Mentally thinking that baselining at a singular metric of Revenue Per Token (I'm sure there is more granularity needed here) is where a new business needs to optimise for. Especially as more of the automation will be handled by agent factories!
Opus 5 constantly misleads by saying it's doing something when I need to ask it to follow through with it. Consistently too.. which was making me question the harness this was running in. Turns out raw sessions are equally bad.
Now on to trying to visualise the universe I have access to as the backtest was running limited positions.. This gives me a good understanding of what’s happening under the hood.
Some of the earlier work around setting up a DB with prices etc is now paying off. I’m now able to visualise what price action was doing when a trade was placed and really start to think about what my initial filter criteria should be from a TA viewpoint.
Added a vol sizer to the trading project and now i have drawdowns under control at the cost of performance of course. However fairly pleased that my backtesting pipeline is relatively stable!
Spent today working up a Streamlit app that helps me dissect my backtest logs.. Considering i still do not have a baseline for if the pipeline is good, the only way to do this was a viz check. And benefits already. Time to figure out why SPY data is not being pulled through :D
Spent the day yesterday getting vLLM deployed using ECS. There is a GPU enabled task which seems to work ?! Now to see how this “scales” for heavier workloads. I probably will need to implement a backoff mechanism since it takes a few minutes for the container to be spun up!
Coming back to the project after the holidays. This looks too good to be true and it probably is. Currently getting into the weeds of the trade ledger and seeing what the crack is. I think i’ve also reached the limit of o1 understanding what it is that i’m asking for it to do.
And the trading project is growing well. I’m so glad i decided to bake in some unit tests from the start. Got out of many a hole with o1!
Now debating on parquet, csv or sqlite before I do some serious e2e test runs.
Spent the last week or so trying to codify my brain from while trading options over a 3-6 month period. Right now focused on working out the best risk:reward setup given a long and short spread spread trade. 1/8th the work done!