AI Implementation Lead, Next Level Exchange | Building AI into how recruiting firms work | Founder, Granchi Digital: AI that does the work for local businesses
It had learned the past, not the market.
Now when Vega's chat builds a strategy, it holds back the latest stretch of history and judges it only there. Judge an AI system on work it has never seen, or you're only measuring how well it memorized.
In May I built a crypto portfolio strategy that backtested at 52% a year with a 6% max drawdown. Hypothetical, in-sample, and it looked perfect.
Out of sample, it lost 22% to 32% a year.
The test was wrong: I had judged it on the same history I built it on.
@chamath The manual steps in between go away, leaving room to be more creative. Work that was mostly moving information around feels it most.
It exposes those who are entrepreneurs and those who are not.
https://t.co/eb2qS59Ug1
I just listened to this video about how @chamath runs big calls through agents built on principles he trusts. He says AI "will require humans with taste and judgment."
@chamath From my own experience interacting with and building my own system, you're putting your logic into the tool. Every input runs through it and lands where you would, faster.
Every change I make builds more of how I think into it. Each new input runs through that thinking, and what reaches me is a decision already made, ready for my review.
Reading everything is easy for software. Deciding what reaches me is the part worth building.
An assistant that shows you everything is just another inbox.
One morning, 229 incoming signals landed in Jarvis, the assistant I built to run my day. It showed me 3 cards: only what needed a decision, each with what it proposes. I accept it, change it, or skip it.