@TheZvi fable is the first model where i'll ask it to do something and despite not even so much as hinting as to why i'm asking for it it'll correctly clock the *ultimate* goal of the project even though that requires quite a few logical leaps
@hackerdocc this happens in the native harnesses as well btw (fable has decided to only use python to edit in a long-running convo for me ... hooray for token efficiency)
@tszzl I've wondered this, but the most annoying verbal quirks are encountered specifically when they are reward hacking you socially (making excuses / downplaying issues). Personally, I just want them to say "uhhh shoot yeah, that's right, my b"
The "should you read code" debate is dumb because the real decision isn't binary, it's a scale:
1. Reading every line of every diff
2. Scanning every diff, reviewing important lines
3. Ignoring diffs but understanding the 'why' of every PR
4. Spot checking PR's instead of reading every one
5. Ignoring PR's, but doing regular spot checks on the codebase
6. Ignoring the code, but spot checking agent traces to help improve the system
7. Ignoring both the code and the system, let models handle everything
Where are you on the scale?
@rezoundous it's a token saving technique for when you are doing something that involves a lot of output tokens, but don't need the taste of Fable when writing
I don't expect it to be generally applicable
@jon_stokes I feel like the input / output math here is so simple, genuinely what kind of cooking the book here is even possible? are you saying that GPUs are secretly a lot more expensive than what they are paying hyperscalers / NVIDIA? or double counting revenue?
everything is way too slow after you hit really long conversations (I have conversations that are multi million tokens long)
opening the conversation is slow
multi gb log files
forking is slow
network requests for remote access time out
but worth it because compaction is good
@TheMindScourge doesn’t this actually imply that firms are faced with anti-monopoly regulation (ie. how much hate Amazon and Walmart get), it IS easier and more profitable to focus on higher income customers?