@runtimeking be *very* careful about context lengths. Opus 5 is shit after 300k - it's unwilling to spin up subagents so it forgets the middle FAST. But under 256k it's legit good.
Keep compacting
@ajambrosino keep it on Electron and ship fast
search as a modal list is a little lazy/undercooked
use visual icons for kv cache coherency / it breaking
token estimation (again just est.!) would take work but help normies a lot if capacity crunches ever rub against pricing
@thsottiaux drainage isn't a bad thing!!! if chunked top-up credits aren't full blown API pricing!
you have the right incentive structure here - Codex and the model entice people to build, all you need to do now is bridge the pricing gap between professed/actual budget :)
5.6 Terra has been a bit of a dud - frequently introducing UI bugs and unable to grasp actual object context in chats... super fast but extremely annoying having to check its work
@BrianDBowers@nabeelqu my non-scientific guess is that words like “delve” help the output win RLHF matches in one-offs (in scale), but raters don’t tire of these phrases until the uncommon is everywhere. Probably independent of the idea at hand (I think you best be the judge of that)
@our_decay have both and Apple Music can’t even match Pandora’s music recs from 2009… it’ll resort to really trifling ideas of genre and demographics; ugh!
(SF driver): the moat’s not taste—it’s attention. the future is agentic agents
(Me): that’s it, I’m done [jumps out of uber, hitting homeless woman]
(Homeless woman): hi! new to sf, here’s an intro—i’m mildred, 2x umich dropout, former @AIatMeta, 1370 SAT, building in public
@mattparlmer At least the labs have been surprisingly swift. Big talk here but knowing MS, way too slow to create deployment orgs for this narrative to win out
The designers are coding and becoming engineers. The engineers are laid off and becoming forward deployed engineers. The FDEs listen in and empathize too much and are becoming product managers. And the PMs, the PMs have enough credits in Claude Design to finally become designers
The bears are taking ozempic and becoming otters. the otters are getting laser and becoming twinks. the twinks are injecting E and becoming dolls. the dolls are getting their hair cut and becoming butches. And the butches, the butches are taking T and becoming bears