IMO it's very disrespectful to post direct output from an AI into an email, Github comment, or other document intended for human consumption without any annotation saying that it's agent output.
i actually don't want this "but you don't review compiler output either" meme to die.
it's the perfect signal for being immediately able to ignore someone in this space.
@zeeg@icpolicy In wezterm, I can use ctrl+shift+x to enable "copy mode", which lets me select and copy literally any text with ctrl+shift+c. What terminal doesn't support something like this?
@badlogicgames So in the context of pi: (1) start a session, (2) /tree, write prompt. kv cache is valid, all is well. (3) /compact, kv cache busted. they're saying if at (3) you go back to the branch in (2), it will reload the cache from disk, and you won't have to wait for prefill.
@badlogicgames Compaction, system prompt change, branching, tool changes, any context change will require reconstructing the full attention state from scratch. oMLX dumps kv cache to disk so they can bring it back later.
@mitsuhiko Our workspace has thousands of direct dependencies. Some runs of cargo build literally report N/2000, and that's just a fraction of a multi-language repo. It's impossible to avoid dependencies if you're trying to ship quickly.
@mitsuhiko@_austrian@airBaltic@lufthansa Had the same experience. It was also "free" (part of ticket price), so no messing around with paying the extra fee through Austrian's slow portal. They clearly live in the future
@rough__sea You can still put it on the heap with `Box::pin`, and then calling `.as_mut().init()`. Minimal playground link: https://t.co/dt1tEsC3u4 - am I missing something?