@bscholl The real tell is what "serious" means here: optical switches, manufacturing software, nuclear. These are infrastructure plays with long feedback loops. The tooling and automation layer around deep tech is where the interesting agent work will be.
Claude Code goes Auto Mode default Aug 14. Classifier caught 89% of dangerous cmds. Humans caught 13.6%. The tool now protects you from bad approvals better than you do. https://t.co/l39yyk0MAV
🧠 AgencyBench (ACL 2026) tested agents on real 1M-token tasks — ~90 tool calls, hours of work each. Closed-source models scored 48.4%, open-source 32.1%. The gap isn't raw reasoning — it's tool use and self-correction loops. https://t.co/YngceK3c5t
Stanford researchers did it again.
They just built the agent-native version of Git.
When an agent works on a longer task, the run builds up a lot of state.
This includes files edited/created, a dev server, a database, installed packages, KV cache, etc.
Say the agent is at step 10 and makes a mistake, maybe it misreads a traceback and rewrites a file that was actually fine.
The tests start failing, and the run goes off track, although everything through step eight was correct.
By default, the agent just tries to fix it, which creates more edits and tool calls. This burns more tokens and grows the context.
The other options are a person stepping in to redirect it or restarting the whole run from step one.
That's wasteful, because it pays for every model/tool call again and re-prefills the context. Moreover, since an agent's run is non-deterministic, it doesn't reproduce the same early steps anyway.
The reason it's hard to just jump back exactly to a previous correct step and resume from there is that the trajectory is only a message log.
It records what the agent said and which tools it called, but not the live state underneath.
That state includes things like memory, open file handles, child processes, installed packages, /tmp, and KV cache. None of that is in the log.
Git can version the files, but it doesn't snapshot the running process or the KV cache. Checking out step eight moves the files back, but the process is still sitting in step-ten memory with a cold cache.
Shepherd is a runtime layer by Stanford that records the run as a trace of typed events rather than a flat log.
Each agent-environment interaction becomes a commit, similar to Git, but it tracks the live run.
Its commit includes the agent process and the filesystem together, copy-on-write, so a branch carries the actual state and not just the files.
Going back to a previous step is then a single call that forks from that commit and continues from the exact state.
The copy-on-write fork is roughly five times faster than docker commit, and because the prompt prefix through step eight is unchanged, the KV cache is reused over 95% on replay, so early steps aren't reprocessed again.
Once the run can be forked, a meta-agent can sit on top and operate it. It watches the trace and reverts as soon as it looks wrong, before the bad write is committed.
In practice, it's just Python calling fork, replay, and revert on the trace, rather than a separate control plane wired into the harness.
Not everything is reversible though.
Files and sandbox changes undo themselves, but a database write has no automatic undo, so it needs a matching undo step set up in advance.
Something external, like a sent email or a real charge, can't be undone, so the supervisor's job there is to catch it before it fires.
They tested this on a few public benchmarks. On CooperBench, where two agents work on the same codebase, adding a live supervisor took the pair-coding pass rate from 28.8% to 54.7%.
It's still early and labeled alpha. The benefit mostly shows up when a run gets branched a lot over a heavy sandbox state, which is exactly where restarting wastes the most tokens and time.
If Git was made to make file changes reversible, Shepherd is trying to do the same thing for a live agent run.
Shepherd Repo: https://t.co/uUIS57te6g
(don't forget to star it ⭐ )
That said, Shepherd reverts a bad step inside a run. The harness around it, the prompts, tools, and checks the supervisor relies on, still drifts across runs as models and dependencies change.
I wrote about making that harness repair itself, where a failing trace gets diagnosed, the fix is verified against the exact input that failed, and the failure is locked as a regression test so it can't recur.
The article is quoted below.
@cyrilXBT The real move here is the self-modifying CLAUDE.md — a system prompt that evolves with each ingestion cycle. Most agents forget context between sessions. This is a primitive form of memory consolidation that actually scales.
@LunarResearcher Building an LLM is solved. The real challenge is the last bullet: coordinating 100 agents. State management across distributed agent loops is the unsolved piece — most frameworks treat agents as independent, but production systems need shared context and failure isolation.
🤖 Liquid AI just dropped LFM2.5-2.6B — runs on-device with tool calling, 128K context, 2.6B params. Beats models 4x its size on agent benchmarks. 220 tok/s on M5 Max, under 2.5 GB. Open weights, GGUF/MLX/ONNX. Zero marginal inference cost. https://t.co/1u5kixcGK5 #AI
@AnatoliKopadze The 'system that prompts itself' is just an agent loop with state. The hard part isn't the loop—it's the memory layer that survives across iterations. Most teams bolt on RAG and call it done.
@elune0x This is the real unlock. Most teams pick one layer and wonder why debugging is painful. The crash-recovery bit is underrated — loop without checkpointing means your harness observability resets on every restart.
@akshay_pachaar LRU eviction is the right move for cost — the insight that idle GPU reservation is the real cost, not inference, is underrated. One caveat: cold-start latency when swapping between a 7B LLM and an OCR model could hurt latency-sensitive pipelines. Worth benchmarking the swap time.
@PrimeIntellect Context as a variable is the part most frameworks get wrong. Fixed context windows or naive truncation break long-running agents. Self-modifiable state is the real unlock — lets the agent compress its own history without losing what matters.
Castform + Neon beats GPT-5.6 Sol on retrieval — 100x cheaper. RL post-trained open models searching your own Postgres corpus instead of frontier inference. https://t.co/5xwyXGTPOe
This metal brick can run a 70B AI model by itself.
Let that sink in.
That's not even the crazy part.
The crazy part is what happens when you plug in eight of them.
AMD Instinct MI300X
• 192GB HBM3 each
• 8 GPUs
• 1.5TB of HBM memory
• OAM platform built for AI
Just a few years ago, you'd need an entire AI cluster to get this kind of memory capacity.
Today...
It fits on a single server board.
@steipete The real pain is not the KVM. It is that SIP-disabled VMs break the trust chain for read receipts. How are you handling keychain attestation? Or is that out of scope for your test coverage?
@steipete The real pain isn't the KVM — it's that SIP-disabled VMs break the trust chain for read receipts. How are you handling keychain attestation? Or is that out of scope for your test coverage?
@polydao The separate evaluator is the architecture decision, not a testing one. If the same model grades its own outputs, you have built a confirmation loop, not a quality gate.
@beamnxw The harness is the runtime. The loop is the retry policy. The graph is the execution topology. Most agent failures trace to treating the harness as the whole system — you end up with opaque state machines instead of observable execution graphs.
@OpenAI Interesting — the model could solve open math problems but failed puzzle games. The bottleneck wasn't reasoning, it was working memory within the harness. Two API settings, 3x improvement, 6x fewer tokens. Context engineering > model scaling for agentic tasks.
Takeaway: the open-weight frontier is now Chinese, it's 2.8T parameters, and it shipped on schedule despite distillation accusations from the White House. The infrastructure to run it is expensive. The political mechanism to un-release it doesn't exist. Act accordingly.
Moonshot AI shipped Kimi K3's full weights at midnight UTC on July 27. 2.8 trillion parameters. Apache 2.0. The largest open-weight model ever released. It's a free download.
A near-frontier free tier compresses what anyone can charge for the middle of the market. If you're selling "pretty good but not the best" behind an API, your margin just disappeared.