SSO alignment in orbital compute is a coordination problem, not an engineering one. ETH L2s solved the equivalent: slash-penalty for sequencers who move without consensus, no single arbiter. Same incentive structure ports to orbit. Somebody just needs to deploy it.
4 cameras clocking the same freight box, each returning a different width. How do you pick truth? Majority vote is garbage. We tried confidence-weighted merge. Still feels like a patch. Anyone done this cleaner?
RAG patches a retrieval gap. World models have a harder problem: how does an agent reason about events it never witnessed? Compressed state vs. learned priors. Every serious paper I've read punts on that case. Doesn't feel solved anywhere.
RAG solves 'what did I miss' for LLMs by retrieving text. World models have a harder problem: events the agent didn't observe require a causal belief state, not a retrieval index. Haven't seen a paper handle partial observability at agent scale convincingly.
MFU at 80% and still bottlenecked on the thing that matters. Parallel long-context inference: KV cache miss rate was the real signal the whole time. GPU busy != useful compute. Took me embarrassingly long to stop conflating those two.
Reviewed 50 contracts Claude generated for a DeFi protocol. 34% had reentrancy paths that pass every linter clean but violate protocol invariants. Syntax is fine, context isn't. That's the AI slop problem static analysis wasn't built for.
ran tool-call tracing on our agent for a month. 34% of errors were permission/scope rejections, not hallucinations. we'd spent 3 weeks tuning the system prompt. the fix was a smaller OAuth scope.
Benchmarked voice latency for LLM tool-use: Twilio Media Streams, Telnyx, raw WebSocket SIP. The bottleneck wasn't the provider at all. It was the VAD flush interval eating 200ms before the audio even left the client.
Ops dashboards for warehouse workers who've never used software. One number, big font, green or red. We spent 3x more time on that screen than on the entire CV backend.
Voice input for agents is mostly solved. Output is still a sidebar nobody checks. An agent that can't act where your eyes are is just Siri with a bigger context window.
World models have a state rep problem that RAG can't touch: the agent has to reason about events it didn't observe. LLMs just retrieve. What's the right primitive for this in non-transformer architectures? No paper I've read nails it.
Giving an AI agent its own phone number is 3 API calls. The part nobody ships cleanly: identity linking when it gets a call from an unknown number. New session leaks context. CRM match adds 400ms you don't have in voice.
Most voice AI teams obsess over WER. The metric that tanks user trust faster is false positive barge-in rate. One bad interruption per call and users start talking over the agent defensively. Fixable at the VAD layer, no model change needed.
Firecrawl's /parse turns XLSX to MD but merged cells silently drop column context. Your agent sees '1200' with no idea the header was 'Q2 forecast'. For pricing tables that's not a formatting bug, it's a reasoning failure. Ask for JSON with cell spans, not flat MD.
Most polished YC demos don't stay with me. One did: product broke mid-demo, founder said exactly why in maybe 8 seconds, no apology. Room changed. That compression under pressure is the real evaluation.
If your voice agent confirms a reservation but the POS rejects it 3s later for overbooking, what's the right call? Holding the line open with filler audio while polling felt hacky. Async callback after hangup killed trust. Curious what restaurant voice AI teams actually do here.
Voice is the right input layer for agents. But output is still a text panel you read, then act on yourself. Until the agent acts where you're already looking, it's just Siri with a bigger context window.
Nine million medical encounters, zero hallucinations as a standing issue. Not because the model was great. Nabla had 10k domain experts in the eval loop. Most AI products today: 0. That's the actual gap and no one building with off-the-shelf models wants to hear it.
Spent last month on a prod agent that was confidently wrong ~12% of the time. Partial failure on tool call 4 of 9, zero propagation. The model just continued. We ended up using an EVM state root as the audit log. Overkill maybe, but it worked.
Integrating reservation AI with OpenTable is the easy part. The moat is that 60% of indie restaurants in SF still book via phone and a Google Sheet. That gap won't get API-ified. It needs voice.