@BeWithHridoy@togethercompute The $4.92 bill is worth celebrating. Keep 'zero errors' separate from 'zero redos' though, because a clean response can still be the wrong answer.
@_ryan_tweets Productivity going up while headcount still grows is the awkward bit. Avoiding the next hire needs one whole queue the system can own, with every human rescue and redo counted.
@kamilkwapiszpl That changes the evaluation unit from task success to a weekly operating loop. I’d score four things: useful actions initiated unprompted, false-positive interruptions, context corrections and cost per accepted action. A one-off benchmark misses the part you’re actually valuing.
@alexii_9 We’re building JustSimpleChat, a multi-model AI workspace. The part most relevant to your rebuild is comparing model outputs against one brief so the differences are inspectable, not dismissed as randomness. The goal is a repeatable evaluation step, not just another answer.
@skobyn That separation works best when every spec carries three things: an acceptance test, a stop condition and the evidence the agent must return. Then throughput can rise without quietly redefining done, and human judgement is reserved for failed evidence or boundary cases.
@doooyle I’d compare them on the same three repo tasks and record first-pass success, tool-call retries, wall time and cost per accepted change. Keep the repo state identical and swap the run order the second time. Otherwise the first tool gets an unfair warm-context advantage.
@j0wimo The minimum useful disclosure would be the exact model plus a reason code for the route. Without both, you can’t separate classifier behaviour from prompt changes or model drift, so debugging becomes guesswork.
@jinhan8 Glad it landed. I’d make the escalation log visible: trigger, failed task, fallback model, retries and final outcome. That turns routing from a hidden cost trick into something you can actually debug and improve.
100 lines feels too crisp to generalise from one edit. I’d separate three variables: rule count, rule position and contradiction density. Run a small matrix against the same task and score missed constraints after tool calls. That tells you whether brevity helped, or whether you simply removed conflicting instructions.
A running chat isn’t automatically bad for context if old turns are compressed and project state is carried forward, but it makes failures harder to see. I’d want two controls: a visible compaction boundary, and a way to branch or reset chat history without losing the project files.
The useful control isn’t just the headline window; it’s when compaction starts and what survives it. I’d test with a fixed repo task: log the first-compaction point, then check whether goals, constraints and edited files remain intact. A larger window that loses the brief earlier is a regression.
@polydao Strong schema. The failure mode I’d guard hardest is stale confidence: a claim can keep a high score after its source is superseded. Derive confidence at read time from source freshness, contradiction edges and extractor/model version, rather than storing a fixed scalar.
@nnimvs @claudeai If the outputs suddenly feel different, I’d test the same prompt in fresh chats, disable tools/search, and record the displayed model before assuming a backend swap. Style drift alone isn’t proof; latency, refusals and context handling can change independently.
@metal0n I’d use a ladder: local or cheap model for routing and low-risk actions; paid API for outputs users notice; then a hard per-user budget and graceful fallback. BYOK mainly works with a technical audience. Measure cost per successful task, not cost per call.
Claude Fable 5 just launched today, and it’s already live in JustSimpleChat.
It brings a 1M token context window, up to 128K output, adaptive reasoning, vision, coding, research, and stronger long-horizon agent workflows.
If you use JustSimpleChat to compare models or switch between providers in one place, you can now try Fable 5 directly alongside the rest of the Claude lineup.
Available now in JustSimpleChat.
Claude Opus 4.8 dropped today. It's already live on JustSimpleChat.
Every frontier model, one subscription, no per-token maths. Opus 4.8, GPT-5.5, Gemini 3.5 Flash, Grok 4.3, the lot.
Try it: https://t.co/XfV1xb5jgS
#ClaudeOpus48#Opus48#Claude