Today we’re launching Echo: Fable-level quality at ~1/3 the inference cost using open-weight models.
Echo matches or nearly matches Fable on math, science, and the coding benchmarks we currently cover, while trailing on multilingual and broader knowledge. 🧵
Try Echo:
https://t.co/oIymERQqB2
Read the full Launch YC post:
https://t.co/QI1TjFwwSF
Running meaningful LLM inference in production? Work with us to optimize Echo for your workload:
https://t.co/wxSV5IClPw
Today we’re launching Echo: Fable-level quality at ~1/3 the inference cost using open-weight models.
Echo matches or nearly matches Fable on math, science, and the coding benchmarks we currently cover, while trailing on multilingual and broader knowledge. 🧵
Every company’s AI traffic has a shape.
For teams that work with us, Echo can be configured around their workload, quality bar, and data requirements to optimize inference further.
Public Echo does not train on users’ private traces.
Tracer just launched on @ycombinator's Launch YC!
Tracer: Fable-level AI at 1/3 the cost using open-weight models. Check them out: https://t.co/QI1TjFwwSF
Today, we’re introducing Echo: one adaptive model built entirely from a pool of open-weight models.
On our first internal task mix, Echo reached Fable-level results at roughly 1/3 of the total inference cost.
Try it: https://t.co/oIymERQqB2
Today, we’re introducing Echo: one adaptive model built entirely from a pool of open-weight models.
On our first internal task mix, Echo reached Fable-level results at roughly 1/3 of the total inference cost.
Try it: https://t.co/oIymERQqB2
We’re releasing Echo now to learn from real workloads and keep pushing the approach forward.
Full evaluation methodology, results, and limitations:
https://t.co/mbW9lUOaSF
You can use Echo through the chat or plug its OpenAI-compatible endpoint directly into OpenCode and other compatible tools.
New accounts include $10 in free inference credits.
Try it on something hard:
https://t.co/oIymERQqB2
Tracer 0.2.0 is out New: tracer scan reads your LLM classification traces and tells you, on held-out data it never saw, how much traffic a near-free model can already take over, with an interactive 3D map of your embedding space and more... 👇🧵