Had a fun conversation with @HarryStebbings on all things Model Independence, Software Factories, pricing wars…
And sprinkled in some hot takes that I may or may not regret sharing 😳
Reliability is built into @droid. Factory Router has auto-failover across model providers, so your sessions keep running even when one of the providers goes down.
We also provide dedicated compute capacity for enterprises, and we reserve a guaranteed TPM (token per minute) allocation.
We believe that diversifying LLMs in your agent stack is the future, and the way to achieve the highest reliability in production.
Introducing model routing to Factory.
Factory Router picks the right model for every task, automatically.
Maintain frontier performance while cutting costs by 25%.
Update, in the last 9 days since launch this has saved our customers over a hundred billion tokens already.
In addition to the context savings this provides, this helps prevent unnecessary context bloat which lets Droid stay focused on its current task for longer.
We plugged the CLI into @FactoryAI@Droid and within 15 minutes had:
- Daily automated spend briefings pushed to Slack
- WoW and MoM vendor analysis with anomaly detection
- Vendor management automatically cross-referenced with Google CLI (gmail, drive, etc.)
- Automated spend alerts routed by category to the right person in Slack
(fake data Slack message below)
@shl Trying to get an EIN. Online won't work. I call, the system is down call back on Monday. Can we just make this work online? And does the application really need to be live certain hours of the day?
@itunpredictable Used Technically to bring myself and then new non technical colleagues up to speed. Appreciate what you built. This feels like a great next step
@IAmClintMurphy@pslohmann@rhpMike I’ll take the other side of this. As someone who has had previous bosses basically schedule send 9am emails/messages every morning. I’d rather have those messages sent like Peter mentions rather than wait on the edge of my seat every morning for the wave that was going to hit