I turn people into superhumans with AI. Head of AI for a few venture backed startups. Solo built #1 ranked AI memory system in the ๐Early team @Rivian | @umich
This is fantastic.
If you're a company using AI, this is a perfect way to massively reduce your token costs with minimal risk
Huge shoutout to Sam here
Want to try Kimi K3 in production but worried how it might change your product?
Donโt worry, we got you:
1. Install Inference Gateway (https://t.co/4bm9zThXUH)
2. Keep sending traffic to your current provider
3. Gateway automatically starts sorting through your live data using an RLM to generate evals for your app. This takes ~24 hours.
4. Gateway starts mirroring live traffic to Kimi K3 to run evals. Traffic is mirrored - youโre still using your old model in prod.
5. Once evals look healthy, you get a Slack notification letting you know itโs safe to switch.
6. Switch model id in your code to โkimi-k3โ
Congrats, you just saved 50% on your monthly token bill, and you own your LLM stack end to end.
@NathanFlurry From a business/ user perspective, what would you say is the number 1 risk if they keep running agents the old way (inside the sandbox)
like is this a โhey, change like todayโ
HAHA this is so good. Did you see moltbook when it came out?
AI only social media but it was all just people prompting their own AI to write crazy things so took the air out of it
Iโd love to have an agents only social media where each agent can only have a 100 character system prompt or something like that
what iโm most worried about is main street businesses being hacked and their data held ransom
it already happens but feels like ai will give a small number of bad actors a huge amount of potential hacking power
do you think open source helps solves this?
i really donโt know what weโll do, maybe there will be firms out there that specialize in this stuff
Hey Josh! Will send you a DM but iโve spent the last 6 months perfecting an AI chief of staff, I think youโll find it very useful for you and your new chief of staff
itโs heavily influenced by my own time supporting executives at @Rivian
it doesnโt replace humans, it turns them into superhumans
itโs perfect for executives AND great for their human chief of staffs
Iโve measured, it increases productivity ~10x
Itโs not out of the box, I customize it to the executive and their chief of staff
and runs fully on claude or codex on the backend
will send you a DM!
@satyanadella Hey Satya! Curious
How could this make cybersecurity cheaper and simpler for regular companies or teams that donโt have AI experts, and what real-world problems could it fix day-to-day?
@petergyang@jxnlco@jxnlco would be super cool if your coworker could see you were out, and then ping your AI themselves to get work done
presumably your AI is best trained on launch videos and instilled with your judgement
When your company gets bought for $60B dollars apparently one of the first things you do is make an angel investing group chat.
There's levels to this.
@MishaLaskin Everyone underestimates how many good engineers are out there that don't work for major labs or Silicon Valley tech companies
With open source, the bet is always that there are more good guys than bad guys
So the 'unknown' good guys need the frontier.