Want to try GLM 5.2 in production but worried how it might change your product?
Don’t worry, we got you:
1. Install Inference Gateway (https://t.co/4bm9zThXUH)
2. Keep sending traffic to your current provider
3. Gateway automatically starts sorting through your live data using an RLM to generate evals for your app. This takes ~24 hours.
4. Gateway starts mirroring live traffic to GLM 5.2 to run evals. Traffic is only mirrored - you’re still using your old provider in prod.
5. Once evals look healthy, you get a Slack notification letting you know it’s safe to switch.
6. Switch model identifier in your code to “glm-5.2”
Congrats, you just saved 90% on your monthly token bill, and you own your LLM stack end to end.
Smart consolidation across the #GenAI and #data spaces is a boon for enterprises. 🎉 Congrats to @databricks on the acquisition. 👏
Learn more about the announcement here ⬇️
Benchmark code open sourced here: https://t.co/5edqaNc5eX
I would like to see turbopack team open source their benchmark and methodology as well, or update the marketing materials to reflect the actual numbers.
In 1995, 14 wolves were released into the wild in Yellowstone National Park. Scientists at the time did not suspect that this would radically change the entire ecosystem of the park. 1/n
@scrumtuous "Lowercase numbers exist, but they do not exist on a computer keyboard. In other words, they did not survive the transformation from analog to digital". Ref: https://t.co/KkWZtaw7m2
do hav any ref that other programming lang has this feature? tht would be helpful to get an idea
Request:
Reply to this tweet with an article, podcast, or book that will break my brain when I read it.
Something that will make me unable to view the world the same way as I do right now.
People set goals too high and then get disappointed. We should encourage setting small goals and keeping promises to ourselves. Setting the right goal is half the battle won. A minimum viable goal (MVG) is the smallest goal that you have yet to achieve: https://t.co/cXRdkJZejL
I’m 22 years old and I tested positive for COVID-19.
I’ve been debating on posting, but I want to share my experience especially with those around my age to help bring awareness, and to relieve any stress/anxiety some may have due to the pandemic.