@KanishkaNarayan@AnthropicAI not just the base models need to be sovereign, even the vertical specialized models have to be owned by enterprises to stay independent
@BlackHC 1. build compute yesterday 2. get the best people in a frontier ai lab filthy rich building a competitive open source model 3. subsidise enterprises post training specialized models for their use cases on top of that model.
hey @HarryStebbings loved the discussion about oss models but i think you should take this discussion a few years forward. when looking at nvidias just released chips you can see the industry is preparing for a future where in just a few years current level intelligence will be on local hardware. not sure that future makes me incredibly bullish on the frontier labs.
pcs went from the size of a house to a slap in your pocket before and we will see it again!
Emotion-steered LLMs at 300+ tok/s on an L4 with batching.
We built open source library that lets you serve an OpenAI-compatible API where request pick its own affective direction from an api parameter, fearful, surprised, angry, without breaking vLLM's batching.
Open source, with a write-up of how it works:
https://t.co/Dz6Ei3sO2t
@levelsio to be fair the leaked product in these screenshots is supposed to enable more people to build for smaller audiences. i think the 100k/y to 5m/y businesses are likely fine