We started Seldon less than 3 months ago as an API gateway, then a compiler to help make LLM powered applications run cheaper, faster and more reliably.
We have seen a 300+% MoM user growth in that period with many interesting client conversations that have eventually led to our expanded focus on this concept of Semantic Compute: helping existing AI apps run repeated work across code, specialized models (Jev, GLiNER), and LLMs.
We’re still finding the right developer experience, full details to be revealed soon.
What have you tried to move off an LLM?
Hey all 👋
We are a team of ex: quant researchers, MLEs and data scientists working on some exciting ideas in:
Program synthesis;
System one models;
AI workload optimization;
RL envs in multi agents and partially observable scenarios;
Inference optimization;
If you are working in any of these areas, let's connect🤝
System one models are a good idea, but in practice it's still pretty hard to refactor an existing LLM based application logic into one that uses these lighter and more cost efficient models.
https://t.co/Lds9b7Xrnr
@nishantkumar07 I am curious if this is also related to the increased leverage in hedge funds in recent years that the Feds are concerned with. Any thoughts on that?
System one models are a good idea, but in practice it's still pretty hard to refactor an existing LLM based application logic into one that uses these lighter and more cost efficient models.
https://t.co/Lds9b7Xrnr
System one models are a good idea, but in practice it's still pretty hard to refactor an existing LLM based application logic into one that uses these lighter and more cost efficient models.
https://t.co/Lds9b7Xrnr
Spoke with more than 20 data vendors in the last two weeks.
Can confidently say that the AI training data space is a cottage industry full of LARPers with no access.
Most people probably aren't even making 6 fig in revenue.