TypeSafe AI has introduced its first model named Jev - a small and customizable System One decision model.
Not being an LLM, Jev can’t reason or write explanations; it generates a fast judgment with calibrated probabilities and a confidence score.
Anything heavier gets split into separate questions and recombined in code.
TypeSafe reports a response time of approximately 150ms per call, at around 100x lower cost and faster responses than LLMs, with pricing at $42 per billion input tokens and free output.
Claude 3.5 Sonnet + Artifacts changed the LLM game.
People are getting creative with wild use cases that were harder with GPT-4o. Is this the new AI king?
10 examples:
1/ How quickly are state-of-the-art AI models growing?
The amount of compute used in AI training is a critical driver of progress in AI. Our analysis of over 300 machine learning systems reveals that the amount of compute used in training is consistently being scaled up at 4-5x/year.
Highlights in thread 🧵