We’re excited to share that @ArtificialAnlys has validated Clarifai's Compute Orchestration with GPT‑OSS‑120B as one of the top‑performing GPU inference platforms globally. 🚀
What the data shows:
• 0.27s Time‑to‑First‑Token (TTFT) → tokens start streaming almost instantly.
• 313 output tokens/sec → among the very fastest measured.
• $0.16 per 1M tokens (blended) → this undercuts the $0.26–$0.28 cluster while maintaining top‑tier performance.
Placed in the benchmark’s “most attractive quadrant” for high speed + low price.
This is the payoff from years of building and operating inference infrastructure:
👉 Press Release here: https://t.co/nSkshnTeAR
Modern football is too robotic for players, all it takes is one game for messi to do mockery on modern football … player barely covering ground or pressing but still produce magic day in day out.
They are the “ballers” and they are the ones keeping the game alive.
#messi
Everything has a pattern ! Modern football is already controllable from outside pitch.
That’s where players like yamal bruno cunha messi kdb cherki olise musiala salah hazard type players come in and change the flow/state of the game. The bunch who kept/keeps this sport alive.
Everything has a pattern ! Modern football is already controllable from outside pitch.
That’s where players like yamal bruno cunha messi kdb cherki olise musiala salah hazard type players come in and change the flow/state of the game. The bunch who kept/keeps this sport alive.
We’re teaming up @Palmeiras, the first football club to meaningfully build upon TacticAI: our AI system that can help simulate field scenarios and predict open play dynamics up to 8 seconds in advance. ⚽
Seen first time at chepauk a crowd goes bizarre for every ball of the spell of a foreign bowler !
Overrrtonn…overrrtonnn chants all over the stands !!
He earned this respect 🫡 @JamieOverton 🐐
JAMIE OVERTON ON CHEPAUK CROWD: [JioStar]
"Chepauk has one of the most passionate crowds I have played in. When I first came here last year, I remember saying in an interview that it was almost louder than a Premier League game. They are among the best crowds, follow us everywhere. It is amazing to get all the support here & I am loving my time in Chennai". 🥹💛
Software horror: litellm PyPI supply chain attack.
Simple `pip install litellm` was enough to exfiltrate SSH keys, AWS/GCP/Azure creds, Kubernetes configs, git credentials, env vars (all your API keys), shell history, crypto wallets, SSL private keys, CI/CD secrets, database passwords.
LiteLLM itself has 97 million downloads per month which is already terrible, but much worse, the contagion spreads to any project that depends on litellm. For example, if you did `pip install dspy` (which depended on litellm>=1.64.0), you'd also be pwnd. Same for any other large project that depended on litellm.
Afaict the poisoned version was up for only less than ~1 hour. The attack had a bug which led to its discovery - Callum McMahon was using an MCP plugin inside Cursor that pulled in litellm as a transitive dependency. When litellm 1.82.8 installed, their machine ran out of RAM and crashed. So if the attacker didn't vibe code this attack it could have been undetected for many days or weeks.
Supply chain attacks like this are basically the scariest thing imaginable in modern software. Every time you install any depedency you could be pulling in a poisoned package anywhere deep inside its entire depedency tree. This is especially risky with large projects that might have lots and lots of dependencies. The credentials that do get stolen in each attack can then be used to take over more accounts and compromise more packages.
Classical software engineering would have you believe that dependencies are good (we're building pyramids from bricks), but imo this has to be re-evaluated, and it's why I've been so growingly averse to them, preferring to use LLMs to "yoink" functionality when it's simple enough and possible.
Holy cow ! Always rated litellm higher than any other llm wrappers. Sad to see them going through this. Shows why we need to be more careful in using Opensource packages in prod environment.
LiteLLM HAS BEEN COMPROMISED, DO NOT UPDATE. We just discovered that LiteLLM pypi release 1.82.8. It has been compromised, it contains litellm_init.pth with base64 encoded instructions to send all the credentials it can find to remote server + self-replicate. link below
🚨 LAST CALL for ingress-nginx!
If you haven't migrated your workloads, the best effort maintenance will end by the end of March.
Read the official statement:
🔗 https://t.co/JFZwZa8HF6