Lesheng Jin

Inference @databricks

[Yuchen Jin @Yuchenj_UW]

Databricks ranks #1 on NVIDIA’s SOL-ExecBench kernel leaderboard, in the L1 single operation track, powered by KDA (Kernel Design Agents) 🎉

What’s crazy is: we 100% leveraged AI agents to beat the competition.

This is a sneak peek at recursive self-improvement. The core frameworks we used were KDA, Humanize, and Omnigent: Claude writes code, Codex reviews. Together, they enabled agents to run autonomously for as long as possible. The key is setting up the right framework to let the agents cook.

This work was driven by @leshenj15 at Databricks, in collaboration with NVIDIA and MIT HAN Lab’s @LigengZhu and @DongyunZou03 .

Databricks AI is like a neolab. Join us if you’re cracked!

[Yuchen Jin @Yuchenj_UW]

You may have heard that GLM-5.2 at 328 token/s is cool,

How about 392?

Databricks is now #1 in inference speed for GLM-5.2 on Artificial Analysis. It's a great model, and we did a lot of optimizations.

[Yuchen Jin @Yuchenj_UW]

An OpenAI friend told me he burns 300M GPT-5.5 tokens/day.

The top one in his team burns billions of tokens/day. Codex coding for them every night.

Databricks also gives engineers unlimited tokens.

We're looking for cracked inference engineers to join us at Databricks AI to produce trillions of tokens, insanely fast. DM me if you have:
- Contributed to open-source ML systems like SGLang/vLLM/PyTorch
- Experience serving LLMs at large scale

Databricks AI runs like a startup. Lots of exciting things to build!

[Lesheng Jin @leshenj15]

@Yuchenj_UW

[Yuchen Jin @Yuchenj_UW]

I have decided to step down as CTO at Hyperbolic.

Leaving a company you co-founded and poured your heart into is not easy.

So many moments still feel vivid: launching our AI inference product for open-source models and seeing tens of thousands of developers sign up in a week; the week we were hit by a massive DDoS attack and the entire engineering team fought around the clock until we won; the day we launched the GPU platform and watched ARR take off.

There were also hard moments. That’s the nature of building a startup. I’m grateful for all of it.

What I’m most grateful for is the team. Thank you for your trust. Most startups never build something people want. I believe we did. You should be proud of yourselves. I will look forward to seeing your success.

What’s next for me? I’m still figuring it out. I believe this is the most extraordinary moment in human history. We’re standing at the edge of the Singularity. AI will reshape everything, and I still feel the same excitement I felt when I first fell in love with AI.

Time to start over. Time to climb another mountain.

Thank you to everyone who has been part of the journey,
— Yuchen

[Lesheng Jin @leshenj15]

@junrushao 严肃程序员

[Lesheng Jin @leshenj15]

@Yuchenj_UW new interview: debug the code generated by llama

[Lesheng Jin @leshenj15]

@AlexanderTw33ts @ChatGPTapp banger

[Lesheng Jin @leshenj15]

@Yuchenj_UW @_thomasip lol

[Lesheng Jin @leshenj15]

@Yuchenj_UW Meta fired a bunch of talented employees to cover up the fact that too many talented people had left.

[Lesheng Jin @leshenj15]

@simon_zhai @Yuchenj_UW lol

[Yuchen Jin @Yuchenj_UW]

We just launched On-Demand GPU Cloud at Hyperbolic!

- H100s at $1.49/hr
- reliable nodes with persistent storage
- spin up a cluster of GPU nodes with Infiniband in just a few clicks

Tell me what you're building. I'm giving out free credits to cool projects.

[Lesheng Jin @leshenj15]

@mepps32

[Yuchen Jin @Yuchenj_UW]

🚀 Excited to share that we raised a $12M Series A!

At Hyperbolic, our mission is to build an open AI platform. By "open", we mean:

> Open GPU marketplace: Think of it as GPU Airbnb—anyone can contribute their GPUs. We’ve started providing H100 SXM at $0.99/hr, the lowest price you can find anywhere. More people from "GPU poor" to "GPU rich" means more AI innovation.

> Open-Source Models: We believe open-source is the future of AI. We’re committed to hosting and supporting these models, and since launching our inference service 5 months ago, more than 40,000 developers have used us.

> Open community: Transparency and collaboration are at the heart of what we do. By building in public, we hope to create maximum value and the best products for our users. Let us hear your feedback!

Now we continue to accelerate! 🌪️

[Lesheng Jin @leshenj15]

@syeddhasnainn @Yuchenj_UW @hyperbolic_labs @Alibaba_Qwen @openrouter Thank you for the feedback! I tried on my side, and the result seems good. This result might come from other platform. Did you choose Hyperbolic as the only provider on OpenRouter? Let me know if you meet any issues.

[Yuchen Jin @Yuchenj_UW]

Launching @hyperbolic_labs "hyperbolic-gradio" package, and our first HuggingFace spaces app similar to Claude Artifacts.

Here's how I built a tic-tac-toe game using the app, with just a prompt.

Shoutout to @_akhaliq and the @huggingface team for setting up the hyperbolic-gradio package. It makes deploying a @Gradio app with Hyperbolic Inference API incredibly simple.

This app leverages the package to call Hyperbolic Qwen2.5-Coder-32B-Instruct bf16 API to write code.

[Lesheng Jin @leshenj15]

@AnalogPvt @YayaSoumah @hyperbolic_labs @JustinLin610 @huybery Frontend stuff. It's 0.2 now. Thanks for the info!

[Hyperbolic @hyperbolic_labs]

Hyperbolic’s inference service has hit over 1 BILLION LLM tokens daily!

This achievement highlights the growing demand for our AI services and the trust our community members place in our platform.

With 22 models (and counting), we’re dedicated to offering top-tier AI models at a fraction of the cost.

💜 Build with us: https://t.co/PdfiigOcRF

[Hyperbolic @hyperbolic_labs]

Introducing the Hyperbolic Ambassador Program

At Hyperbolic, we believe in a future where AI is open source, decentralized, and accessible to all. This program engages those who are committed to decentralizing AI while supporting career growth.

Earn up to $1,000 in platform credits and $2,400 in meetup credits. Whether you're a startup founder, university researcher, developer, or simply enthusiastic about AI, we want to hear from you.

➡️ Apply by October 9th, 2024
https://t.co/DyKEXGcpxM