Started a small project: tinyllm-engine. a tiny vLLM-inspired inference engine from scratch to understand internals of @vllm_project
Starting with the basics first:
model runners, KV caching and paged attention
The goal is learning the internals deeply by building them myself
I just published a short 8-minute introduction to Ratatui fundamentals.
In this video, I walk through the core concepts you need to understand before building terminal user interfaces in Rust with Ratatui.
We’ll cover the basic structure of a Ratatui application, how rendering works, and the overall mental model behind building TUIs.
If you’re new to Ratatui or have been curious about building terminal apps in Rust, this should give you a solid starting point. @ratatui_rs
for most important dev and contracts I've been doing, cursor is my go-to and its not even close. Many projects I can manage in parallel with claude code/codex, but being able to inspect code and ensure that production systems don't get slopified is super important to me, especially when a common trend for devs is to vibecode. every feature from UX/UI standpoint has been well thought out. back when i used this 6 months ago, i had issues with memory leaks but it seems they made the app a lot more resource friendly and performant.
keep it up @cursor_ai
We’ve received notice that the Department of Commerce has lifted export controls on Claude Fable 5 and Mythos 5.
We'll begin restoring access tomorrow, and will share an update soon.
We’re grateful to our users for their patience, and to everyone who worked with us on redeploying the models.
@AnthropicAI@elliotarledge Curious what changes during a redeployment like this. Is it infra, compliance updates, or are there model-level changes as well?
Got the paged KV cache running with huggingface Qwen3.
One thing I appreciated while doing this is that Grouped Query Attention doesn't really complicate the memory manager.
The block allocator still allocates token blocks. The only difference is that each block contains fewer KV heads.
That's why GQA saves memory without changing the basic paging mechanism.
At OpenAI, we're continuing to bet on Rust as the future of systems programming.
I'm proud to announce that we're making a $600,000 commitment to the Rust Foundation, which combines our Platinum membership with additional support for maintainer efforts across the Rust ecosystem.
@charliermarsh Interesting, Curious where you see Rust expanding the most over the next few years: inference infrastructure, agents, networking, or something else?