How LLMs work under the hood?
This is the best place to visually understand the internal workings of a transformer-based LLM.
Explore tokenization, self-attention, and more in an interactive way:
China dropped these open-source models in July:
- GLM-4.5
- GLM-4.5-Air
- Wan-2.2
- Qwen3 Coder
- Qwen3-235B-A22B-Thinking-2507
- Qwen3-235B-A22B-2507
- Kimi K2
Meanwhile:
- OpenAI still hasn’t released the open-source model
- Anthropic is doing stricter rate limits
- Meta might be walking away from open source
The future of open AI may not be led by the West.
The latest MLX has a CUDA back-end! To get started:
pip install "mlx[cuda]"
With the same codebase you can develop locally, run your model on Apple silicon, or in the cloud on Nvidia GPUs.
MLX is designed around Apple silicon - which has a unified memory architecture. It uses the same design with CUDA. So there's no need to move arrays around from CPU memory to GPU memory.
Note, this is early days - some operations are missing and performance is still being optimized.
But it's already quite fast for Transformer training, text generation, and more! Here's a demo using mlx-lm to generate text with Llama 3 8B (bf16) on an A100:
People like Anil are the unsung heroes of our nation. 🇮🇳
They don’t just work—they feel the pulse of the people, understand their hopes, and deliver with heart and honesty.
It’s efforts like theirs that lay the foundation for rebuilding a stronger, more compassionate India. 🙌
@AirIndiaX@MoCA_GoI I flew with Air India Express, but my luggage wasn’t sent to the destination city. A PIR was filed, but no one is responding to calls or updating me. I urgently need my baggage for a planned trip and this delay is ruining everything. @consaff#MissingLuggage
@AirIndiaX You should have people like who believe in getting the work done Anil. On that very same helpdesk people like Anam, Muskaan and their supervisor were there to whom I literally begged about my luggage but they did not bother to listen and all they had was attitude
Though I must clarify that it was not an Airline but a person himself who went out of his way to help people around them. Be grateful for having such people @AirIndiaX
@AirIndiaX@MoCA_GoI Thanks to superheroes like Anil Kesarwani from Delhi Air India Express team with whom I had a very brief discussion about my luggage. He understood my concern and got my luggage deliver at Kullu Airport single handedly though he was out of duty #appreciation
@izhargbc@AirIndiaX@RafiqueAhmad_@JM_Scindia@PatnaAirport@blrairport_kn Same here! I had a trip planned for 10 days and they did what they are best at, left my luggage at the source airport itself. Funny part is that they did not have an idea for 3 hours about where my luggage was….still not received it. Pathetic service ever!
@izhargbc@AirIndiaX@RafiqueAhmad_@JM_Scindia@PatnaAirport@blrairport_kn Same here! I had a trip planned for 10 days and they did what they are best at, left my luggage at the source airport itself. Funny part is that they did not have an idea for 3 hours about where my luggage was….still not received it. Pathetic service ever!