Wrote a short essay on Pallas and how to think about it! Criticisms and feedback are welcome.
I am reading about kernels and hardware for quite some time now, it was time to put them into "blog brain dumps". If I have enough encouragement, I might as well do a series on it (what do you all think?)
I re-built the tiny-diffusion repo (which has 10MM param GPT and diffusion-LLM models for ~Shakespeare text) in JAX.
And to show off more recent methods, I added flow-matching generation too.
@GoogleDevExpert#TPUSprint
Sharing on behalf of a friend:
"""
New compute & funding opportunity for researchers!
We're launching the 2026 Google TPU Research & Education Awards.
We want to support researchers pushing the boundaries of ML systems, performance, and efficiency, and those working in high-impact applied science.
What's included:
- Compute: Free access to the latest generations of TPUs.
- Funding: An unrestricted gift to support or partially support a grad student.
- Credits: Google Cloud credits to support your work.
If you or a colleague are exploring what is possible with TPUs, we want to hear from you.
Read the RFP and apply here: https://t.co/mu6GvkKx3D
If you have questions, email [email protected]
"""
I just completed the youtube series on JAX AI Stack by @robert_crowe.
The idea:
- why is jax important
- how is flax nnx really close to the torch design
- using optax and orbax for optim and checkpointing
https://t.co/UnMk5XlEGh
tell me you are a research nerd without telling me you are a research nerd
me: just got lego of @JeffDean and @sanjayghemawat with there legendary paper map reduce
We’re excited to announce that Kaggle’s 5-Day Generative AI Intensive Course with Google is now available as a self-paced Learn Guide!
https://t.co/9U0WYQvZXx
A very cool use of Gemini models to help summarize (and turn into podcasts) the dizzying array of awesome research papers, for those of you attending or interested in @NeurIPSConf in Vancouver this week!
Nice work, @algo_diver!
+1,000 developers graduated the Korea Google ML Bootcamp for the past 5 years. Coursera Deep Learning Specialization and Kaggle competitions are part of the intensive curriculum.
This is a big milestone. I am really happy and proud of being part of the team.
지난 10월 18일, 구글 머신러닝 부트캠프 2024가 5기 참가자들의 졸업식을 끝으로 3개월간의 여정을 마무리했습니다! 🎓
489명의 미래 머신러닝 엔지니어들과 함께한 이번 5기 부트캠프에서는 새롭게 추가된 💡 ‘젬마 스프린트’ 과정을 통해 단기간에 프로젝트 아이디어를 제안하고 앱, 코드, 모델 등의 결과물을 만들어 내며 언어 모델에 대한 역량을 강화할 수 있었답니다.
더 자세한 내용은 구글코리아 블로그에서 확인해보시기 바랍니다!🔗✨
👉 https://t.co/lzamlEH6N0
Thank you. I am glad to see this happening and I wish it could be an opportunity for the developers/students/researchers there to go deeper into the fundamentals of AI/ML.
As a ML GDE, I am proud to organize first-ever ML Paper Reading club dedicated for Myanmar ML Community.
Notably, 90 percent of the presenters and 80 percent of the participants are women actively working in the machine learning industry.
https://t.co/3prnmMtho0
Something that I worked on over the weekend: A port of Mistral 7B in Keras with JAX backend. A few things left in the TODO list, but coming out good so far.
PS: I was blocked by an issues while porting Mistral in Equinox, but will get back to it as well
Check out this Beginner's Guide to Colab produced by one of Google's Developer Experts for Machine Learning, @Sam_Witteveen. Thanks for the video Sam!
https://t.co/8ObKvJ2raF