Last fall, we shared our deep dive on FA4 internals.
But we didn't stop at grokking the kernel.
Since then, we've been developing improvements for inference performance and upstreaming them.
This blog post explains those contributions.
https://t.co/xzDNHdq3Zw
i joined @modal :)
we're creating a publication
The Modal Review - a literary print and digital publication, with a balanced mixture of dispatches, guest essays, poetry and art
A new state of the art in NanoGPT, NanoChat, and SOL-ExecBench from @Recursive_SI's automated AI research system -- all in one post, and all built with @modal.
What's not shown but nice is that the p50-p99 spread is now among the best, only ~120ms.
And the throughput is >1k/s—but for that demo we're awaiting June 17th :)
Two big updates on my end:
1. I’m moving on from @PrefectIO after three wonderful years.
2. I started this week at @modal as Member of Product Staff.
I’m so incredibly grateful to @jlowin , Chris White, Thomas Egbert and the team at Prefect. I got to build world class open source software and be a part of Prefect and @fastmcp's vertical growth.
Three years ago I joined Modal as a user. It was March 2023 and I was two days into a losing fight with ECS. @PhysicsBliss told me to check out Modal. @bernhardsson replied to my signup email in two minutes; by that night, days of work had collapsed into hours. Modal sparked joy and I was preaching the gospel to anyone who would listen.
That didn’t stop when I joined Prefect. It’s rare to find kindred spirits, who share your scar tissue, who think about software and developer experience the way you do. Unsurprisingly then, Modal was my default recommendation to customers and I kept working with Erik, @akshat_b and @charles_irl to build integrations and do events together.
So I'm making it official. I get to do full-time what I've been doing as a fan for three years: help people build without friction and turn months of work into hours.
I couldn't be more excited to build alongside Erik, Akshat, Charles, and the whole team. Here's to the next chapter.
one consequence of @DevinAI being so good at computer use its able to scour documentation pages, resources so effectively.
im building skills for @modal so your agents can write better code for modal!
keep an eye on this PR: https://t.co/zoMZqumfOH 👀
personal update: i'm joining @modal
modal unequivocally is the best AI infra company.
i've been a customer for about a year now.
i'm in london for two months, if any startup seed and above is willing and able to move to modal. DM me. I will help out personally