Rasool Fakoor

Building agents that reason, adapt, and act with RL and friends!

[Rasool Fakoor @rasoolfa]

Too many ideas die at the edge of the LLM/VLM/VLA training framework. Not anymore.
Excited to release FeynRL: built to help you understand, modify, and build new RL methods without fighting the stack.
https://t.co/bdzM4JJbIO
Try it, ⭐ it, and send feedback.

[Rasool Fakoor @rasoolfa]

Exciting time to be at Modal 🚀 i'm hiring interns & full-time researchers in RL, ML, and large models to join our **new** research team. apply on our website or reach out to me directly (contact info on my website)!

[Modal @modal]

Today we're announcing that Modal has crossed $1B in annualized run rate, as well as raised a $750M Series D at a $15.75B valuation, led by @Accel.

Since our Series C, usage has tripled and we’ve grown more than 15x year-over-year.

We are deeply grateful to the developers and companies building on Modal. There's still so much more to build, and we can't think of a better time to be building software.

[Rasool Fakoor @rasoolfa]

@natolambert this is an awesome effort in the right dirextion and many congrats on starting this. Happy to help with your effort in any way that I can.

[Rasool Fakoor @rasoolfa]

@aakaran31 would dagger-style training offer another perspective here? would comparison make sense? check out this paper which is very relevant to yours where SFT issues r studied from exposure-bias perspective ( no expert data tho) https://t.co/rSFTBBfLIq 2/2

[Rasool Fakoor @rasoolfa]

@aakaran31 Seems like interesting work. wouldn’t these SFT issues more of exposure bias (training != inference) problem? why use the off/on-policy framing here than exposure bias? 1/2

[Akshat Bubna @akshat_b]

We don't do staged demos at Modal. Every box in our viz was a sandbox spinning up in real time :)

[Rasool Fakoor @rasoolfa]

@twni2016 @ben_eysenbach @allenainie congrats @twni2016

[Rasool Fakoor @rasoolfa]

@CompleteSkeptic pretty sure, you don't mean this method 😉https://t.co/CvnB4Cd2Gx

[Rasool Fakoor @rasoolfa]

@allenainie @NickATomlin @carissayipchess @rose_e_wang congrats allen!

[Rasool Fakoor @rasoolfa]

@OfficialLoganK If you guys could fix some of the Antigravity issues, it'd help a lot. E.g, opening Codex extension closes Agent window, so you basically have to choose between Codex & Gemini Agent instead of using both at the same time. Claude Code works fine alongside it, but Codex doesn’t.

[BosonAI @boson_ai]

Meet Higgs Realtime: a cost-efficient, real-time speech-to-speech model.

It listens while it talks. Interrupt it mid-sentence, change your mind, and it keeps up, all the way through real workflows.

Available today 🧵

[Rasool Fakoor @rasoolfa]

@algikarpooja It covers other methods like SFT, DPO too. But RL in general is more complex to get working and has more pieces to it, which is why there's so much focus on it.

[Rasool Fakoor @rasoolfa]

Too many ideas die at the edge of the LLM/VLM/VLA training framework. Not anymore.
Excited to release FeynRL: built to help you understand, modify, and build new RL methods without fighting the stack.
https://t.co/bdzM4JJbIO
Try it, ⭐ it, and send feedback.

[Rasool Fakoor @rasoolfa]

@johnschulman2 @hallerite Predefined clipping values could be the source of this? Dropping them all together and assigning them based on training dynamics not only makes things adaptive but also addresses this to some extent. Tho haven't studied this here
https://t.co/XGtDYC2XNK

[Alex Smola @smolix]

RL is hot and has a reputation of being difficult to control. That is, unless you have the right parametrization. Off-policy RL, in particular struggles with the fact that your roll-out looks different from what you're actually optimizing. This can happen if you roll out with a more powerful model, or if you want to roll out in FP8, while you're training in FP16, or if you update asynchronously, or in other words, almost all the time in practice.

[Rasool Fakoor @rasoolfa]

@_arohan_ tbh wish I had your patience and rigor to do something like this for RL. There’s so much to clarify about RL and where things went quite wrong: ablation studies being presented as new RL alg, old concepts getting reinvented under new names, and so on...

[Rasool Fakoor @rasoolfa]

This is exactly why open-source frameworks like FeynRL matter more than ever. Open weights are NOT enough. Open AI needs open training recipes, alg, etc.
You should be able to understand training, modify it, & build new algorithms, optimizers, recipes.
https://t.co/30CAbnxwIn

[elie @eliebakouch]

mythos will be bad ON PURPOSE on ai "frontier llm research" tasks, this is very very sad for the research community

also the fact that this is un purpose not visible to the user is crazy

[Rasool Fakoor @rasoolfa]

@neural_avb yeah, real pain is not just RL-training the model, but knowing why it breaks and when it actually works. Most frameworks do not help much cuz they blur the line between system and alg. FeynRL tries not to. https://t.co/bdzM4JJbIO Would love your feedback if you try it.

[Rasool Fakoor @rasoolfa]

@TsendeeMTS @ChangHao564792d
Great paper. We also studied and proposed some form of DAgger style training for LLM but for SFT using scheduled sampling.
https://t.co/rSFTBBfLIq

[BosonAI @boson_ai]

Higgs Audio v3 TTS is here.

Built for voice AI that speaks, not just reads:
• 100 languages with single-digit WER/CER
• inline control over emotion, style, prosody, and sound effects
• API, Workspace, and open weights
• Blog 👉 https://t.co/C8frDlfO5D

Watch the demo 👇