NVIDIA released a new RL framework:
Your entire setup is one Python file:
- write a class with a step() function
- return a reward from it
- the framework handles the rest, up to 1T-class MoE training
In a typical RL framework, the environment and reward logic are added inside the trainer's codebase.
Adding a new task requires writing framework code, registering it, and wiring up config for it.
The reward usually comes from a separately trained reward model, which needs its own GPUs and placement next to the actor and critic.
NVIDIA's Molt framework drops both these requirements.
Every run takes an agent_path flag pointing to one Python module, and the trainer code never changes.
The module gives you two ways to plug in an agent.
> The first is an Env class where you write a step() function that receives the model's output and returns a reward, and the framework handles everything else, i.e., calling the model, tokenizing, and looping turn after turn until the episode ends.
> The second is a ChatAgent class, for agents that already exist as their own loop. Here, you write the loop yourself, calling the model through a standard OpenAI or Anthropic client, and the framework spins up a local server so those calls hit its vLLM engines instead of an external API.
Either way, the trainer sees the same thing, i.e., a trajectory of tokens and a reward at the end.
That reward can come from a string-match grader, code executed in a sandboxed subprocess, or an LLM-as-judge call.
So there is no reward model to train or place, and no environment code living inside the framework.
Under the hood, Molt runs a single trainable actor (plus an optional critic for PPO) on FSDP2, vLLM engines for rollout, and Ray queues between them, so generation, training, and weight sync overlap instead of running in lockstep.
Scaling just requires setting some flags on the same command.
The framework also splits the model across GPUs for you, so the script that trains an 8B model on one node can also train DeepSeek-V3-scale MoE models on a cluster by raising the parallelism flags.
Here's the repo: https://t.co/TafSfatER5
Since the framework is new, I am still experimenting with it and will share more about my learnings soon.
To dive deeper into how top AI labs are building RL Agents in 2026, I wrote a full article about it.
It covers the evolution from RLHF to GRPO with verifiable rewards and using an LLM-as-judge reward function. This idea extends RL training to non-verifiable agentic tasks without writing custom reward functions.
Read it below.
Since phoneuse blew up, people mentioned a lot of other similar tools for agentic phone use. Here's the short list:
https://t.co/493WqqdNYA - mine. Linux PC, AirPlay for the screen, Bluetooth HID for input. Phone: no app, no dev mode, just AssistiveTouch and a Bluetooth pairing
https://t.co/YrddOyp0GT - YC. Drives your iPhone through iPhone Mirroring on a Mac, plus rented cloud phones. Phone: nothing installed, iOS 18+
https://t.co/FwwBZl1tqo - a rack of real phones in SF with a robot stylus and an overhead camera, $149/mo per iPhone. Phone: theirs
https://t.co/BhBeiulJGB - runs fleets of physical iPhones on a schedule. Phone: theirs
https://t.co/KOPzcVXZ26 - PhoneAgent, runs on the iPhone itself. Phone: Developer Mode and a signed app
https://t.co/3SUm1RGqRO - same idea as mine (AirPlay + Bluetooth mouse), Linux or Windows. Phone: no app, just AssistiveTouch
https://t.co/IPb2rmVVIG - ESP32 plugged in as a USB mouse and keyboard, AirPlay for the screen. Phone: their app (TestFlight) and AssistiveTouch
https://t.co/woxbZqqSDD - ESP32 Bluetooth mouse and keyboard plus an iOS app that reads the screen. Phone: Developer Mode, the app built in Xcode, AssistiveTouch
https://t.co/Que2gDQ2zn - Mac with Xcode's developer services, with an MCP server. Phone: Developer Mode, iOS 27, paired to the Mac by cable once
https://t.co/f3YZ349xio - Mac, WebDriverAgent + iPhone Mirroring. Phone: Developer Mode, WebDriverAgent re-signed every 7 days on a free Apple ID
Android has adb, so it's a lot easier there.
this is the most DANGEROUS thing on internet today
4,843 backtested trading strategies for FREE, with the MOST profitable ones ranked by their Sharpe ratios (top one hits 3.39)
i handed these strategies to Opus 5.5 & it turned them into live AI trading bot working 24/7 (INCREDIBLE RESULTS)
here’s what you get:
> 4,843 strategies, each tested over decades of real data
> Sharpe ratio, t-stat & years tested for every strategy
> full Python code & data for each one
> 136 libraries for backtesting, bots, data & broker APIs
> 55 trading books, from beginner to pro
here are the EXACT steps to turn any strategy into live trading bot:
1. open the Strategies list & pick from the 61 strongest, sorted by market, so you can choose stocks, bonds, forex or crypto depending on what you trade
2. click any strategy & create a free account, it unlocks the full Python code & data so you can see exactly how the strategy works
3. paste that code into Claude Code & ask Opus 5.5 to explain every rule in simple English, so you know exactly when it buys, when it sells & why
4. before going live, ask Opus to rerun the backtest with REAL trading fees on the last 3 years of data, if the strategy still makes money after costs, it’s worth converting
5. now ask Opus to convert the research code into live trading code, so instead of testing on old data, it reads live prices & creates real buy & sell signals as they happen
6. pick a broker connection from the 136 libraries, like Alpaca for stocks or Binance for crypto and let Opus connect the bot to it
7. ask Opus to add a risk layer on top: a fixed position size, a stop loss on every trade, a daily loss limit & a kill switch
8. run the bot in paper trading mode for 2 weeks with fake money & compare its live results with the backtest, if they match, the conversion worked
9. connect Telegram so your phone pings you on every trade, switch it to live & let it run 24/7, then repeat the same steps to add a second & third strategy to your bot
if you want to build an AI trading system from scratch, start with this article below:
A good technical LLM interview question:
We replace a dense feed-forward layer with a top-2 MoE.
The profiler confirms that the MoE executes fewer FLOPs per token.
However, end-to-end inference latency has increased instead of decreasing.
Why did this happen?
A standard Transformer applies the same feed-forward network to every token in a layer.
An MoE layer replaces that network with multiple experts. Each expert is a feed-forward network with its own weights.
A router reads each token’s hidden-state vector, scores the available experts, and selects the top two. It also produces a routing weight for each selection.
Only those selected experts process the token. The model therefore contains many expert weights while executing only a small subset for each token.
The serving system must move activations when the selected experts are stored on different GPUs.
The visual follows a batch that begins on GPU 0.
The router returns two expert IDs and two routing weights per token. One selected path is shown for each example token to keep the diagram readable.
Token T1 selects E1 on GPU 0. Its activation remains in local GPU memory, where E1 processes it.
T2 selects E4 on GPU 1 in the same server. GPU 0 transfers the activation through NVLink, a high-bandwidth GPU-to-GPU connection. NVSwitch connects several GPUs through this fabric.
T3 selects E7 on GPU 2 in another server. Its activation crosses the cluster network through InfiniBand or Ethernet.
To be clear, the system transfers activation vectors, which are the numerical representations produced for a token by the preceding Transformer operations.
Each destination GPU runs its expert and returns the output to GPU 0.
GPU 0 multiplies both selected expert outputs by their routing weights, adds them together, and restores the original token order.
Different tokens can select different expert pairs. Across a batch, those assignments may involve every GPU storing experts.
Each GPU may therefore send activations to several GPUs while receiving activations for its own experts. This exchange is called all-to-all communication.
And there are several ways to optimize this.
For instance, keeping frequently selected experts within the same server reduces remote traffic.
Balanced routing prevents one GPU from delaying the layer.
Communication overlap allows local expert computation to continue while remote activations move.
In this setup, sparse routing reduces expert FLOPs, but token dispatch and network communication erase part of that saving.
If you want to dive deeper, we recently covered MoE inference engineering, including routing, expert placement, token dispatch, load balancing, communication overlap, memory, quantization, and offloading.
Read the article below.
YouTube kanalı açmayı hep isteyip bir türlü başlayamadıysanız, bu post derdinize derman olacak.
Bu hafta paylaştığım skill cinecode ücretsiz ve açık kaynak. Sadece Claude üyeliğinizle, sağda solda satılan kurslara para vermeden, aynı işi yapan araçları parayla satan platformlara gerek kalmadan kanalınızı açabileceksiniz.
Aşağıdaki Bermuda belgeseli için bir gece cinecode'a "kararları sen ver" deyip yattım. Sabah teslim raporuyla uyandım: sekiz dakikalık nerdeyse final bir video. Son haliyse, değişmesini istediğim yerleri detaylıca anlattığım tek bir revizeyle çıktı. Bunu yazarken harbici gururluyum, birkaç hafta önce bu cümleleri kuramazdım.
Ne yapıyor derseniz: fikrinizden senaryoyu yazıyor, sahneleri kodla üretiyor, gerektiğinde stok görsel tarayıp arşivden buluyor, motion design ile görsel kancalar kuruyor, açık kaynak ses efektlerini ve müziği de ekleyip son kurguya kadar götürüyor.
Valla bu skill gerçekten oldu, dümen değil. Kurcalayın, iyice aşina olun, benden iyilerini de yapacaksınızdır. Kamera almadan, yüzünüzü göstermeden, kurgucu tutmadan kanal zaten açılıyordu; ama artık başka hiçbir araca ihtiyaç duymadan, sadece Claude'la ya da kullandığınız yapay zekâ aracıyla yapabileceksiniz. Kafayı koyup emek verirseniz elinizde kanal açacak kalitede iş üretebileceğiniz bir araç var.
Ben de izninizle kendi kanallarımı açıyorum artık; hepinizi kendime rakip etmesem içime sinmezdi. Sıra trend bir konu ve doğru nişte. Tutan formatı bulup seri üretime geçeceğim. Belki de Bermuda gibi paranormal olaylar anlatan bir kanaldan devam ederim.
cinecode'u geliştirmekten de bir süre uzaklaşacağım, şu haliyle fazlasıyla yeterli. Aklıma gelen fikirleri not ediyorum, özleyince döneceğim.
Repo ve kurulum ilk yorumda. Bu akşam konunuzu seçin, YouTube'da görüşürüz.
I tried LearnHarness, an open-source AI learning tool, because I was curious to see how a harness would be implemented in education.
LearnHarness: https://t.co/tPKRrUi0wn
TLDR: I liked its live learning graph, but at times I felt tested rather than taught.
Before testing it, I used Teachable Code (https://t.co/ZsraXLE0e8) to explore the GitHub repo, then read its teaching methodology. I was curious how ideas about learning became concrete workflows, tools, and state.
The learning task I gave was to learn/build backprop from scratch. LearnHarness starts with probing questions, then generates a learning route on the fly using Mermaid. The route combines the learning content, my goal, and its assessment of my starting point. As I work through questions, the corresponding nodes are highlighted. I could see which part of the plan we were working on and why rates of change came before backpropagation.
Where I struggled was the teaching itself. I kept answering questions and receiving corrections, including on things I didn’t yet understand. At that point, I wanted explanations, illustrations, and worked examples to help me build the understanding I was being asked to demonstrate.
I’d like to reuse that working graph in an AI tutor whiteboard. When I get stuck at a node, we could work through an example together, keeping the calculations visible and tracing what changes when we change an input.
I’m building one.