Added a one-page flowchart for GALT.
Idea: turn LLM post-training from single-loss tuning into constraint-graph learning with task, safety, and memory as responsibility channels.
Paper/code/results:
https://t.co/egWjAAZJth
#LLM#AIAlignment
GALT is surfacing a surprising pattern: memory and safety are distinct, but memory seems to grow on top of safety boundaries. Training the memory path alone helped less than getting the safety path to route cleanly first. Safety may be scaffolding, not just suppression.
@cem_yuksel@AnkaHeChen@karpathy@ylecun This was a 2-week sprint from idea to release. I wanted to get the core direction out quickly while the physics→ML connection was fresh. More experiments and ablations are coming in v2.
@cem_yuksel@AnkaHeChen
GALT is out: Graph-Parallel Augmented-Lagrangian Training with Responsibility-Separated Channels.
I took the core local solve technique from your AVBD paper and applied it to neural network training.
Repo + full paper: https://t.co/egWjAAZJth
Thanks to @cem_yuksel, Chris Giles, Elie Diaz, and @AnkaHeChen for the AVBD foundation and Physical AI direction.
Tagging some deep learning leaders: @karpathy@ylecun
Brutal feedback welcome on the physics-to-ML transfer and scaling ideas.
Repo: https://t.co/egWjAAZJth
Big refactor landed in PhysX_AVBD.
All joints (Spherical / Revolute / Prismatic / D6 ) now unified into one clean D6 solver.
→ ~400 lines of duplicate code deleted → Much better stability & convergence
Ordinary joints = AVBD’s real battlefield.
Repo: https://t.co/NVacjxXwJc
Excited to share my latest project: PhysX_AVBD! Forked NVIDIA's PhysX SDK and integrated an experimental position-level Augmented Vertex Block Descent (AVBD) solver—99.9% coded by AI via @GitHubCopilot powered by @AnthropicAI's Claude models.
Repo: https://t.co/NVacjxXwJc