Data centers in space will be bombarded with stray subatomic particles. Even at sea level, where they’re less common, they sometimes flip bits in memory. I wanted to know how much damage those flips do to GPT-2 and how different altitudes would affect its lifespan.
I found that without proper protection, GPT-2 would last ~1.5 years in low Earth orbit before breaking.
Blog post and repo are linked below
In MIT CSAIL's recent "Sparks of Weight-Space Programming", GPT-6 Astra fixed Qwen's thinking loops by editing its weights directly.
I replaced Astra's trial-and-error tuning with linear programming, constructing a weight edit that matched its results while taking 99% less time (minutes vs 8 hours) and changing 8x fewer weights.
Blog post and repo are linked below
Excited to share that @asherdfeldman and I won first place overall at the Vibecheck formal methods hackathon yesterday! Had a great time meeting super cool people and learning from everyone there. We built Sound and Complete, a verified tool to help guitarists practice call-and-response blues.
Thanks to @maxvonhippel, @qd_forall and everyone else who helped put on this fantastic event!
There are some large winds and great people moving FM forward, excited for what is to come!