Introducing OpenMythos
An open-source, first-principles theoretical reconstruction of Claude Mythos, implemented in PyTorch.
The architecture instantiates a looped transformer with a Mixture-of-Experts (MoE) routing mechanism, enabling iterative depth via weight sharing and conditional computation across experts.
My implementation explores the hypothesis that recursive application of a fixed parameterized block, coupled with sparse expert activation, can yield improved efficiency–performance tradeoffs and emergent multi-step reasoning.
Learn more ⬇️🧵
TBPN has been acquired by OpenAI
The world is changing quickly but TBPN will stay the same. Live every weekday just with a lot more resources.
Thank you to everyone that has been a part of this journey big or small. We are 17 months in and unironically just getting started.