Top Tweets for #nolimitt()()

There was a moment when the room suddenly felt darker. 😵‍💫 The numbers on the screen were still moving… but one of them was moving in the wrong direction. And for the first time, it felt like CetinLM had opened a door we weren’t sure we wanted to walk through. Around 500M tokens, CetinLM was moving exactly as the math suggested. 🧠⚙️ Validation kept improving. All five data sources were improving. Gradients were calm. But then something strange happened. 😱 Greedy loops: 400M → 48% 🔪 450M → 52% ☠️ 500M → 56% ⚰️ 550M → 64% 🪦 It felt like a portal had opened into a darker universe. No panic. Just that uncomfortable thought: What if the math was lying? So I went back through everything. Training code. Packing. Attention. Loss. EOS behavior. Optimizer state. The code stared at me. I stared back. And the answer was annoyingly simple: Everything looked correct. At 550M, validation was still reaching new bests. Every source loss was still falling. Gradients were stable. There was no evidence strong enough to justify breaking the training recipe. Two choices remained: panic and change the system… or trust the measurements and keep the experiment controlled. We changed nothing. Then 600M arrived. Val loss: 3.203 → 3.160 🏆NEW BEST PPL: 24.61 → 23.58 All 5 sources improved again. Gradients: ~0.19 And the number that opened the portal? 🤪 Greedy loops: 📉 64% → 40%. 🥂 🪄 No miracle. No secret patch. No magic. Just another 50M tokens and gradient descent doing what the equations said it should do. A 25-prompt probe doesn't prove the loop problem is gone. But falling held-out loss, improving source losses and changing generation behavior tell us something much more important: the model is actually learning from the data. At 550M, it looked like a horror movie. At 600M, the lights came back on. Only 6% of the first 10B-token run. Not “CetinLM will be perfect.” Just: Does the math actually work? So far: yes. ⚡ Apparently 2 + 2 still equals 4. 🎬 The movie continues. 😂😅 #CetinLM #LLM #AI #MachineLearning