Introducing DiffusionBlocks: Block-wise Neural Network Training via Diffusion Interpretation
https://t.co/c9AvsRKybj
What if we didn’t have to hold an entire neural network in memory to train it?
Standard neural net training optimizes all parameters jointly. As a result, the memory required during training grows linearly with the depth of the network.
In our #ICLR2026 paper, we propose DiffusionBlocks, a principled framework to train networks one block at a time, drastically reducing memory requirements while matching end-to-end performance.
With DiffusionBlocks, we split the network into blocks and train them one at a time, so you only need memory for a single block.
How? We explicitly assign each block a role: to move the representation a little closer to the target than the block before it did. That role turns out to be precisely what a diffusion model does, step by step. Each block only needs to optimize its own objective and can be trained independently.
We validated this across five different architectures:
• ViT
• DiT
• Masked diffusion
• Autoregressive transformers
• Recurrent-depth transformers
In each case, performance is competitive with end-to-end training while using a fraction of the memory.
This perspective also extends naturally to recurrent-depth (Looped) transformers, which apply the same network iteratively and normally require expensive backpropagation through time (BPTT). Viewed through DiffusionBlocks, we can replace those multiple iterations with a single forward pass during training.
Read our paper and code, to learn more.
Paper: https://t.co/CRj96VGYQn
GitHub: https://t.co/eNW0K9Xh8E
🐟
After 100Level it is now by who is CONSISTENT, all you need to survive medschool is now consistency. No more physics chemistry and biology, you all are now in a same level ground for ANATOMY, PHYSIOLOGY AND BIOCHEMISTRY
It’s a frequency thing tbh “how many times did you read it”, there is no topic the BGS read that you didn’t read he just read it 7-8 times and did alot of PQs and you only read it 2 times and solved PQ some days to the exam while your social life and other stuffs took a lot of your time. Reading something many times gives you an edge, it becomes very friendly and you are so familiar with it. So when the mcq comes out he will be very familiar with it while some other persons might be mixing some details. Also someone who is consistent read some topics you missed out while you were playing or doing other stuffs this also gives an edge.
It may also interest you that the best JAMB and POST UTME average in my class failed out in 300 level after the 2nd mb exam.
See how non challant he was at the beginning because he wasn’t expecting much.
But it then turned to excitement and then tears.
If you like let these zero effort women manipulate you to settle for less. You will just die young.
I rather remain single than put up with nonsense.
2023, I missed my convocation. I missed my induction. I don’t have a single group picture with my lecturers or the people I graduated with. I couldn’t go for NYSC I didn't celebrate anything I couldn't afford it.
I’ve never really “done life” the way people assume. I didn’t go on my first date until this year never been to the beach, never been to the cinema, never really had fun. Everyone looks at me when I say these things.
Before that, a lady once offered to take me out because I told her I had never experienced it. She didn’t mind paying I even said I don't have money to come down to the island, she said she will order an uber. I felt uncomfortable, worried, even scared. I chickened out and said no I felt like a useless man, I couldn't afford shit.
Not because I didn’t want to go, but because something about it just reminded me of where I was financially.
Then this February, I finally went on my first date. I paid for everything. Spent money I normally wouldn’t.
So when people say “men should stop faking maturity and celebrate themselves,” it sounds nice, but it’s not the full picture. A lot of guys are not avoiding joy. We just don’t have the leverage for it.
Most men in Nigeria are broke. That’s the reality. Not lazy, not unwilling, just financially constrained. We miss moments, not because we don’t care, but because we can’t afford to show up for them.
This might be the 1st year I’ll actually celebrate my birthday the way I want, and I’m doing it properly. I’ll go out, hit the beach, enjoy myself this time. Not because I suddenly became a different person, but because I finally can. I also celebrated Valentine's Day for the first time. Documenting everything is fun when you have money to pay for it.
A lot of us want to celebrate with friends and family. We want those memories. We want to show up fully. But poverty quietly takes those moments away and replaces them with survival.
That’s why I’ve always tried to position myself to help people break out of it.
Because poverty is deeper than money. It steals experiences, confidence, and even the ability to enjoy life.
God bless the women, that came into my life 😭😭 I can finally say afford to do things.
Reducing what goes on in a boy’s head on his birthday to fake maturity is an evidence to how insensitive the other gender can be to a boy, many times even in relationships.
For boys, a lot of expectations are attached to age
While birthday is a call for studio photoshoot for some
for many boys, new age is a reminder of the apartment of their own that they should have had
It’s a reminder that they are getting too old to be where they’re financially, academically and relationship wise etc
On a normal day a boy could just sit and start thinking of how to move forward in life, that thinking is more intense on a birthday
So if they don’t send a picture of themselves as broadcast to all contacts on WhatsApp group for a repost, it’s not a flex
They are grateful for life, but when they have something truly worth celebrating they won’t hold back
It’s not fake maturity, we are usually on a date with reality and reality is not friendly.
@ruthefordml Thank you🙏🏼
My thoughts: it seems to rely heavily on the performance of LLM, which might end up boxing the context
Maybe you can allow two modes (with and without model context layer) and collect performance comparison
People won’t believe this one🙏🏾
When I was 15, still in SS2, a family friend a multi-Billionaire who owns one of the biggest malls in Abuja and a conglomerate in the Oil and Gas sector visited our family and asked my Dad one question that still echoes in my head:
“What are you planning for Simon to study?”
My Dad, chest puffed with the kind of pride only a Nigerian father carries, answered without blinking: “MBBS.”
The man didn’t even flinch. He replied calmly but deadly serious, and dropped the truth bomb that my 2018/2019 self wasn’t ready for. “Medicine is not what it was in our time,” he said, with his voice low like he was revealing classified information.
“If this boy who already plays with computers like it’s breathing gets taken to Harvard to study the tech side of Finance and Economics… he’ll be done by 20. The financial doors that will open for him are endless and unlimited.”
My Dad laughed that short, skeptical laugh fathers do when money talk gets too loud. “Who will sponsor him?” The billionaire didn’t miss a beat. He just smiled, glanced at his two kids sitting right there in the same room (Kids wey wan don almost complete their Masters for Harvard), and said: “Man of God, make the decision first.”
That night, my parents called me into the parlour. The same parlour where the fluorescent light buzzed like it was nervous too. I can still see the exact couch I sat on, that brown leather one with the cracked armrest with my legs swinging because my feet didn’t fully touch the ground yet. The smell of my mum’s 'Ofe Oha' soup still hung in the air. My heart was racing, but I was trying to look cool.
They laid it out: The man’s offer, Harvard, Tech and Money that could change bloodlines. I loved how it sounded. God, I really loved it. The idea of jetting off, coding empires, stacking paper before my mates even finished JAMB. But then my mouth moved before my brain could catch up.
“Tech? I want to be like Ben Carson the neurosurgeon. Which tech will turn me into that?” The room went quiet. I remember leaning forward on that exact seat, voice cracking with teenage conviction, and I declared like I was preaching on a mountain:
“NO PROFESSION IN THE WORLD CAN MAKE YOU RICHER THAN MEDICINE AND SURGERY!” My Dad’s eyes lit up like I’d just cured cancer myself. He beamed, slapped my back, and said, “You can even do the tech side of medicine, my boy” with 'this is my beloved son' energy.
They relayed my answer to the billionaire who wasn’t happy, you could hear it in his voice but he just agreed, “No problem. ”
In my head, the plan was crystal: 6/7 sweet years in a federal university, white coat, stethoscope swinging, Dr. Simon Thazhigilla Simon, neurosurgeon loading.
Simple.
What I didn’t see coming was:
The one-year delay just to process my admission… after the school had already lost almost a whole year to insecurity. Then another full year swallowed by ASUU strike. Then another. And another.
Fast forward, I’m still a student and the only “tech” thing I know how to do is design. Every time I scroll past stories of 20-something yr/o tech guys closing million-dollar rounds, or see that same billionaire’s mall lighting up the Abuja skyline like a reminder… I feel it.
And sometimes, the difference between two lives…
is just one “yes” you didn’t say.
But then again…Maybe this path too is becoming something. Maybe all this delay, all this stretch, all this uncertainty is not wasted.
Maybe it’s building a version of me that that 15-year-old boy had no capacity to imagine.
Because the truth is…
You don’t always know if you made the right decision.
You only get to become it.
And me?
I’m still becoming.
What Python was doing for C++ in ML, English is now doing it for Python.
It’s just continuous layers of abstraction for simplicity. Now you can run the entire code with a simple prompt in English 😊
Anyone out there who is a newbie in tech , does not know where to start or what to learn?
You can reach-out to @iQube_OX team, they are building a fantastic mentorship support community.
I am impressed about the progress they have made and I am supporting them.