No, GPT-3 wasn't trained in 11 minutes.
The GPT-3 architecture was trained on the C4 dataset to 2.69 log-probability in 11 minutes on 3584 H100 GPUs.
Don't focus on the "11 minutes" -- because it's like saying "ResNet-50 was trained in 5 seconds on MNIST to 80% accuracy"
We finally got some good news today.
The Chinese government helped facilitate a donation of 1,000 ventilators that will arrive in JFK today.
I thank the Chinese government, Jack Ma, Joe Tsai, the Jack Ma Foundation, the Tsai Foundation and Consul General Huang.
As most of the U.S. stays home to avoid spread of the coronavirus, doctors, nurses, paramedics, grocery store workers and more are hard at work. 60 Minutes says, "Thank you." https://t.co/YLR1N1RXxZ
"Workers aren't going home for fear of infecting their families and loved ones, instead they're sleeping in their cars," reports @CoriCoffin. "They're pulling double, triple shifts."
https://t.co/WKI1Yyc0NU
I'm on board with the idea of masks for everyone, but it's worth urging caution about home-made masks. Better than nothing, home-made mask provides ~50% filtration between material & fit, vs 95% for a surgical mask. That means you get & share 10x the viral particles. /1
Facts are empowering.
Even when the facts are discouraging, not knowing the facts is worse.
I promise that I will continue to give New Yorkers all the facts, not selective facts.
Cuomo expresses outrage at FEMA for sending New York 400 ventilators when it needs at least 30,000: "You pick the 26,000 people who are going to die because you only sent 400 ventilators." https://t.co/hmODbKuv4b
Let's show our gratitude to our everyday heroes.
They’re stepping up for all of us. So when you see them, thank them. I’ll start.
Thank you to every:
-Healthcare worker
-Grocer
-Pharmacist
-Police officer
-Firefighter
-Public transit worker
-Childcare worker
And so many more.
🚨NY has a critical need for PPE including gloves, gowns & masks🚨
We need companies to be creative to supply the crucial gear our healthcare workers need. NY will pay a premium and offer funding.
Need Funding? 📞212-803-3100
Have Unused Supplies? 📞646-522-8477
SHARE widely.