Today we're releasing Agora: the first ever pretraining stack that allows non-collocated consumer GPUs to be competitive with centralized clusters
Agora is 15x faster than Megatron-LM in this setting and is only 1.5x less efficient in terms of tokens per unit compute than TorchTitan on H100s, despite running on devices that have no NVLink or InfiniBand support.
Founder cheat sheet:
- Celebrate wins
- No meetings one day a week
- Prioritize mental health
- Assume VC will dry up
- Zag when others zig
- Prioritize product design
- Be profitable, you'll sleep better
- Iterate on growth engine
- Iterate on storytelling
- Have fun
Interviewed someone for a grad role yesterday
Their CV, studies and results were exactly what big4/consulting recruits, but they didn't want that
Openly citing "how predictable, and boring" their friends said it was
More grads are looking at tech for a viable path. How cool
Passive aggressive hack of the day:
Ever have someone ask you a lazy question you know they just cbf to google?
Google the exact question for them and send them a link to the search result.
Problem solved.
The amount of new EV's landing in Aus and decreased cost is awesome.
One big issue; renters, people who don't own car space, those who want to road-trip will be locked out of market. They won't be able to easily charge their vehicle.
Know anyone looking to solve this problem?
Years of experience is the worst proxy for validation.
Like, I have 26 years of life experience yet still mix up the definitions of "Mirror" & "Window". You'd think 4 years of life experience would teach you that.
Quality > Quantity.
@emilyscasey It's always the ones that sneakily subscribe you to 5 different Newsletters without mentioning. Then when you want to unsub you have to decipher a riddle, make it through a maze, and fight the final boss. Only then do you earn the right to get off 1/5 newsletters.