Jan Vincent Hoffbauer

AI Products / Data Science / NLP / Entrepreneurship

[Soumith Chintala @soumithchintala]

No More GIL!
the Python team has officially accepted the proposal.

Congrats @colesbury on his multi-year brilliant effort to remove the GIL, and a heartfelt thanks to the Python Steering Council and Core team for a thoughtful plan to make this a reality.

https://t.co/58QK2yctRD

[Paul Graham @paulg]

I know it's weird to quote yourself, but I came across this in a footnote and realized that it was worth saying again:

[Sebastian Raschka @rasbt]

Doing a back-of-the-envelope calculation, a 7B Llama 2 model costs about $760,000 to pretrain!

And this assumes you get everything right from the get-go: no hparam tuning, no debugging, no crashes and restarting. The real cost, including experimentation, is probably millions!

It makes me appreciate all these openly available models!

Math:
- The total number of GPU hours needed is 184,320 hours.
- The cost of running one A100 instance per hour is approximately $33.
- Each instance has 8 A100 GPUs.

That's 184320 / 8 * 33 = $760,000

[Jan Vincent Hoffbauer @hoffbauer_jan]

@rsg @StephNass What are indicators you’re looking for?

[Jan Vincent Hoffbauer @hoffbauer_jan]

@bernhardsson TF1 to PyTorch

[Jan Vincent Hoffbauer @hoffbauer_jan]

@MartinGTobias Going from experimentation to principles is learning :)

[Jan Vincent Hoffbauer @hoffbauer_jan]

@LM_Braswell Not perplexing …

[Jan Vincent Hoffbauer @hoffbauer_jan]

@jackmcclelland @Darktrace Are you interested in more unique insights? Let’s have a chat on what I’m building :)

[Jan Vincent Hoffbauer @hoffbauer_jan]

@jackmcclelland Noise cancellation rules :)

[Jan Vincent Hoffbauer @hoffbauer_jan]

@MartinGTobias Exciting for every pre seed founder!

[Jan Vincent Hoffbauer @hoffbauer_jan]

@MartinGTobias I would do really good due diligence! :)

[Jan Vincent Hoffbauer @hoffbauer_jan]

@alliekmiller That’s one of the few things Europeans have seen before Americans in Tech :) In Germany every page wants that since a few years

[Jan Vincent Hoffbauer @hoffbauer_jan]

@Avishai_Bitton I agree. @aboutido and I do this every day. We’re just developing a GTM and execute with no prior expertise. We both learn constantly on task we’ve never done before. We left our confirt zone in fundraising daily.

[Jan Vincent Hoffbauer @hoffbauer_jan]

@MartinGTobias … and makes the best startup teams

[Jan Vincent Hoffbauer @hoffbauer_jan]

@Isinlor @NannaInie I think that’s a super interesting point. Have you ever used it in this way? :)

[Jan Vincent Hoffbauer @hoffbauer_jan]

@aboutido It is a pleasure to work on this together! 🙌🏽

[Jan Vincent Hoffbauer @hoffbauer_jan]

@justingordon212 @aboutido that’s good stuff :)

[Jan Vincent Hoffbauer @hoffbauer_jan]

@aboutido @sabakarimm + We have a kick-ass team and a mission making the world a more connected place.

[Jan Vincent Hoffbauer @hoffbauer_jan]

@Billy_Draper Language Learning with AI is heating up - we’re building an effective B2B solution 🤝🏼