I like blockchain tech quite a bit because it extends open source to open source+state, a genuine/exciting innovation in computing paradigms. I'm just sad and struggle to get over it coming packaged with so much braindead bs (get rich quick pumps/dumps/scams/spams/memes etc.). Ew
Okay. Thanks for the nerd snipe guys. I spent the day learning exactly how DeepSeek trained at 1/30 the price, instead of working on my pitch deck. The tl;dr to everything, according to their papers:
As a small startup or indie maker, your size is your biggest weapon.
Giant corporations are sluggish, bogged down by red tape.
Don't hold back on launching just because a big player is in the game.
wow. The new model from @LumaLabsAI extending images into videos is really something else. I understood intuitively that this would become possible very soon, but it's still something else to see it and think through future iterations of.
A few more examples around, e.g. the girl in front of the house on fire
https://t.co/wDiCirpmUa
today, im excited to release a repository that implements llama3 from scratch -- every matrix multiplication from attention across multiple heads, positional encoding and every other layer in between has been carefully unwrapped & explained. have fun :)
https://t.co/gFLcFSRINf
GPT-4o is so good at coding that I am having legit mind bending moments back to back.
The era of the billion dollar solo entrepreneur really has started.
The more I use Llama 3 the more I think that Zuck may have just killed OpenAI and all other large proprietary AI vendors. The gap between latest GPT4 and Llama 70b is virtually non existent. Even if OpenAI releases GPT5 now, 400b Llama 3 is still training and will most likely be in the same ballpark, again closing the gap between open source and proprietary.
OpenAI has $2b in revenue and is most likely very unprofitable. Meta makes over $100b gross profit. They likely can outspend OpenAI by a factor of at least 10 in terms of compute and talent -- speaking of which, a large majority of AI researchers find open source work a lot more appealing than closed for profit; so very likely top talent will end up at Meta. Google is still caught in the issue of AI killing their main revenue line, so most likely can never go as full in as Meta.
I think the biggest winners from all of this will be application developers, because you can choose any API service that hosts Llama 3, or just host it yourself on your own terms.
So far the majority of AI products have just been glorified wrappers around API endpoints. But if you manage to integrate AI deeply into a product, where the user doesn't even have to think they're interacting with an AI (e.g. behind the scenes calls that adapt to user context, combined with RAG, feeding it your internal API format, multi step reasoning / planning etc), you likely have a very sustainable business that only improves the more advanced the base models become.
But vendor risk / dependency should no longer be a concern for AI developers. Added to that the fact that hardware is only going to get faster / cheaper; there really are endless opportunities to disrupt existing software domains, much of which we're probably not even able to conceive now, but that will seem obvious in hindsight.
A beginner's guide to @eigencloud - an explanation of what it does, how it works, and why it's so powerful.
By the end of this, you'll be able to explain Ethereum restaking to your most crypto illiterate friends.
Let's begin 🧵: