Chris Christie on Trump: "The grift from his family is breathtaking. It's breathtaking. Jared Kushner & Ivanka Kushner walk out of White House and months later get $2 billion from the Saudis? $2 billion from Saudis. Do you think it was because he's some kind of investing genius?"
Why AI Will Save The World
By Marc Andreessen
The era of Artificial Intelligence is here, and boy are people freaking out.
Fortunately, I am here to bring the good news: AI will not destroy the world, and in fact may save it.
🧵
Googles Keynote 🤯 for AI. Here's a brief overview:
About 25 different AI products. Biggest LLM news
Palm 2
- 4 different sizes, gecko (runs on mobile) , otter, bison, unicorn
Palm med
- tuned for Medical purposes. Can analyze x-rays to help radiologists.
- Palm Security
Oops haven't tweeted too much recently; I'm mostly watching with interest the open source LLM ecosystem experiencing early signs of a cambrian explosion. Roughly speaking the story as of now:
1. Pretraining LLM base models remains very expensive. Think: supercomputer + months.
2. But finetuning LLMs is turning out to be very cheap and effective due to recent PEFT (parameter efficient training) techniques that work surprisingly well, e.g. LoRA / LLaMA-Adapter, and other awesome work, e.g. low precision as in bitsandbytes library. Think: few GPUs + day, even for very large models.
3. Therefore, the cambrian explosion, which requires wide reach and a lot of experimentation, is quite tractable due to (2), but only conditioned on (1).
4. The de facto OG release of (1) was Facebook's sorry Meta's LLaMA release - a very well executed high quality series of models from 7B all the way to 65B, trained nice and long, correctly ignoring the "Chinchilla trap". But LLaMA weights are research-only, been locked down behind forms, but have also awkwardly leaked all over the place... it's a bit messy.
5. In absence of an available and permissive (1), (2) cannot fully proceed. So there are a number of efforts on (1), under the banner "LLaMA but actually open", with e.g. current models from @togethercompute, @MosaicML ~matching the performance of the smallest (7B) LLaMA model, and @AiEleuther , @StabilityAI nearby.
For now, things are moving along (e.g. see the 10 chat finetuned models released last ~week, and projects like llama.cpp and friends) but a bit awkwardly due to LLaMA weights being open but not really but still. And most interestingly, a lot of questions of intuition remain to be resolved, e.g. especially around how well finetuned model work in practice, even at smaller scales.
Prompt:
"I want you to find 10 bootstrapping stories of founders from 2000 to 2010 that were first movers in their industry."
Keep 3 things in mind:
• Timeframe ( 2000 to 2010)
• Genre of stories ( bootstrapping stories)
• Specific details ( first movers in their industry)
Every AI hobbyist needs to realize how soon your laptop and smartphone will have a ChatGPT on it.
It's happening soon and way faster than you think.
Here's what you need to know (the non-technical version):
The modern world, and all the tools it provides, will give you one of two things:
1. Chains of endless distraction, mindless consumption, and a never ending stream of unearned dopamine
Or...
2. The keys that unlock intentional action, mindful education, and well-earned success
The tools that power your ability to thrive within the neo-renaissance are the same tools that keep you trapped in the modern recession.
How you choose to use those tools is what determines the reality you experience.
And at some point, you have to make the choice.
Do you stay stuck in the failing system, unable to break free because you're shackled by how you use your technology?
Or do you use that very same technology to carve a path for yourself, add genuine value to the lives of others, and access a life of absolute abundance?
The choice is clear, and I hope you make the right one.
This is the most exciting time to be alive in all of human history, and the opportunity that exists has never been more abundant or accesible.
Don't let it pass you by.
Don't let it go to waste.
Chibi(dot)ai - Simple AI writing tool with a lot of power under the hood.
Retune(dot)so - Early release. Nocode setup to create custom chatbots and fine tunes.
Subtxt(dot)ai - AI-powered story structure builder that blows me away.
.
How about you? What are your fave AI tools?