Shoutout to YouTube for solving the "comments section" problem of Computer Science. I recall at one point they used to be 90%+ toxic/spam, but in most videos I come by today the comments are almost surprisingly wholesome and informative.
The most unknown most common shortcut I use on my MacBook is:
- Command+Option+Shift+4 to select a small part of the screen and copy it into clipboard as an image
- Command+Shift+4 to do the same, but save it as a file on Desktop as png
Life-changing.
Superb list on how to do great work, including:
• It is easier for a team to do a hard thing that really matters than to do an easy thing that doesn’t really matter; audacious ideas motivate people.
• Concentrate your resources on a small number of high-conviction bets... You can delete more stuff than you think.
• Do not let the org chart get in the way of people working productively together.
• Take risks on high-potential people with a fast rate of improvement. Look for evidence of getting stuff done in addition to intelligence.
• Fast iteration can make up for a lot; it’s usually ok to be wrong if you iterate quickly... execution should be measured in weeks.
• Inspiration is perishable and life goes by fast. Inaction is a particularly insidious type of risk.
• Working with great people is one of the best parts of life.
There's too much happening right now, so here's just a bunch of links
GPT-4 + Medprompt -> SOTA MMLU
https://t.co/Jkp96izfec
Mixtral 8x7B @ MLX nice and clean
https://t.co/75StzY5AHe
Beyond Human Data: Scaling Self-Training for Problem-Solving with Language Models
https://t.co/gOCWjfY7ec
Phi-2 (2.7B), the smallest most impressive model
https://t.co/Fps8tI5QVi
LLM360: Towards Fully Transparent Open-Source LLMs
https://t.co/l6E16GfdIN
Honorable mentions
https://t.co/7GQqiCGHRH
https://t.co/3GZrYPp9KP
https://t.co/Su8iiDksMZ
You know how image generation went from blurry 32x32 texture patches to high-resolution images that are difficult to distinguish from real in roughly a snap of a finger? The same is now happening along the time axis (extending to video) and the repercussions boggle the mind just a bit. Every human becomes a director of multi-modal dreams, like the architect in Inception.
Coming back to Earth for a second, image/video generation is a perfect match for data-hungry neural nets because data is plentiful, and the pixels of each image or video are a huge source of bits (soft constraints) on the parameters of the network. When you're training giant neural nets in supervision-rich settings, your train loss = validation loss, and life is so good.
My favorite place to keep an eye on the AI video space unfold atm is probably https://t.co/l1xRaq71C4 , or the individual Discords.
The UAE Minister of AI @OmarSAlolama points to a historical precedent of premature technology regulation motivated by fear: the ban of the printing press in 1515 by Sultan Selim I led to the decline of the Ottoman Empire.
“We overregulated a technology, which was the printing press. It was adopted everywhere on Earth. The Middle East banned it for 200 years. The calligraphers came to the sultan and said: ‘We’re going to lose our jobs, do something to protect us’—so, job loss protection, very similar to AI. The religious scholars said people are going to print fake versions of the Quran and corrupt society—misinformation, second reason. It was fear of the unknown that led to this fateful decision."
https://t.co/CJQd6rMz5D
Popping this up: a response to a question about what I consider reasoning & planning, why current Auto-Regressive LLMs can't do it, why that would require AI systems with world models, and why we still have a lot of progress to do towards AI systems that can learn and reason.
Another tweak peek at how I introduce neural networks after explaining kernel regression as regression in feature spaces, giving the insightful case of random features, and then simply adding the features as the argument in the loss function to get the loss of a neural net.
At the end of the day, the greatest privilege of my job is working with people who are driven by mission. These last 5 days, I saw people across OpenAI remaining calm and resolute in driving their mission despite all that was happening around them. And I saw people across Microsoft remain focused on our mission and serving our customers and partners, stepping up to help in every way. This is what I’m especially thankful for going into the Thanksgiving holiday. Thank you for your resolve and for the work you do each day to advance AI safely and responsibly and distribute its benefits to all of humanity.
Salesforce will match any OpenAI researcher who has tendered their resignation full cash & equity OTE to immediately join our Salesforce Einstein Trusted AI research team under Silvio Savarese. Send me your cv directly to [email protected]. Einstein is the most successful enterprise AI Platform completing 1 Trillion predictive & generative transactions this week! Join our Trusted AI Enterprise Revolution. ❤️
About 650 / 770 signed at this moment. As people start waking up, more will come. All the efforts started after 1:30 AM, 500+ within two hours and all of this after 2 crazy days with very little sleep.