white pill for my nerds:
60fps e-ink display
a random guy outperformed entire eng teams by developing a pixel by pixel driver for e-ink displays that makes it 60fps.
he did that after work for months, launched it yesterday.
the future is bright
this is actually insane
> be tech guy in australia
> adopt cancer riddled rescue dog, months to live
> not_going_to_give_you_up.mp4
> pay $3,000 to sequence her tumor DNA
> feed it to ChatGPT and AlphaFold
> zero background in biology
> identify mutated proteins, match them to drug targets
> design a custom mRNA cancer vaccine from scratch
> genomics professor is “gobsmacked” that some puppy lover did this on his own
> need ethics approval to administer it
> red tape takes longer than designing the vaccine
> 3 months, finally approved
> drive 10 hours to get rosie her first injection
> tumor halves
> coat gets glossy again
> dog is alive and happy
> professor: “if we can do this for a dog, why aren’t we rolling this out to humans?”
one man with a chatbot, and $3,000 just outperformed the entire pharmaceutical discovery pipeline.
we are going to cure so many diseases.
I dont think people realize how good things are going to get
MIT's "Street Fighting Mathematics"
This course teaches the art of guessing results and solving problems without doing a proof or an exact calculation.
readings: https://t.co/n8o2YlsqXo…
(audio generated by NotebookLM)
I did not advance in my process of learning languages the last year. At least not very strictly. However, I still softly practiced English and Portuguese. I am retaking my learning process in German, which has been quite a hard language.
Ich bin zurück!
I'll retake German and maybe study French or Russian at a very low pace.
I even need to improve my English and recover the fluency I have lost in the last few years. I will take a rest after finishing the Portuguese course.
Speaking of debuggers, I am looking forward to this book. Why? It's one of the most comprehensive ones on debugging. Sy Brand has been sharing great videos and articles on debuggers for quite a while; take a peek at the ToC.
New 20hr bootcamp on Probability & Statistics!!!
Videos released weekly but full playlist already posted:
https://t.co/3LnVCaeYGv
Probability & Statistics are cornerstones of data science and machine learning. This course rapidly covers the basics and gets into advanced topics.
Just put together a short Jupyter notebook with tips and tricks for reducing memory usage when loading larger and larger models (like LLMs) in PyTorch: https://t.co/fEx2e8E7jS
(PS: This is an LLM example but the same concepts apply to any PyTorch model)
If you're done with your first college probability theory class and you want to step it up, or if you just want to take a short cut into the world of random processes, you can trust the absolute genius Yakov Sinai to get you there.
Here's a top tip for aspiring mathematicians from Oxford Mathematician Philip Maini.
Be lazy.
More advice (and maths) from Philip in his 1st year student lecture on Fourier Series, the latest we are making available.
https://t.co/XR0JgYhZdG
An enlightening article 💎 that benchmarks various machine learning classifiers on small datasets, revealing some remarkable insights.
Contrary to the long-held belief, particularly among statisticians, that simpler methods are more effective for small datasets, the study proves this to be a myth.
Even with datasets smaller than 100 points, machine learning methods, including ensembles, boosted trees, random forests, and support-vector machines, consistently outperformed logistic regression—a method that dates back to the 19th century.
Interestingly, none of the top-performing models in the study were from scikit-learn, raising questions about its relevance in 2024.
Although CatBoost wasn't part of this study, it's highly likely it would surpass LightGBM in performance.
This challenges us to reconsider our choice of tools for dealing with small datasets in today's machine learning landscape.
#tabulardata #datascience
Remember:
You’ll be dead soon.
And likely forgotten.
The best way to deal with our insignificance is to live boldly and significantly.
That is, do something that matters…in your own eyes.
What other people think doesn’t matter.
Just go for it.
today i found out that this one australian guy has been toiling away making incredibly detailed Neural Circuit Diagrams with the vibe of a 1950s issue of Popular Mechanics, but content fit for the 2020s
behold. the Transformer
Emergence in LLMs is a mystery. Emergence in physics is linked to phase transitions. We identify a phase transition between semantic and positional learning in a toy model of dot-product attention. Very excited about this one! https://t.co/ALb9D8YdfP