The human brain is truly a marvel of nature.
If you horribly reductive, and boiled it down to a language model, you'd be looking at roughly 100 trillon parameters running as a sparse MoE architecture
Only about 1-5% of neurons fire at any given moment, meaning the brain "activates" maybe 1-5 trillion parameters per inference step.
For context, the largest AI models we've built probably top out around 5 trillion parameters.
The brain is roughly 100x larger. Even its active params at any given moment are larger than almost every model in existence today.
Here's what melts my brain (pun intnended) though
Your brain does all of this on about 20 watts of power, less than a dim light bulb.
Training a frontier AI model consumes enough electricity to power small cities for months. Running inference across data centers pulls megawatts.
Your brain runs 24/7 for 80+ years on the equivalent of a phone charger.
We haven't come close to matching the brain's scale. And we're not even in the same universe when it comes to efficiency.
Evolution spent 500 million yrs optimizing the most energy-efficient intelligence architecture ever known. we're trying to brute force our way there with compute and electricity.
Nature is still the best engineer in the room.
Ever annoyed by the long list of local Git branches that are no longer relevant? Solution:
git remote prune origin
That removes all local branches that have been deleted from remote (typically GitHub)
Add --dry-run to merely see a list first to confirm.
#git
If you want to learn something new, FOCUS is your friend. Pick ONE book, course, video series, etc. and work through it start to finish. If you find yourself on Wikipedia tangents, refocus and get back on track. The shortest path from A to B is a straight line.
"Nothing will change your future trajectory like your habits."
Article sums up many challenges I have with goals. How about you?
#100DaysOfCode#CodeNewbie
Habits vs. Goals: A Look at the Benefits of a Systematic Approach to Life https://t.co/waxytlf1S6 via @farnamstreet
Gonna do this tutorial before working with TDD on my own React project.
A guide to TDD a React/Redux TodoList App — Part 1 https://t.co/EGnwK0rUcH #react#redux#webdriverio via @sanj9000
Really like the tips! Still lvling up my terminal skills. 'history | grep' is gonna be useful for sure and i have already been enjoying 'sudo !!' for a while now.
So you've mastered the command line basics...but how do you take your skills to the next level?
Want to feel like a developer wizard?
Here are five awesome terminal tricks to help you level up as a developer, by @JacksonBates.
https://t.co/UVV6kF3Ocz
8 tips for effective time management 👨💻
🔸Set short and long-term goals
🔸Set priorities
🔸Automate boring stuff
🔸Schedule a calender/ task list
🔸Focus on one task at a time
🔸Put your tasks on a Deadline
🔸Learn how to say NO
🔸Take successive breaks
#100DaysOfCode
v4.3.0 is out! ✨
🌳 Introduce a Tree View component
💄 Support vertical tabs
📚 Remove the prop-types from TypeScript demos
⚛️ Add two import codemods
💄 Support small switch
And many more 🐛, 📚 improvements
https://t.co/oGigjb4HLy