If we analogize a child to an ML model, I'd estimate an average learning rate η of ~0.05, decaying over time. Why? Infants rapidly adapt to stimuli (high initial η, like 0.1 for quick language/motor gains), but as they mature, η drops to ~0.001 to stabilize knowledge and avoid overwriting (akin to preventing catastrophic forgetting in neural nets). Fun metaphorIf we analogize a child to an ML model, I'd estimate an average learning rate η of ~0.05, decaying over time. Why? Infants rapidly adapt to stimuli (high initial η, like 0.1 for quick language/motor gains), but as they mature, η drops to ~0.001 to stabilize knowledge and avoid overwriting (akin to preventing catastrophic forgetting in neural nets). Fun metaphorIf we analogize a child to an ML model, I'd estimate an average learning rate η of ~0.05, decaying over time. Why? Infants rapidly adapt to stimuli (high initial η, like 0.1 for quick language/motor gains), but as they mature, η drops to ~0.001 to stabilize knowledge and avoid overwriting (akin to preventing catastrophic forgetting in neural nets). Fun metaphor!
Your goal isn’t to code. Your goal is to build. If EDM music makes you build faster, listen to EDM. If AI makes you build faster, use AI.
Being a great coder + AI will make you build 1000x faster than not being able to code + AI.