Unlock effective ecommerce strategies, optimize marketing efforts, and solve real-world business challenges with data insights using Python ,maths and Big Data
Doctors expected stents to reduce stroke risk — but a major study found the opposite.
How statistics was used to decode what's true? You will learn how treatment and control groups are created and its importance.
https://t.co/lhgDtZ0Jjn
Quickly turn a GitHub repository into text for LLMs with Gitingest ⚡️ Replace "hub" with "ingest" in any GitHub URL for a text version of the codebase.
I wish I had had this animation when teaching Markov chain Monte Carlo. Could also help think about the behaviour of deep learning optimisation with non-vanishing gradients.
Nice collection of LLM papers, blogs, and projects, focussing on OpenAI o1 and reasoning techniques.
What it offers:
📌 Curates papers, blogs, talks, and Twitter discussions about OpenAI's o1 and LLM reasoning
📌 Tracks frontier developments in LLM reasoning capabilities and techniques
Cold emails are hard and good ones can change a life. Here is my email to @NandoDF that started my career in ML (at the time I was a PM at Google) https://t.co/ILaOtGQvbD Real effort (incl feedback) went into drafting it. Thanks to @EugeneVinitsky for nudging me to put it online
📣Check out our #NeurIPS24 paper Geometric Trajectory Diffusion Models (GeoTDM), a new diffusion-based generative model that captures the temporal evolution of the ubiquitous geometric systems!!
Paper: https://t.co/wy8lQGxaNe
Code: https://t.co/6FW1UiRCZV
🧵1/8
I just spent my Saturday writing >5000 words fully documenting every single feature of FastHTML handlers.
So please, read it, because I went slightly crazy doing this and I need to believe this helps someone out there...🤪
https://t.co/aHADwfspo7
Since a number of people asked, this is what I mean by deep learning way of understanding reinforcement learning.
It's all about one question: how can I differentiate through the total reward my agent is collecting?
The total reward (i.e., the value function) is the objective function of RL. When we see an objective function in deep learning, our goal is to differentiate through it to compute a gradient. You can view many RL techniques and fundamental problems as ways to fulfill that unstoppable desire to differentiate through the value function.
If the world your agent is operating in is differentiable you can do it the easy way. If everything is deterministic or reparameterizable à la VAE, you have a complete computational graph. Just compute that gradient and push that value function up.
What if you don't have access to the world dynamics? You still want to compute that gradient. Learn a world model from data, then you will generate a valid computational graph and it will give you a gradient to push that value function up.
Your world model doesn't work as expected or it's computationally expensive? You can predict the value in a direct way with a critic, a value function approximator, and differentiate through it. With a critic, you can just do one forward and a backward pass. Direct gradient to your agent. No compounding errors, no messed up gradients, nothing too expensive.
Learning a critic by just predict the rewards you are observing is requiring too much data? You can use temporal difference, it's a nice concept that exploits the structure of decision-making to speed up learning for a critic. Then you will be able to compute your gradient.
You can understand a lot about reinforcement learning as just a quest to compute that gradient of the value function. It's not all of it, but I find it always useful to think about it.