Entropy is one of those formulas that many of us learn, swallow whole, and even use regularly without really understanding.
(E.g., where does that “log” come from? Are there other possible formulas?)
Yet there's an intuitive & almost inevitable way to arrive at this expression.
Self-attention as a directed graph!
Self-attention is at the heart of transformers, the architecture that led to the LLM revolution that we see today.
In this post, I'll clearly explain self-attention & how it can be thought of as a directed graph.
Read more...👇
#Bayesian updating is truly fascinating! It reveals a wealth of interesting behaviors and insights!
For example, given a prior (green) and a likelihood (red), as we reduce the variance of the likelihood, the posterior (black) converges to the likelihood. The prior becomes less influential as the likelihood becomes increasingly informative!
Try out my set of interactive #Python Bayesian updating demonstrations on #GitHub @ https://t.co/Wt4bMLgAwz ∀. #DataScience
When I teach Principal Component Analysis (PCA), I use my interactive dashboard to engage my students. They can observe how, through an orthogonal transformation (rotation) of a two-feature dataset, the variance of the data projected onto one of the components can be maximized.
I shared my #Python @matplotlib dashboard on #GitHub @ https://t.co/obhJCkCg7V ∀. #DataScience #MachineLearning
I have put online the content of 10 lectures of 2h on the basics maths of AI. It contains raw transcripts, so probably not super useful, but it might be helpful to give some ideas. https://t.co/oRHCwixNqq
62% des MCF sont au grade CN ; la pension moyenne des MCF est de 3115 euros (comparée à 3681 euros pour les PRAG, et 4530 euros pour les PU).
A quand un réveil des MCF !
Comment faire un doctorat conduit à une carrière inversée en tant que MCF ?
Rappel : L'arrêté du 13 février 2023 divise par deux le taux de l'avancement au grade MCF HC en le faisant passer de 20% en 2022 à 10% en 2025
Corrigendum: the co-authors are E. C. Faye and M. D. Fall, both from Institut Denis Poisson (IDP, Orléans).
Sorry @FallMDiarra for the typo on your name! 😳
New #arxiv preprint introducing a probabilistic counterpart to regularization-by-denoising (RED) for #Bayesian inversion. Comes w/ a dedicated #MCMC algo. to sample from the resulting posterior.
Joint work w/ E. C. Faye & M. D. Faye (@Univ_Orleans).
🔗https://t.co/FrorhgEX6x
I'm an Accepted Author of the 2024 IEEE International Symposium on Biomedical Imaging (ISBI)! Join me in Athens, Greece, from 27-30 May 2024. #ISBI2024 https://t.co/kp00QCJkYy