Φτιάξαμε ένα AI που μπορεί να «διαβάσει» ολόκληρη τη Διαύγεια.
Όχι μόνο τα ποσά και τα metadata.
Και τα ίδια τα PDF των αποφάσεων και των συμβάσεων.
Να πώ�� το κάναμε 🧵👇
My summer project is done! A 20 video, free course on post-training to accompany my book is all on YouTube with slides open for modification & re-use.
~12 hours of content covers the core foundations and some research areas I think will grow in importance. It was a fun time to review all the fundamentals again, as it is clear in the next 1-3 people the amount of people wanting to learn post training will likely 100X again from today, as we have already 100X'ed from two years ago.
As AI agents get increasingly capable at coding and discussing these fundamentals (see the code exercises accompanying the book that I am refining with the community) I think developing clear intuitions for how models work and why is one of the most important skills going forward in AI. Still, learning the post-training math is the best way to battle test them. I personally just in this course am starting to master how forward/reverse KL relates to post-training topics.
Thanks to all my viewers, and I'm happy to answer questions in the book discord or understand how to better teach the various reward models, on-policy distillation, new RL algorithms, etc.
Plus, the book is 50% off right now with the code PBLambert on Manning to celebrate the launch.
I'll share the relevant links below.
Who's going to make this course for pretraining?
@Finumus1 xhigh seems like a very good model as well, straightforward and not too much talking, straight to business.
overall, very impressive results.
Introducing Kaleido💮 from @AIatMeta — a universal generative neural rendering engine for photorealistic, unified object and scene view synthesis.
Kaleido is built on a simple but powerful design philosophy:
3D perception is a form of visual common sense.
Following this idea, we formulate rendering purely as a sequence-to-sequence generation problem, successfully unifying neural rendering with the architecture principles behind modern language and video models.
Unlike traditional neural rendering methods, Kaleido learns 3D purely in a data-driven way, without explicit 3D representations or structures.
It acquires spatial understanding directly through large-scale video pretraining, then multi-view 3D data finetuning, inspired by how LLMs acquire textual common sense from large corpora before specialising in domains like coding.
Through extensive ablations, we progressively modernised the architecture design and training strategies and tackled key scaling challenges in sequence-to-sequence generative rendering, arriving at a design that’s simple, versatile, and scalable.
Kaleido significantly outperforms prior generative models in few-view settings, and remarkably is the first zero-shot generative method matches InstantNGP-level rendering quality in multi-view settings.
We view Kaleido also as an alternative step towards world modeling that flexibly spans a spectrum of “realities": with many views, it faithfully reconstructs grounded reality; with fewer views, it imagines plausible unseen details.
🔗 Explore more results and paper: https://t.co/fOcssVKQiW
📢 Hiring a PhD intern in Generative AI @Meta (London) to work with my team on video generation.
If you’ve worked on diffusion / flow matching (plus ideally LLMs/VLMs) and have strong engineering skills, apply here: https://t.co/HxYgEVBa7T
24-week internship preferred
We’re releasing access to Speech-1, our conversational speech model designed specifically for customer phone calls (8khz telephony) to reduce call drop rates.