Tymon

[Tymon @tymonq]

@Kyndryl @grok how did the market respond?

[Tymon @tymonq]

@AkiyoshiKitaoka Wow!

[Andrej Karpathy @karpathy]

We have to take the LLMs to school.

When you open any textbook, you'll see three major types of information:

1. Background information / exposition. The meat of the textbook that explains concepts. As you attend over it, your brain is training on that data. This is equivalent to pretraining, where the model is reading the internet and accumulating background knowledge.

2. Worked problems with solutions. These are concrete examples of how an expert solves problems. They are demonstrations to be imitated. This is equivalent to supervised finetuning, where the model is finetuning on "ideal responses" for an Assistant, written by humans.

3. Practice problems. These are prompts to the student, usually without the solution, but always with the final answer. There are usually many, many of these at the end of each chapter. They are prompting the student to learn by trial & error - they have to try a bunch of stuff to get to the right answer. This is equivalent to reinforcement learning.

We've subjected LLMs to a ton of 1 and 2, but 3 is a nascent, emerging frontier. When we're creating datasets for LLMs, it's no different from writing textbooks for them, with these 3 types of data. They have to read, and they have to practice.

[Andrej Karpathy @karpathy]

The hottest new programming language is English

[Tymon @tymonq]

Ukraina. Stan państwa [FILM DOKUMENTALNY] https://t.co/PSKx9Q6jY2 via @YouTube 🍗🍖🍖🍖👋

[Tymon @tymonq]

Listen to "(DeFi)_ Architektura, Ryzyka i Perspektywy " by 🧙🏻‍♂️🍇. https://t.co/hQQTxk2LyA

[Tymon @tymonq]

@AkiyoshiKitaoka Mona Lisa

[Akiyoshi Kitaoka @AkiyoshiKitaoka]

Blue and yellow stripes. Mona Lisa 6%. stripes 94%.

[Tymon @tymonq]

@napokolenia @Radio_TOK_FM @boguszmichal @OSW_pl 👂

[Tymon @tymonq]

@MarcinTorz Fajnie że piszecie, ale można też obliczyć: 540k : 600 stojaków ~ 900 zł za 1. Wiele-mało, ale brzydko 100%

[Tymon @tymonq]

@elonmusk Kardashev scale and Effective Acceleration?

[Tymon @tymonq]

@RobertRostek @PLinSaudiArabia Congrats @maczka_p 🎉👏🎉

[Tymon @tymonq]

@NorwichCityFC @samaritans Who has produced this great spot?

[Tymon @tymonq]

@RyszardPetru Dawaj Ryszard o której filmik dasz?

[Tymon @tymonq]

@RadekKar Załóż, załóż.

[Tymon @tymonq]

@Przegaa Jak to wytrenowałaś Pani?

[Tymon @tymonq]

@Rysz_Wojtkowski @MedicoverPL Jeździectwo to ekstremalny sport pełny wysokiego ryzyka.

[The Cultural Tutor @culturaltutor]

500 years ago there was a painter called Pieter Bruegel who changed the course of art history.

And his paintings are unlike anything you've seen before...

[Tymon @tymonq]

@wiseconnector 3452839

[Przemek Gerschmann @PGerschmann]

Jaka jest najlepsza książka, podcast lub film, który obejrzeliście w 2022?

#pytanieDoKawy