Neil Mussett

[Neil Mussett @NeilMussett]

@romanmars Here you go! Good luck on the talk!

[CATHOLIC MAXIMUS @EcciusMaximus]

Japanese Catholic aura is on another level. The majesty of it. Beautiful.

[Taelin @VictorTaelin]

this is a weird long post without much substance

I strongly recommend against reading it

...

so, do you feel like whatever you're working on right now is pointless, or will have zero value soon, due to the crazy times we're living? then, perhaps you should stop, and start working on the only unsolved problem that actually matters TODAY:

✨ replicating GPT-3 in a laptop ✨

"why is that so important?"

because it would make AI incredibly cheap, which would mean everyone would have Fable-class models in their laptops, without depending on Anthropic, OpenAI, or any other hyper-scaler giant. and that's amazing, don't you think?

"isn't that literally impossible?"

that's the cool part: as far as computer science is concerned, no. not really. not at all. is entirely plausible and, as far as we know, most likely not even hard.

it takes one good idea. one breakthrough. one great "aha moment", to go from zero to "hey, this software I wrote is producing credible English sentences"

and whenever that happens:
- the entire AI industry collapses
- clusters are liquidated
- we all get Fable at home
- you become famous and rich, if that's your thing

sounds fun, doesn't it?

"wtf you talking, OF COURSE that is hard"

so prove it.

show me a paper, a lean file, anything that proves that training a Fable-class model fundamentally requires billions of dollars. you can't, because, guess what - it is not true! the only "evidence" we have is purely psychological. "many attempted over decades, and the best thing we have is GPTs, so, it is a hard problem" - but that's not a scientific argument. that's a human, psychological, sociological argument. and if that's it, consider the following counter-argument:

✨ humans are stupid as hell ✨

I mean, 10 years ago we didn't have transformers, so, that very argument could be used against GPTs existing. yet, they exist. we have them now, because someone found it. and, guess what, it isn't even complex. I mean, karpathy implemented the whole thing in a napkin. and it probably compiles.

we were just too dumb to figure GPTs out... for decades.

just like GPTs, there ARE other approaches, other algorithms, other architectures, equally simpler or even simpler, that do work. this is a mathematical certainty. and one of them might be astronomically faster than what we're doing right now.

and you might be the one to find it!

"me? why me???"

because you're intelligent, creative and handsome.
I see a lot of potential in you.
in fact, I always believed in you.

and I think you're wasting your time, doing that silly agent orchestrator. nobody wants that. quit it. take your most interesting ideas, intuition, creativity, and work in a problem that matters. do your best shot at reproducing GPT-3 in your own laptop.

do NOT fork llama.cpp.
do NOT train another LLM.

do something... ✨different✨

it must be unique, novel, full of YOUR soul. something nobody thought of, or bothered doing.

go ahead and implement that thing in C/CUDA (or Bend!).

no Python!

zero excuses for Python.

any model is fluent in GPGPU now. build a real kernel.

and then, train your thing. download wikipedia, give it time and compute to absorb the patterns of English speech. you can rent GPUs anywhere nowadays. let it train. then, ask it some questions. chances are it will just respond back. just like GPT-2 answered OpenAI. computers are incredible. don't underestimate them!

"many tried. nobody succeeded. why would I?*

see - that's your mistake again. turns out not many actually tried, at all. I promise you. who do you think is seriously working on that?

people on Mozilla?

they're busy building a browser

Linus Torvalds?

he is busy building an OS

employees at OpenAI, Anthropic, xAI?

they're paid to work on what is proven to work: GPTs.

what about all the AI enthusiasts all around the world?

yeah, you know they're mostly fine tuning Qwen

and how about your friends?

if only they weren't busy building a SaaS in the eve of AGI...

how about people from the past?

bro - people from the past seriously expected Lisp would be AGI. just dismiss them. they didn't have the compute, the resources, the knowledge, the MODELS that we have today. that YOU have access to.

so, what's left? not much.
the world looks big. it is not.
truth is: ✨almost nobody is working on this ✨

"I still think it is impossible. I don't trust you"

well, take my word no more.

Ilya himself, in his 2019 talk on GPT-2, said:

> "the story of deep learning is this: empirically old simple methods which were usually invented in the 80s and the 90s when scaled up on very large clusters work really well."

and then:

> "(we took) normal simple reinforcement learning method, scaled it up, and discovered that it suddenly becomes very capable of solving extremely hard problems."

and again:

> "you take a simple tool which is unimposing and barely works, and then you run it on a big cluster and suddenly it works, it becomes a capable tool for solving problems"

do you see the point here?

Ilya isn't arguing that transformers are magic.
Ilya is arguing that SCALING is magic

step #1: take a simple, elegant algorithm.
step #2: shove compute at its face.
step #3: ...?
step #4: your computer is talking to you

THAT is the key insight that led to GPT-3

THAT is what Ilya saw

THAT is what caused the OpenAI x Anthropic war

THAT is the founding principle of the ongoing era

not "scaling transformers work"

but "scaling beautiful algorithms works"

that's the incredible lesson.

yet, we all took it and... threw it way.

- zurk bought 100k GPUs. to train GPTs

- musk bought 100k GPUs. to train GPTs

- bezos bought 100k GPUs. to train GPTs

...

that's what everyone is doing.

so, no. not many are trying to replicate GPT-3 through other means.

we're just ants, after all...

whenever we find a pile of sugar, we leave a track of pheromones, which guide the rest of the colony towards the new food source. the colony then swarms around the pile, extract all of it, until no grain is left.

but piles of sugar aren't spontaneously generated in the middle of nowhere. they imply something more profound: "humans are around". and, if humans are in sight, even better things must be. like a big sweet cake.

a colony that only follows the pheromone trail would miss the cake for the grains. that's why every ant species has scouts and exploratory foragers. and, just like a pile of sugar implies something more profound, LLMs also imply something quite profound:

*computers are capable of thinking*

a pile of sugar is never alone.

GPTs are most likely not the only system capable of thinking.

so, if you find yourself a bit lost, without purpose, like your work is pointless and Fable 3 will soon one shot it anyway... consider becoming a scout. find a new approach to AI. bring something new to humanity. breaking out of the massive cost associated with training GPTs is the next big step in AI, and it will only happen if people like you work to make it happen.

[Daniel Hoffman @ds_hoffman]

Christian scholars using “BCE” and “CE” in their published work is embarrassing.

[NOBUNAGA🇯🇵🏯_夏樹蒼依 @japan_nobunaga]

USA. A Mexican restaurant. We had not yet ordered anything, and the food was already arriving.

Chips. Salsa. Unrequested. Free.

I stopped the waiter. "We have not earned these."

"They just come with the table, man."

They come with the TABLE. In my land, hospitality is a debt. Every gift creates an obligation, weighed carefully, returned in the proper season with interest of feeling. Here, the gift arrives before you have even proven you can pay for dinner.

This is not an appetizer. This is a declaration: we trust you. Eat.

I ate with the gravity the moment deserved. And then — I must report this calmly — the basket emptied, and a new one appeared.

"Did we…?"

"Refill," the waiter said. "It's bottomless."

Bottomless. They have wells of salsa. The supply lines of this nation are beyond anything my ancestors imagined.

My friend warned me. "Don't fill up on chips, dude."

Too late. I had accepted three baskets. Honor demanded each one be finished — an unfinished gift is an insult. By the time my actual food arrived, I was a ruined man.

I was not hungry. I was not comfortable. I had been defeated by a courtesy.

Generosity that arrives before the request cannot be repaid. It can only be survived.

I know the rule now. I have made my peace with the basket. One basket. Two at the most.

Who am I deceiving. There is no number of baskets I would refuse. The trust of a nation is in that salsa, and I intend to honor all of it.

[Neil Mussett @NeilMussett]

@SceneOnRadio @PeterBeinart @catchatweetdown I’m conservative, and this had blind spots. <4% republicans in news? NBD, because corporations are censoring radical reporters. Your self analysis should mention that all your examples of bad behavior is from conservatives. Isn’t this a bit of a straw man?

[Catholicism in East Asia @TheChurchInAsia]

Another painting by Chinese artist Bai Huiqun, this one titled "Our Lady with an Angel Amidst the Clouds and Holding the Child". 1948, scroll watercolor on silk.

[Catholicism in East Asia @TheChurchInAsia]

A 1948 Chinese watercolor painting on silk, "Jesus with Martha and Mary". The artist is Bai Huiqun.

[marqix ☆ @fwmarqix]

Me: sitting quietly in a tiny ramen shop.

Chef: Extra egg?

Me: Sure.

Chef nods with terrifying seriousness.

Friend: Congratulations.

Me: For what.

Friend: You've been chosen.

Me: By WHO.

Chef disappears into kitchen.

Entire staff suddenly start moving faster.

Me: Why did the atmosphere change.

Friend: You complimented the broth too sincerely.

Me: That's bad?

Friend: Now he must prove himself.

Me: This feels illegal.

Chef returns carrying a bowl that looks spiritually important.

Chef: Please.

Me: Why does this ramen have an aura.

Friend already taking photos: I've never seen him use that spoon before.

Me: WHAT SPOON?!

Old customer in corner whispers: "The dragon ladle..."

Me: absolutely not.

Chef watches silently while I take first bite.

long pause

Me: ...oh my God.

Chef closes eyes slowly like a warrior hearing good news from battle.

Random businessman starts clapping once.

Then the whole restaurant joins in.

Me: PLEASE STOP.

Friend wiping tears: He accepted you.

Me: IT'S NOODLES.

[Catholicism in East Asia @TheChurchInAsia]

Happy Mother's Day! This 1948 watercolor painting on silk by Bai Huiqun depicts the Virgin Mary with a young Christ.

[Jeremy Wayne Tate @JeremyTate41]

Until today, this has all been happening in secret. We have been working with the University of Dallas, Founders Classical, and Founders Bastrop, to launch the beginnings of an alternative to College Board’s AP. Today, for the first time in history, students took the first ever Classical Baccalaureate Exam (U.S. Government and Politics). The exam even included an oral component where students had to have a conversation with an adult about the foundations of American government. We made history today and College Board’s AP program just got a new competitor. This isn’t simply a battle between two companies, this is a battle between competing visions for the future of American education.

[Robert P. George @McCormickProf]

This is monstrous, Congressman. We have our dignity and basic rights--human rights--in virtue of our humanity, not age, size, or stage of development, anymore than race, sex, or ethnicity. Human dignity is inherent, not acquired. All of us have it, and we have it from the point at which we come into being; we do not lose it except by ceasing to be (i.e., by dying). On this principle--that of the profound, inherent, and equal dignity of each and every member of the human family--all else depends. It is the foundational principle of justice. If we bandon it, then all other claims of justice are rendered arbitrary ... and Thracymachus wins.

[Rony @Ronycoder]

Instead of watching an hour of Netflix, watch this 30-minute speech by the Head of Anthropic’s Coding Agents research team. It will teach you more about vibe coding than 100 paid courses.

[I Love Typography @ilovetypography]

How Not to Take 10 Years to Design a Typeface

Jamie Clarke’s amazing decade-long story of a wonderful typeface called Nave.

New on the ILT Blog: https://t.co/0Yim0LRHdW

[Native American Pride @native_am_pride]

NEWLY MARRIED NATIVE AMERICAN COUPLE. ❤️❤️WE NEED A BIG AHO❤️❤️

[Sr Lusayo Kaseghe @kaseghe64295]

Friends put us in your prayers we have lost one of our sister in our congregation.

[Ugochukwu Ugwoke, ISch @FrUgochukwu]

Since December 2, 2025, Rev. Fr. Emmanuel Ezema, priest of the Diocese of Zaria, has remained in captivity.

We refuse to forget him. We continue to pray for his safe and speedy release 🙏🏿

[Pope Leo XIV @Pontifex]

It is with deep concern that I am following the developments in Venezuela. The good of the beloved Venezuelan people must prevail over every other consideration. This must lead to the overcoming of violence, and to the pursuit of paths of justice and peace. I pray for all this, and I invite you to pray too, entrusting our prayer to the intercession of Our Lady of Coromoto, and to Saints José Gregorio Hernández and Carmen Rendiles. #PrayTogether

[Robert P. George @McCormickProf]

Disagreement is a reason to engage an issue, especially if it's an important issue, because the fact that a reasonable person of goodwill has arrived at a judgment different from one's own is a signal that one's judgment may be unsound and therefore in need of revision. Even if the engagement does not cause one in the end to revise one's judgment, it will in a great many cases deepen one's understanding of the matter. (This is a too-often-overlooked point John Stuart Mill made in "On Liberty," and it's a point he was right about.)