Chud fatigue has fully set in. The cheap thrill of offending others can only distract you from your loneliness for so long, before you’re forced to reckon with how unsustainable it is to live in a belief system that proudly eschews all forms of basic human decency.
That grammar thing you do may not be wrong in all contexts, but it might be risky in some.
@GrammarGirl Mignon Fogarty explains on this episode.
https://t.co/dQRjbmv0X3
Chomsky was wrong.
Researchers found your brain doesn’t store language the way every textbook since 1957 claims.
For decades, the undisputed rule of linguistics, led by Noam Chomsky, was that human language is hierarchical.
We were told our brains process language using complex "grammar trees." That we secretly build deep, abstract, mathematical rules in our heads before we speak.
This new paper proves that is completely wrong.
Researchers at Cornell University analyzed how people actually process and produce language in real time.
They found sequences. Linear chunks.
When we speak, we aren't calculating deep syntactic rules. We are just predicting the next most logical sequence of words based on the context of the words right before it.
We string linear chunks together.
If this sounds familiar, it should.
This is exactly how Large Language Models like ChatGPT work.
For years, critics have dismissed AI as "just a next-token predictor." They said it isn't truly intelligent because it doesn't understand deep grammatical hierarchies like humans do.
But this paper suggests humans don't use those hierarchies either.
We are just predicting the next chunk.
Language isn't a rigid tree of mathematical rules. It's a linear stream of contextual predictions.
We thought we were building AI to mimic the complexity of the human brain.
It turns out, the human brain was just running a simpler algorithm all along.
@thesupermannx We thought this was a great and interesting result, so we talked to the authors! You can read or listen here. We really get into the weeds.
https://t.co/y8HzQd8O0v
@lefthanddraft The model can “notice” its own “thoughts”.
That’s how humans talk about introspection, so of course that’s what the model comes up with.
He’s got this right.
Language output is only one part of language. The models are mimicking language output, without the sentience or awareness behind it.
Being able to convincingly mimic language output is an impressive accomplishment, don’t get me wrong.
Ben Affleck says AI is simply matrix multiplication, linear algebra and floating point calculations, and however convincingly it sounds like a person, it has nothing to do with thought, humanity or feeling
��Nor do I believe, and I think it’s important to draw the distinction between what AI does, which is simply predict the next token or the next word in a sentence, then add that word on, run it back to the machine, do a lot of computation and pick the next word."
"That is a very different thing than sentience or thought. And I think we need to be really clear about that because it can be convincingly, in an illusory way, sound like thought or like a person."
"But let’s be real clear. This is matrix multiplication. This is linear algebra. These are floating point calculations. It has nothing to do with thought, humanity, or feeling.”
Wait, Ben hates interrobangs‽ But they're great! They're a question mark AND an exclamation point. Do you use them?
New episode on punctuation with Florence Hazrat here, or in all the podcast places:
https://t.co/Aocn6FpxpX
New episode! It's okay to play with punctuation. @FlorenceHazrat tells us about the history of the marks we use, and who the heavy hitters were.
@BasicBooks
Book here: https://t.co/0nDG3lNs4F
Episode here: https://t.co/Aocn6FpxpX
@phono_logical No specific text, but many suggested
This is how I might present this to a first-year class where syntax is not the focus. I would explain that this is very ropey, and they will have to unlearn some things when they do real syntax. It’s just a tool for analysis at their level.
One way in which I am sort of not a nice person is that I characterise the philosophical antics of theists as “trying to wank God into existence using words”.
But now I see that this criticism is equally true for members of the AI consciousness cult.
Why do people think AI is conscious or sentient or whatever? It's because it talks to you. That's the whole reason. No one seems to think the Waymo or Tesla FSD is conscious even though it's just as complex (if not more) and even a remarkably similar architecture