The section on hallucinations has to be one of the best read to learn about LLMs for a while!!!
How does hallucination happens?
1. The model initially attempts entity recognition on incoming tokens.
2. If it recognizes the entity as "unknown" or "unfamiliar," the default inhibitory rejection activates strongly, leading to refusal to answer.
3. If the model believes (rightly or wrongly) that it recognizes the entity, the inhibitory mechanism is suppressed.
4. Correct recognition → Correct response.
5. Incorrect ("misfired") recognition → Hallucination.
This is not the complete mechanism of mechanism as demonstrated that even mechanistic intervention indicates hallucination can happen outside of this “rule”, but still a very informative finding!
https://t.co/ijkoEvAtkA
===
Subscribe to https://t.co/mQMIRbOUJv if you want more!
#llms #readingwithellie #anthropic
Check out the latest article in my newsletter: If learning intersection math excites you, you can be a great engineer. https://t.co/lvCPCK0mJ8 via @LinkedIn
Almost every ambitious engineer or student I meet lately asks the same anxious question: 'Do I have to learn machine learning or LLMs, or risk becoming obsolete?’
I thought I'll just answer it once and for all. :)
#techexec#llms#insight#career#engineering
@Avis [19940841US4] promised a full refund, did not refund. And then today said will not refund anything AT ALL. Avis/Budget/Payless, you used to be great, BUT NO MORE.
A car that almost caused a crash, and such irresponsible support.
#avis #
Horrible @Avis rental experience. Flat tire due to poor maintenance. Even roadside assistance folks were shocked we did not crash. Yet, @Avis try to charge ME for their fault. Fixed things myself. Will not use @Avis again. Will ask friends to cancel their reservations.
Not gonna be active on Twitter tonight. I’m getting the @memecoin waitlist (a real one) in half an hour (wouldn’t expect a lot of you to understand anyway) so please don’t DM me asking me where to get $MEME
#4c5f64ee#MEMEWL
The news coming out of the United States is horrific. My heart goes out to the millions of American women who are now set to lose their legal right to an abortion. I can’t imagine the fear and anger you are feeling right now.
@thisistechtoday@wongmjane You can try local Asian markets or even restaurants. They usually have them this time of the year :) should help to remind since good memories
A strong team isn't where everyone worked in Google, FB, or so, but that the team demonstrates characteristics of a high performing team.
YOU can build a strong team.
Not exhaustive, but here's some 4 key points I look for! Without them, it's a no go.
https://t.co/qWhN5Trvze