Joe

I’m on Twitter to keep an eye on things that interest me. Sometimes, I retweet them.

[Joe @JoeSpellmeyer]

@Austen Yes totally…BUT having different menu prices is shady practice. Add all the fees, tip, service charge, etc needed to make a profit, but having separate prices based on delivery/pick up selection feels designed to obfuscate the true up-charge.

[Joe @JoeSpellmeyer]

@Codie_Sanchez An MD board certified in…psychiatry?

[Joe @JoeSpellmeyer]

@HellsHalfAcreSG

[Hell's Half Acre Stadium Goods @HellsHalfAcreSG]

🚨Giveaway Time: We're giving away four hats to two lucky winners. To enter all you need to do is:

🐸 Like & RT this post
🐸 Reply with a TCU GIF
🐸 Follow @HellsHalfAcreSG

[Adam Wainwright @UncleCharlie50]

Oh… my … goodness. Texas does BBQ right! ⁦@HeimBBQ⁩ in Ft Worth is some of the best I’ve had. Ribs, bacon burnt ends, brisket, green chile Mac n cheese, fries. Wow.

[Joe @JoeSpellmeyer]

@CallawayGolf @jackjennison78 @meditation_frog

[Joe @JoeSpellmeyer]

@CallawayGolf @odysseygolf Mallet

[Joe @JoeSpellmeyer]

@CallawayGolf @meditation_frog @jackjennison78

[Joe @JoeSpellmeyer]

@CallawayGolf @jackjennison78 @meditation_frog

[Joe @JoeSpellmeyer]

@sporticai Didn’t know this was a feature, thank you for the PSA. Does it work for emojis like “a 🧵 👇🏻”?

[Joe @JoeSpellmeyer]

@CallawayGolf @mickeyv68 @meditation_frog

[Joe @JoeSpellmeyer]

@spellmj7 We’ve noticed

[Joe @JoeSpellmeyer]

@TCUBasketball Charlie is the mojo man! I feel a final four run brewing…

[Fran Fraschilla @franfraschilla]

Most coaches say, “We’re going to run more this season” but they don’t. It’s hard to condition players to do it, physically & mentally. But @TCU RUNS! Lead the country with 24 fast break points a game. Watch. ⁦@Big12Conference⁩ ⁦@TRACAB_⁩

[Elizabeth Goitein @LizaGoitein]

RED ALERT: Buried in the House intelligence committee’s Section 702 “reform” bill, which is schedule for a floor vote as soon as tomorrow, is the biggest expansion of surveillance inside the United States since the Patriot Act. 1/11

[Andrej Karpathy @karpathy]

# On the "hallucination problem"

I always struggle a bit with I'm asked about the "hallucination problem" in LLMs. Because, in some sense, hallucination is all LLMs do. They are dream machines.

We direct their dreams with prompts. The prompts start the dream, and based on the LLM's hazy recollection of its training documents, most of the time the result goes someplace useful.

It's only when the dreams go into deemed factually incorrect territory that we label it a "hallucination". It looks like a bug, but it's just the LLM doing what it always does.

At the other end of the extreme consider a search engine. It takes the prompt and just returns one of the most similar "training documents" it has in its database, verbatim. You could say that this search engine has a "creativity problem" - it will never respond with something new. An LLM is 100% dreaming and has the hallucination problem. A search engine is 0% dreaming and has the creativity problem.

All that said, I realize that what people *actually* mean is they don't want an LLM Assistant (a product like ChatGPT etc.) to hallucinate. An LLM Assistant is a lot more complex system than just the LLM itself, even if one is at the heart of it. There are many ways to mitigate hallcuinations in these systems - using Retrieval Augmented Generation (RAG) to more strongly anchor the dreams in real data through in-context learning is maybe the most common one. Disagreements between multiple samples, reflection, verification chains. Decoding uncertainty from activations. Tool use. All an active and very interesting areas of research.

TLDR I know I'm being super pedantic but the LLM has no "hallucination problem". Hallucination is not a bug, it is LLM's greatest feature. The LLM Assistant has a hallucination problem, and we should fix it.

</rant> Okay I feel much better now :)

[Joe @JoeSpellmeyer]

@spellmj7 @meditation_frog lol yeah Cool Papa Bell would like a word

[Joe @JoeSpellmeyer]

@BudElliott3 TCU to win the Big 12 at +1100

[Joe @JoeSpellmeyer]

@MattNorlander The only acceptable orange is THE orange https://t.co/p9GhqilA7f