Steve Brown

Focused on Artificial Intelligence.

[Steve Brown @brown2020]

@AceofSpadesHots Does Elon know about this?

[Steve Brown @brown2020]

https://t.co/zI8lhTfwwW

[Sam Altman @sama]

what i wish someone had told me:

https://t.co/1nEaYimzXG

[Andrej Karpathy @karpathy]

# On the "hallucination problem"

I always struggle a bit with I'm asked about the "hallucination problem" in LLMs. Because, in some sense, hallucination is all LLMs do. They are dream machines.

We direct their dreams with prompts. The prompts start the dream, and based on the LLM's hazy recollection of its training documents, most of the time the result goes someplace useful.

It's only when the dreams go into deemed factually incorrect territory that we label it a "hallucination". It looks like a bug, but it's just the LLM doing what it always does.

At the other end of the extreme consider a search engine. It takes the prompt and just returns one of the most similar "training documents" it has in its database, verbatim. You could say that this search engine has a "creativity problem" - it will never respond with something new. An LLM is 100% dreaming and has the hallucination problem. A search engine is 0% dreaming and has the creativity problem.

All that said, I realize that what people *actually* mean is they don't want an LLM Assistant (a product like ChatGPT etc.) to hallucinate. An LLM Assistant is a lot more complex system than just the LLM itself, even if one is at the heart of it. There are many ways to mitigate hallcuinations in these systems - using Retrieval Augmented Generation (RAG) to more strongly anchor the dreams in real data through in-context learning is maybe the most common one. Disagreements between multiple samples, reflection, verification chains. Decoding uncertainty from activations. Tool use. All an active and very interesting areas of research.

TLDR I know I'm being super pedantic but the LLM has no "hallucination problem". Hallucination is not a bug, it is LLM's greatest feature. The LLM Assistant has a hallucination problem, and we should fix it.

</rant> Okay I feel much better now :)

[Steve Brown @brown2020]

LLM Visualization of Nano-GPT with 85,684 parameters. GPT-4 is 2 million times that. AI is the most complex thing ever created by humans. From https://t.co/lZGOQ80nkP

[Peter H. Diamandis, MD @PeterDiamandis]

If you want a positive mindset, hang out with positive-minded individuals. When you surround yourself with highly driven people, you’ll tend to push harder to achieve your goals.

[Steve Brown @brown2020]

@maria_avdv This is the story that we should be paying a lot more attention to.

[Steve Brown @brown2020]

@IAPonomarenko Shameful. And thank you @IAPonomarenko for being strong and speaking the truth.

[Steve Brown @brown2020]

Wow!!!

[Illia Ponomarenko 🇺🇦 @IAPonomarenko]

This is one of the greatest videos the internet has ever seen.

[Sneakertopia @gosneakertopia]

We #StandWithUkraine 🇺🇦

[Steve Brown @brown2020]

@elonmusk Definitely a big step forward in reducing the friction and increasing the opportunity for the drunk tweeting market...

[Steve Brown @brown2020]

New definition of "interesting": "not followed by anyone you're following". And what a great mission statement: "platform designed to bring power back to creators".

[Steve Brown @brown2020]

The 21st century definition of creativity is the part that AI cannot predict. #AI #creativity

[Steve Brown @brown2020]

To DAO or not to DAO, that is the question... #DAO

[Steve Brown @brown2020]

@IAPonomarenko @IAPonomarenko is my other most trusted and respected source in Ukraine. If only more people had your courage and your clarity. Please let us know how we can help you.

[Steve Brown @brown2020]

@anders_aslund @anders_aslund one of my most trusted sources on this issue.

[Steve Brown @brown2020]

@AskFrontier @AskFrontier This is day 6 with no internet, no information about when it will be restored, and no meaningful communication with @FrontierCorp to know that they are going to fix it.

[Steve Brown @brown2020]

@AskFrontier Still no Internet / phone service from Frontier since LA rainstorm. It's been out all week. No clarity from Frontier on when it will be fixed.

[Steve Brown @brown2020]

@AskFrontier That was days ago, I replied with contact info as requested, but no one actually called.