David Holmes

Long-time blogger & digital curator | sound engineer & musician | Internet music aficionado. Specialized lists available.

[David Holmes @DavidHolmes]

DATPIFF Hip-Hop Mixtape Archives
https://t.co/DUzcZIz5bg

Via Joey @gothamhiphop and @internetarchive

[David Holmes @DavidHolmes]

‘New Blue Sun’ by André 3000 is on #SoundCloud https://t.co/9eZAItdrgX

[David Holmes @DavidHolmes]

A cherished item for ambient music fans: 'The Box,' a special collection of early recordings by UK producer Dennis Huddleston, AKA 36 @3sixrecordings. Lovingly remixed and remastered for superior sound quality. https://t.co/xQXA28kOpY

[David Holmes @DavidHolmes]

With the talent of artists and new tools, imaginary worlds and characters are growing more enthralling and vivid.

[Chikai @lifeofc]

A new cinematic AI piece.

Continuing with the @Magnific_AI + @midjourney + @runwayml combination, but in the setting of a museum. It's an introspection on who is watching whom in the art world.👀

"Panopticon - Museum"

[David Holmes @DavidHolmes]

Medieval folklore ambient dungeon synth project from Berlin.
https://t.co/SDjon2heYI

[David Holmes @DavidHolmes]

Today’s computer algorithms can change music but vibrations from the past remain sublimely beautiful even when stretched in time - 400% slower. ‘Music can change the world’ - Ludwig van Beethoven
https://t.co/TM8giQm7uw

[David Holmes @DavidHolmes]

A beautiful long-form ambient mix by todos using tracks from the ASIP 2023 library of music @todosofficial @asip https://t.co/io52g01qWL

[Chris Stokel-Walker @stokel]

Grok, xAI's LLM chatbot, started referring to OpenAI in responses over the weekend. It could be the first warning sign of a significant collapse in our collective knowledge, experts fear. By me for @FastCompany https://t.co/e5Fhrjd44o

[David Holmes @DavidHolmes]

Vera Molnár, an early pioneer of computer generative art, passed away on December 7th at the age of 99. She began using computers creatively in 1968, and her NFT auction at Sotheby’s this year generated $1.2 million. She will be deeply missed.
https://t.co/MXYwcfFNWW

[Andrej Karpathy @karpathy]

# On the "hallucination problem"

I always struggle a bit with I'm asked about the "hallucination problem" in LLMs. Because, in some sense, hallucination is all LLMs do. They are dream machines.

We direct their dreams with prompts. The prompts start the dream, and based on the LLM's hazy recollection of its training documents, most of the time the result goes someplace useful.

It's only when the dreams go into deemed factually incorrect territory that we label it a "hallucination". It looks like a bug, but it's just the LLM doing what it always does.

At the other end of the extreme consider a search engine. It takes the prompt and just returns one of the most similar "training documents" it has in its database, verbatim. You could say that this search engine has a "creativity problem" - it will never respond with something new. An LLM is 100% dreaming and has the hallucination problem. A search engine is 0% dreaming and has the creativity problem.

All that said, I realize that what people *actually* mean is they don't want an LLM Assistant (a product like ChatGPT etc.) to hallucinate. An LLM Assistant is a lot more complex system than just the LLM itself, even if one is at the heart of it. There are many ways to mitigate hallcuinations in these systems - using Retrieval Augmented Generation (RAG) to more strongly anchor the dreams in real data through in-context learning is maybe the most common one. Disagreements between multiple samples, reflection, verification chains. Decoding uncertainty from activations. Tool use. All an active and very interesting areas of research.

TLDR I know I'm being super pedantic but the LLM has no "hallucination problem". Hallucination is not a bug, it is LLM's greatest feature. The LLM Assistant has a hallucination problem, and we should fix it.

</rant> Okay I feel much better now :)

[David Holmes @DavidHolmes]

33 track album &amp; sound portal by various artists. Campaign to raise awareness of missing tax dollars https://t.co/8DJup4uRxV

[David DeGraw @davidVdegraw]

If we have to reinvent punk music to get $8.5 trillion message out, we will! 4 more #FreakPower music vids to come ~ https://t.co/lh0zSGkXlV

[Open Culture @openculture]

Download 448 Free Art Books from The Metropolitan Museum of Art https://t.co/tx90cQWIgK

[David Holmes @DavidHolmes]

A framework to self-host media, track it online, and make time-based alterations to the work in context. https://t.co/C2xXEaF1kD

[David Holmes @DavidHolmes]

Hatchet - A new kind of social music player and fan community. Listen and share music with friends across platforms https://t.co/ZplApTHyp0

[David Holmes @DavidHolmes]

Insightful essay on alternative media theory, Corporate Social Media and informational capitalism. (32 page PDF) https://t.co/8IRjvXqQxy

[David Holmes @DavidHolmes]

Void Dance by 36 (three-six @3sixrecordings) 12 track album of melodic ambient works, CD album bundles available too: http://t.co/UaIqhLvzXS

[David Holmes @DavidHolmes]

Moments by Planet Boelex - Free six track EP with over 35 mins of melodic downtempo electronica http://t.co/5e3GQr725c #ccmusic

[David Holmes @DavidHolmes]

Seasons: Volume One - Free 40 track compilation sampler from various artists via @sunseasky label http://t.co/q7kux1Jkm3

[David Holmes @DavidHolmes]

Mindfulness meditation app with choice of ambient background sounds &amp; guided sessions from 2-20 mins http://t.co/r73Oop1QzF by @tewy