Anthropic is buying millions of rare books, scanning and destroying them because legally destruction is the safest option. This was a plot element in the Vernor Vinge novel, "The Rainbow's End", which I read 20 years ago.
We finally know why LLMs hallucinate. It's not the model. It's the geometry.
@OpenAI text-embedding-3-large: 91/3072 dimensions do real work.
@GeminiApp gemini-embedding-001: 80/3072 dimensions do real work.
~97% of your vector database is mathematically empty. Your RAG system is retrieving from noise.
@ashwingop and I present "The Geometry of Consolidation" - a proof that RAG compression has a hard floor no algorithm can beat, set by a single spectral number your embedding model cannot escape.
Every hallucination your RAG pipeline produces? This is why.
Paper + results: https://t.co/zut8pdoPbH
one of your side quests should be to build out your own personal library based on your interests and goals
save multiple copies of docs, pdfs, and rare books before they get buried or disappear lost to algo slopification and those who would rather control what you have access to
A friend of mine who works in rare books mentioned today everyone he knows is getting weird, big orders from the same buyer this week for "long tail books"—decades-old textbooks, private press niche history, unremarkable but rare titles just collecting dust.
Obviously AI, right?
@PEWilliams_@Robotbeat It may be an attempt to build a training set that is free of copyright issues. Books from before 1978 generally have shorter copyright terms than later works. Many from the early 1900’s are now free of copyright restrictions.
https://t.co/kktYUVn5Rn
When I watched Buffett’s interview, I couldn’t believe he had lived through multiple times when people called him an idiot for missing “revolutionary changes and lifetime opportunities.” Today, even though the situation is much more chaotic than before, I’ve seen self claimed genius Gen-Z mocking Buffett on X multiple times a day. Stupid people don’t change.
After watching Community so many times, I realised something so simple that I’m probably the last person who watched the show to get it:
If a character gets too self-aware about the show itself — as in, too smart and constantly breaking the fourth wall — it makes the audience suffer. Because it’s too real, too much like life, it loses its fun.