btw anthropic's internal document on this literally said "we don't want it to be known that we are working on this.”
it was called project panama.
here's exactly what happened:
1: anthropic concluded that books were the cheapest way to build a world-class model because they gave claude curated facts, structured arguments, compelling stories, and writing “an editor would approve of.”
2: once anthropic decided it needed books at enormous scale, its first solution was piracy.
it downloaded 7m+ books from online libraries including libgen. the judge later wrote that although anthropic had legal ways to buy them, it chose piracy to avoid what dario amodei called the “legal/practice/business slog.”
3: that piracy created a massive legal risk.
so in february 2024, anthropic hired tom turvey, the former head of partnerships for google books, to find a legally safer way of obtaining “all the books in the world.”
4: turvey first contacted major publishers about licensing their catalogs.
those attempts didn’t produce agreements, so anthropic chose a route that required no publisher permission: buying millions of physical books through distributors and used-book retailers.
5: within about a year, anthropic spent tens of millions acquiring and scanning millions of books, including many rare and 1/1 titles. one vendor proposal targeted 500,000 to 2 million books in six months.
6: to scan that many books within months, the vendors physically dismantled them.
a hydraulic cutter removed each spine. the pages were trimmed to size, fed as loose sheets through high-speed industrial scanners, and converted into searchable PDFs. the paper remains were then sent for recycling.
7: these PDFs were fed into claude as training data.
the complete collection became a private, searchable anthropic library that the company planned to “store forever.” the scans aren’t available to the public and were never open-sourced.
@lachainelequipe bonjour, allez vous diffuser les matchs de #volley de l'équipe de France lors de la #VNL 2026 ? notamment prochain match contre le Brésil le 15/07 ?
@forbes_fr#AromaZone « L'entreprise la plus toxique » : derrière son image éthique, comment la pépite française Aroma-Zone essore ses salariés en boutique. https://t.co/BN5JOjlonu
The deadliest mass shooting our country has witnessed in two years was not an assault at a church or a school but an incident of domestic violence, according to police. Shamar Elkins, a resident of Shreveport, Louisiana, killed eight children, seven of whom were his, on Sunday morning. The only child who survived climbed to the roof and jumped. Elkins also shot two women, one of whom is his wife, Shaneiqua Pugh. She reportedly planned to leave him.
“Many women are not so lucky. I cannot look at my feed lately without seeing stories of Black women’s lives ending tragically,” writes Brittney Cooper, who grew up in Shreveport. Across these deaths, much of the public discourse has centered on the mental-health challenges of the alleged male perpetrators. Shamar Elkins had indicated struggling with suicidal ideation and “demons” to his mother and stepfather. “It is tempting to treat Elkins’s actions as the isolated incident of a madman,” Cooper continues. “But poor mental health is never a reasonable explanation for attempting to execute one’s wife and children. Patriarchy offers a better explanation for this violence.”
Cooper writes about how these killings are the natural outcome of a country enamored with patriarchy: https://t.co/6tWndJ66q2
Rep. James Talarico : Do you think Romeo and Juliet could be banned?
Rep. Brad Buckley : *nervously shuffling papers* "ummm... uh.... I'm not advised on Romeo and Juliet"
America is in a lot of trouble.
Making readers weep uncontrollably since 2015. 😭 Hanya Yanagihara’s A LITTLE LIFE made our list of the 🌟 Best Fiction of the Century (So Far) 🌟 https://t.co/9UsBNjNTgJ @doubledaybooks@IReadVintage
Born #OnThisDay in 1940, Wangari Maathai was a Kenyan social, environmental, and political activist who founded the Green Belt Movement, and who started a movement to plant millions of trees across sub-Saharan Africa.
Discover her story in 'Wildly different' by @SarahJLonsdale.
« Il n'est pas nécessaire d'avoir une religion pour avoir une morale, car si vous ne pouvez pas distinguer le bien du mal, ce qui vous manque c'est la sensibilité, pas la religion. »
Margherita Hack
Des années 60 à 80 à La Réunion, le député Michel Debré décide de mettre en place une politique de limitation des naissances. Un nombre inchiffrable de femmes ont été victimes d'avortements et de stérilisations sans avoir donné leur consentement https://t.co/TlTPp2LwBD
James Galbraith talks about the power of entropy in shaping a new economic reality and how his new book, ENTROPY ECONOMICS, challenges flawed mainstream models that lead to bad policy. Read now from @INETeconomics. https://t.co/T9DsFAYWnc
J’aime tellement cette photo. Joyeux anniversaire de 1️⃣0️⃣0️⃣ ans à Ginette Kolinka, notre héroïne de l’Histoire et de la BD. Inlassable, elle témoignait encore devant les élèves dans notre mairie il y a quelques jours. Qu’elle vive jusqu’à 120 ans !
#ABollywoodStateofMind was published towards the end of October 2023 and I did not have the energy or enthusiasm to celebrate or promote it. So I am SUPER grateful to everyone who read it, loved it, talked about it, promoted it. THANK YOU!