Meta illegaly downloaded 80+ terabytes of books from LibGen, Anna's Archive, and Z-library to train their AI models.
Aaron Swartz downloaded 70 GBs of articles from JSTOR (0.0875% of Meta) in 2010. Faced $1 million in fine and 35 years in jail. Took his own life in 2013.
Iโve avoided End of Evangelion for somewhere close to 18 years since I first watched the series. I was afraid it would be a retcon of the original ending. Provide crowd-pleasing closure. Why didnโt anyone tell me it was the opposite? What a beautiful, truly hostile work of art.
@varunneal@kalomaze would always say Claude newsonnet 3.5 (I believe) was trained multiple times over the same corpus and he used an example of Claude recalling a super specific niche detail without web search implying some sort of multi epoch training donโt remember the full argument tho