Attention has been the key component for most advances in LLMs, but it can’t scale to long context. Does this mean we need to find an alternative?
Presenting Titans: a new architecture with attention and a meta in-context memory that learns how to memorize at test time. Titans are more effective than Transformers and modern linear RNNs, and can effectively scale to larger than 2M context window, with better performance than ultra-large models (e.g., GPT4, Llama3-80B).
China trained a model called DeepSeek-v3 that’s better than OpenAI GPT 4o with a small fraction of the budget and open sourced it. Meanwhile, a bipartisan bill is in the works in America to impose severe restrictions on open sourcing frontier models.
@PJerpiti69856@MOHITSI42163577 @angryoldman27 @Gabbar0099 Jaake news dekh he already left india. Kitte uneducated hote ho tum log. Thats why real education is important
@PJerpiti69856@kamaalrkhan Tum logoke hatred se pata chalta hai ki tum one sided ho with no objective thinking. Vote pattern isone sided. The real reason is hatred towards kafir. Yahan pe andhbhakt bolte ho but just see your pattern, its so unidirectional. Failed state like our neighb pak is outcome
Revenue for 6 years of entrepreneurship and 28 products:
- Most never made money
- 1 pays higher than a programmer's hourly rate
- 72% of the revenue was generated in the last 6 months
First Congress trolls were attacking the film and humiliating the scientists. Now their officials are coming out to troll #TheVaccineWar the film about India’s scientific achievement. Soon, the master of mohabbat will also come.
US Congressman from Georgia Dr Rich Mccormick @RichforGA praises #TheVaccineWar in the reception hosted for S. Jaishankar.
“Through ‘The Vaccine War’ I have seen what women scientists in India have done…”
#TheVaccineWar - the story of India’s great achievement is reaching policymakers.