Top Tweets for #LongRoPE
सुनिए इन महाशय को … जिनके खिलाफ पहले से FIR हो, वैसे लोग भी अगर इनके आंदोलन में शामिल होकर कुछ गलत किए तो उन पर कोई कार्रवाई ना हो । अपराधियों का सहयोग लेकर हंगामा कराओ और फिर बचाओ .. और प्रवचन दो कि देश संविधान से चलना चा���िए । संविधान मतलब… इनकी और इन जैसों की मर्जी!
Microsoft Research presents #LongRoPE
Extending LLM Context Window Beyond 2 Million
Tokens Large context window is a desirable feature in large language models (#LLMs). However, due to high fine-tuning costs, scarcity of long texts, and catastrophic values introduced by new token positions, current extended context windows are limited to around 128k tokens. This paper introduces LongRoPE that, for the first time, extends the context window of pre-trained LLMs to an impressive 2048k tokens, with up to only 1k fine-tuning steps at within 256k training lengths, while maintaining performance at the original short context window. is achieved by three key innovations:
(i) we identify and exploit two forms of non-uniformities in positional interpolation through an efficient search, providing a better initialization for fine-tuning and enabling an 8× extension in non-fine-tuning scenarios;
(ii) we introduce a progressive extension strategy that first fine-tunes a 256k length LLM and then conducts a second positional interpolation on the fine-tuned extended LLM to achieve a 2048k context window;
(iii) we readjust LongRoPE on 8k length to recover the short context window performance. Extensive experiments on LLaMA2 and Mistral across various tasks demonstrate the effectiveness of our method. Models extended via LongRoPE retain the original architecture with minor modifications to the positional embedding, and can reuse most pre-existing optimizations.
🚀 介绍LongRoPE：在LLMs中的一次突破性进步，将上下文窗口扩展到200万+标记，同时只需最小的微调！这项来自微软研究院的创新不仅在各种任务中保持了性能，而且还利用了非均匀位置插值来提高效率。🌐 更多细节即将在GitHub上公布！#AI #机器学习 #LongRoPE
论文：https://t.co/RW5aWaZFK6
（这篇推文也是用gpt4写的哈哈 对标��歌Gemma那篇：https://t.co/VW13XKca2l）
🚀 Google新动态：推出Gemma，一种新一代开放AI模型！基于Gemini技术，为开发者提供轻量级、最先进的模型。包括Gemma 2B和7B两个版本，旨在负责任地发展AI。功能包含负责任的生成AI工具包，支持主要框架，优化各种硬件。Gemma支持商业使用，目标推动AI创新界限。详细信息，请查看👉https://t.co/6HORPcJMyg （这个推特是用GPT4总结发的 就问这个操作骚不骚哈哈哈）
@abhishekshubhra Team NDTV including but not limited to @VishnuNDTV is paid to spread malicious lies & the #LongRope has emboldened them. Their issue is not that they don’t understand- but - the fact that how can #ModiJi be ensuring corrections.
#IrrelevantSeekingRelevance
@BharatChopra8 @Anamikaa6969 When the #LongRope given by @HMOIndia is perceived as sign of weakness.
#Punjab is a crucial state when it comes to #NationalSecurity and hate 🇮🇳 brigade including Congress knows it all too well. They will create many more incidents like these provoking @HMOIndia to act
10: @HMOIndia | @AmitShah ji
- Why was #VohraCommittee formed?
- Why have the findings NOT implemented?
- if you cannot implement findings - then why waste TaxPayers money in forming them?
- #LongRope or #QuidProQuo?
https://t.co/gELDs7eaEn
5/n
6: @narendramodi ensured that his daughter remains poor & is NOT able to grow Crores of out of flower pot.
7:In short - @PawarSpeaks is just another #IrrelevantSeekingRelevance
8: It’s just that #LongRope is keeping him away from #Tihar - can’t say about 👇🏼
@praful_patel
n/n
"Even the longest rope has an end"
#longrope #victimcard #luxury
#position #misuse
#quotes
#reservetherighttorespond
@MeghUpdates @Rajeev_GoI @AshwiniVaishnaw @GoI_MeitY @NICMeity @MeitY_NICSI @MeityPib @ianuragthakur FastJourney from @premiumbusiness 2NOT @premiumbusiness 2again @premiumbusiness
Hey @jack | @manishm | @vijaya & Team @Twitter testing new update at Ur (Tech) & @PMOIndia’s (People) end?
#AcchaHai keep stretching #LongRope +B sure, U quitting willB 4non compliance with #LawOfLand
KeepTesting!
When Gangsters turn Politicians this is what happens.
Also - when the Gangster knows that the Politician in him willB given a #LongRope as part of #QuidProQuo unwritten but deeply understood protocol - then there is NO WORRY.
If caught - cry #PoliticalVendetta
I wonder what does gangsters do in this city?? Their job is highjacked by politicians n police after all.
@duryodan_ @FltLtAnoopVerma @ECISVEEP @HMOIndia @BJP4Bengal @derekobrienmp @jdhankhar1 @rashtrapatibhvn @KailashOnline @narendramodi @PMOIndia @AmitShah @cpimlliberation @cpimspeak @CPIM_WESTBENGAL @kapil_kausik @PraveenaP96 @BanCheneProduct @iRiteshChoubey @Rajat_Hind @HinduEcosystem_ @JPNadda @NCWIndia @MrsGandhi @sharmarekha @RSSorg @NIA_India @sudhirchaudhary @dna @thekiranbedi @rsprasad @VMBJP @WBPolice @India_NHRC @gauravbh @jsaideepak @indiccollective @KapilMishra_IND @hindulegalcell @SuPriyoBabul @me_locket @swapan55 @NisithPramanik @AmitShahOffice @DilipGhoshBJP @MukulR_Official @Telegraph #NoWords for this life long scar - just because Jihadan #MamtaBanerjee has a ‘mandate’.
Did @MukulR_Official shave his ‘whatever remains’ from ‘wherever’ applicable?
The silence by Centre is deafening and so is the #LongRope.
Trust @rashtrapatibhvn should recall @jdhankhar1.
@MeghUpdates Who is @Twitter 2propose how will investigation happen?
So for @TwitterIndia
1: #LawOfLand - NON COMPLIANCE
2:Justice - MyLiking
3: #Technology SpreadPropaganda
This is what happens when U give #LongRope.
Twitter -Do note it’s @Uppolice & not Minister who masters #QuidProQuo
@duryodan_ @FltLtAnoopVerma @ECISVEEP @HMOIndia @BJP4Bengal @derekobrienmp @jdhankhar1 @rashtrapatibhvn @KailashOnline @narendramodi @PMOIndia @AmitShah @cpimlliberation @cpimspeak @CPIM_WESTBENGAL @kapil_kausik @PraveenaP96 @BanCheneProduct @iRiteshChoubey @Rajat_Hind @HinduEcosystem_ @JPNadda @NCWIndia @MrsGandhi @sharmarekha @RSSorg @NIA_India @sudhirchaudhary @dna @thekiranbedi @rsprasad @VMBJP @WBPolice @India_NHRC @gauravbh @jsaideepak @indiccollective @KapilMishra_IND @hindulegalcell @SuPriyoBabul @me_locket @swapan55 @NisithPramanik @AmitShahOffice @DilipGhoshBJP @MukulR_Official @MoHFW_INDIA @BJP4India @VHPDigital @BajrangdalOrg #ModiJi There mayB compulsions - NOT discounting those - but why is NO ACTION EVEN THOUGHT OF, FORGET TAKEN-WHEN IT COMES TO AREA WHERE OVERAPPEASED CONTROL ADMINISTRATION?
Is #Hindu a 2nd rated Citizen in Hindustan?
The #LongRope always does NOT help.
#SabkaVishwas | #7Years
#MukulRoy hi nahi bjp ke 95% TMC join karenge agle 5 saal me
Caz sabko apni jaan ghar gharwale ki fikar hai
Jo haal Bengal ka hai @narendramodi ji ya @AmitShah ji ne uspar ek tweet bhi nhi kiya action lena to dur ki baat
And i m not surprised with his decision
@kakar_harsha @srdmk01 @rsprasad BRIEF below confirms that @GoI_MeitY LEADERSHIP needs 2 INTROSPECTION a lot.
#LongRope may work 4some-BUT- definitely does NOT in places where YOU set FRAMEWORK.
I welcome this waking UP of IT MIN & hope2C ACTION to control #RhetoricAmplification
All I can say- #2LITTLE2LATE
@ShefVaidya @TwitterIndia @Twitter @narendramodi @rsprasad @AmitShah @blsanthosh @rsprasad - Both #LongRope & #QuidProQuo are good 4 individual benefits - but when U put #NationFirst -one needs 2 take a firm call.
I hope that @jack’s philanthropic outreach vide @RSSorg affilIate #SewaInternational will NOT be a limitation in action against @Twitter in 🇮🇳
I don’t want to brag too loud, but all of my classes had attendance numbers divisible by three today. #longrope
#LongRope
So that they tie themselves up.
Why did vandals destroy Jio towers?
Why ransack venue showing PM’s speech to farmers?
Were they worried that real farmers may change their views on knowing the truth?
Are Modi-Shah giving “protestors” a long rope to expose themselves?
#ModiWithFarmers
https://t.co/gEiZ60nFYW
Last Seen Hashtags on Sotwe
minichat()
salesuccess
Seen from United States
mgai()********************
Seen from Turkey
نارو_العراقية
Seen from United Kingdom
pytt
Seen from United Kingdom
antalyatravesti
Seen from Turkey
เย็ดนักเรียน
Seen from Thailand
女装掲示板
Seen from Japan
novinha ometv
Seen from Brazil
pintoawards #novinhos
Seen from Brazil
Most Popular Users
Elon Musk 
@elonmusk
240.8M followers
Barack Obama
@barackobama
118.8M followers
Cristiano Ronaldo
@cristiano
114.5M followers
Donald J. Trump
@realdonaldtrump
111.9M followers
Narendra Modi
@narendramodi
107M followers
Rihanna
@rihanna
98.7M followers
NASA
@nasa
92.2M followers
Justin Bieber
@justinbieber
91.8M followers
KATY PERRY
@katyperry
90M followers
Taylor Swift
@taylorswift13
84M followers
Lady Gaga
@ladygaga
75.5M followers
Virat Kohli
@imvkohli
73.4M followers
Kim Kardashian
@kimkardashian
70.8M followers
YouTube
@youtube
68.7M followers
Neymar Jr
@neymarjr
66.4M followers
Bill Gates
@billgates
65.2M followers
Selena Gomez
@selenagomez
63.1M followers
The Ellen Show
@theellenshow
62.2M followers
CNN
@cnn
61.7M followers
X
@x
60.6M followers