Top Tweets for #LiveCodeBench
#LiveCodeBench Pro is doing something smart that more benchmarks should copy:
pulls problems in real-time from actual competitions (Codeforces, ICPC, IOI)
Olympic medalists explain where/why models break
avoids the whole data pollution mess
turns out there's still a massive gap between SOTA models and top human reasoners 👀
@SentientAGI
Bullish on their mission for open AGI not controlled by big corps... closed Source
Check the full deets:
- Leaderboard & Docs: https://t.co/JDN4ZUb4EC
- Paper: https://t.co/FW8iUPgcAI
- Toolkit/GitHub: https://t.co/5dCyziGmBv
#SentientAGI #LiveCodeBench #NeurIPS #AI #OpenAGI
#SentientAGI #LiveCodeBench #NeurIPS #AI #OpenAGI
The Problem with Current LLM Coding Benchmarks: Most evals are too forgiving
leaked problems,
easy prompts,
no real limits.
LLMs score high but flop in the real world.
AIの中身を問わない社会は、知性ではなく演出に支配される。孫正義・https://t.co/Pz7vJrrBUf・攻殻機動隊を通じて構造を暴きました。 #AI神話解体 #孫正義批評 ##生成AI詐欺 #BuilderAI #攻殻機動隊 #脱知性社��� #LiveCodeBench https://t.co/Ki4HsWtlcN https://t.co/X0vVqf9Zn2
StarCoder2 continues to punch above its weight, with a strong performance relative to much larger open base models on the new #LiveCodeBench leaderboard.
🌟 OSS Coding Models for LCB 🏆
DeepSeek (33B), StarCoder2 (15B), and CodeLLaMa (34B) emerge as the top base models 💫
Finetuning:
👩💻 Boosts both LCB & HumanEval performance
⚠️ May overfit to HumanEval-style problems
➡️ Need to diversify open fine-tuning data for robust gains
Congrats to @Replit on the release!! Super glad to see that the concept of lively updated coding benchmarks proposed in #LiveCodeBench has been adopted in their design criteria🚀
Checkout more details about LiveCodeBench at https://t.co/XLqkXoygn0🫡
Last Seen Hashtags on Sotwe
Trends for you
Most Popular Users
Elon Musk 
@elonmusk
241.5M followers
Barack Obama
@barackobama
118.8M followers
Cristiano Ronaldo
@cristiano
114.5M followers
Donald J. Trump
@realdonaldtrump
111.8M followers
Narendra Modi
@narendramodi
107.1M followers
Rihanna
@rihanna
98.7M followers
NASA
@nasa
92.3M followers
Justin Bieber
@justinbieber
91.8M followers
KATY PERRY
@katyperry
90M followers
Taylor Swift
@taylorswift13
84M followers
Lady Gaga
@ladygaga
75.5M followers
Virat Kohli
@imvkohli
73.5M followers
Kim Kardashian
@kimkardashian
70.9M followers
YouTube
@youtube
68.8M followers
Neymar Jr
@neymarjr
66.5M followers
Bill Gates
@billgates
65.3M followers
Selena Gomez
@selenagomez
63.1M followers
The Ellen Show
@theellenshow
62.2M followers
CNN
@cnn
61.7M followers
X
@x
60.7M followers