OpenLLMLeaders

Track 🤗 Open LLM Leaderboard. Created by @Weyaxi and

[OpenLLMLeaders @OpenLLMLeaders]

New model added to the leaderboard!

Model Name
https://t.co/0CSt8spi7C

Overall rank: 16
Rank in 70+B category: 10

Benchmarks
Average: 46.79
IFEval: 84.86
BBH: 61.84
MATH Lvl 5: 43.81
GPQA: 19.24
MUSR: 17.66
MMLU-PRO: 53.36

[OpenLLMLeaders @OpenLLMLeaders]

New model added to the leaderboard!

Model Name
https://t.co/CnCDjfK7VY

Overall rank: 120
Rank in 13B category: 44

Benchmarks
Average: 41.89
IFEval: 73.94
BBH: 51.26
MATH Lvl 5: 46.83
GPQA: 16.44
MUSR: 15.06
MMLU-PRO: 47.8

[OpenLLMLeaders @OpenLLMLeaders]

New model added to the leaderboard!

Model Name
https://t.co/EU6bjiPFSh

Overall rank: 52
Rank in 35B category: 17

Benchmarks
Average: 43.92
IFEval: 73.78
BBH: 57.68
MATH Lvl 5: 42.22
GPQA: 15.66
MUSR: 19.21
MMLU-PRO: 54.95

[OpenLLMLeaders @OpenLLMLeaders]

New model added to the leaderboard!

Model Name
https://t.co/1H524pg37b

Overall rank: 4261
Rank in 1.5B category: 545

Benchmarks
Average: 5.04
IFEval: 20.07
BBH: 4.16
MATH Lvl 5: 1.66
GPQA: 1.23
MUSR: 1.11
MMLU-PRO: 2.02

[OpenLLMLeaders @OpenLLMLeaders]

New model added to the leaderboard!

Model Name
https://t.co/qTWlVSHsiQ

Overall rank: 3631
Rank in 1.5B category: 180

Benchmarks
Average: 11.14
IFEval: 54.28
BBH: 4.66
MATH Lvl 5: 2.79
GPQA: 0.0
MUSR: 0.94
MMLU-PRO: 4.17

[OpenLLMLeaders @OpenLLMLeaders]

New model added to the leaderboard!

Model Name
https://t.co/OOiycFxylj

Overall rank: 3172
Rank in 3B category: 229

Benchmarks
Average: 15.97
IFEval: 37.38
BBH: 19.67
MATH Lvl 5: 8.23
GPQA: 3.58
MUSR: 8.59
MMLU-PRO: 18.34

[OpenLLMLeaders @OpenLLMLeaders]

New model added to the leaderboard!

Model Name
https://t.co/bI5CEQpyzQ

Overall rank: 2900
Rank in 1.5B category: 17

Benchmarks
Average: 18.16
IFEval: 41.96
BBH: 19.81
MATH Lvl 5: 21.75
GPQA: 2.35
MUSR: 3.39
MMLU-PRO: 19.73

[OpenLLMLeaders @OpenLLMLeaders]

New model added to the leaderboard!

Model Name
https://t.co/UbmXEx32ju

Overall rank: 2480
Rank in 7B category: 1179

Benchmarks
Average: 20.96
IFEval: 29.55
BBH: 24.8
MATH Lvl 5: 35.5
GPQA: 8.84
MUSR: 7.74
MMLU-PRO: 19.32

[OpenLLMLeaders @OpenLLMLeaders]

New model added to the leaderboard!

Model Name
https://t.co/OjdcJriEeI

Overall rank: 2402
Rank in 7B category: 1130

Benchmarks
Average: 21.35
IFEval: 47.95
BBH: 28.62
MATH Lvl 5: 12.39
GPQA: 3.91
MUSR: 11.65
MMLU-PRO: 23.56

[OpenLLMLeaders @OpenLLMLeaders]

New model added to the leaderboard!

Model Name
https://t.co/G5nfBQRtBY

Overall rank: 2263
Rank in 3B category: 129

Benchmarks
Average: 21.97
IFEval: 39.59
BBH: 25.78
MATH Lvl 5: 20.24
GPQA: 7.49
MUSR: 11.35
MMLU-PRO: 27.35

[OpenLLMLeaders @OpenLLMLeaders]

New model added to the leaderboard!

Model Name
https://t.co/eK6z0DjQtH

Overall rank: 2238
Rank in 7B category: 1013

Benchmarks
Average: 22.12
IFEval: 62.0
BBH: 26.69
MATH Lvl 5: 6.95
GPQA: 4.14
MUSR: 10.72
MMLU-PRO: 22.21

[OpenLLMLeaders @OpenLLMLeaders]

New model added to the leaderboard!

Model Name
https://t.co/NZVwjweCvv

Overall rank: 2100
Rank in 7B category: 936

Benchmarks
Average: 22.83
IFEval: 49.73
BBH: 31.07
MATH Lvl 5: 12.16
GPQA: 4.92
MUSR: 9.87
MMLU-PRO: 29.23

[OpenLLMLeaders @OpenLLMLeaders]

New model added to the leaderboard!

Model Name
https://t.co/upTCKyvdmA

Overall rank: 1576
Rank in 3B category: 53

Benchmarks
Average: 25.28
IFEval: 68.34
BBH: 24.37
MATH Lvl 5: 24.02
GPQA: 3.69
MUSR: 7.85
MMLU-PRO: 23.4

[OpenLLMLeaders @OpenLLMLeaders]

New model added to the leaderboard!

Model Name
https://t.co/6lRpD6ODja

Overall rank: 1570
Rank in 7B category: 573

Benchmarks
Average: 25.31
IFEval: 60.4
BBH: 29.31
MATH Lvl 5: 7.25
GPQA: 3.02
MUSR: 29.37
MMLU-PRO: 22.49

[OpenLLMLeaders @OpenLLMLeaders]

New model added to the leaderboard!

Model Name
https://t.co/P5xYiGhT9I

Overall rank: 1392
Rank in 7B category: 469

Benchmarks
Average: 26.79
IFEval: 63.01
BBH: 31.39
MATH Lvl 5: 27.95
GPQA: 3.69
MUSR: 6.9
MMLU-PRO: 27.82

[OpenLLMLeaders @OpenLLMLeaders]

New model added to the leaderboard!

Model Name
https://t.co/4EnizS3G1X

Overall rank: 1227
Rank in 7B category: 390

Benchmarks
Average: 28.41
IFEval: 73.39
BBH: 32.07
MATH Lvl 5: 17.45
GPQA: 5.7
MUSR: 11.32
MMLU-PRO: 30.5

[OpenLLMLeaders @OpenLLMLeaders]

New model added to the leaderboard!

Model Name
https://t.co/PJoe9mZSlp

Overall rank: 1127
Rank in 7B category: 325

Benchmarks
Average: 29.23
IFEval: 74.02
BBH: 34.82
MATH Lvl 5: 23.34
GPQA: 6.6
MUSR: 7.49
MMLU-PRO: 29.12

[OpenLLMLeaders @OpenLLMLeaders]

New model added to the leaderboard!

Model Name
https://t.co/56d0qUNJ9o

Overall rank: 939
Rank in 7B category: 191

Benchmarks
Average: 30.44
IFEval: 69.34
BBH: 31.44
MATH Lvl 5: 44.56
GPQA: 1.23
MUSR: 1.21
MMLU-PRO: 34.87

[OpenLLMLeaders @OpenLLMLeaders]

New model added to the leaderboard!

Model Name
https://t.co/yAmyPWylmT

Overall rank: 292
Rank in 13B category: 193

Benchmarks
Average: 39.47
IFEval: 58.32
BBH: 50.99
MATH Lvl 5: 40.18
GPQA: 19.13
MUSR: 19.36
MMLU-PRO: 48.84

[OpenLLMLeaders @OpenLLMLeaders]

New model added to the leaderboard!

Model Name
https://t.co/q4H1zKQGYd

Overall rank: 13
Rank in ?B category: 1

Benchmarks
Average: 47.09
IFEval: 73.24
BBH: 65.47
MATH Lvl 5: 28.63
GPQA: 22.26
MUSR: 38.69
MMLU-PRO: 54.27