Top Tweets for #Workarena
Surprising results of GPT-5 on #WorkArena
π¨ Is #WorkArena on the verge of being solved? Or did GPT-5 just get trained on it?
π₯While some benchmarks show modest gains, GPT-5 is crushing WorkArena L2π₯
β‘οΈ 69.4% avg success vs. ~40% for next bestπ€―
β‘οΈ Complex tasks, up to 100 steps, 5β20 min for humans
π¨ Is #WorkArena on the verge of being solved? Or did GPT-5 just get trained on it?
π₯While some benchmarks show modest gains, GPT-5 is crushing WorkArena L2π₯
β‘οΈ 69.4% avg success vs. ~40% for next bestπ€―
β‘οΈ Complex tasks, up to 100 steps, 5β20 min for humans
@ysu_nlp Very cool results!
I'm surprised about Claude Computer use. When We tried Claude-3.5 on #WorkArena, it was by far the best model.
https://t.co/bLtS6hqEuR
@AIatMeta π₯ Fresh off the GPU, new UI WebAgent results on #WorkArena-L1 are in! π· Llama 3.3 70B: 34.5% (β6.6% from 3.1) Qwen 2.5 32B: 27.9% Even the small models shine: Qwen 2.5 7B (8.2%) doubles Llama 3.1 8B (4%)! π·βοΈ
Notable findings:
πClaude-3.5-Sonnet is insanely good on #WorkArena L2
πͺ¨ #WorkArena L3 is insanely hard
π€o1-mini is quite good across many benchmarks
π²o1 is very expensive :)
π Internship Opportunity on web agents at ServiceNow Research! π
We aim to boost π the performance in #WorkArena and #WebArena by fine-tuning large open-source LLMs.
(Candidate must be affiliated with a Canadian university)
π Apply Here: https://t.co/pDO8xauniy
Hurray π!
Our #WorkArena / #BrowserGym paper is accepted to ICML.
See you in Vienna βοΈ
https://t.co/40v6dZCYyH
How capable are web agents at solving knowledge work tasks? π€ Are LLMs up to the challenge? π€
Introducing WorkArena: a benchmark where agents meet the world πΈπͺππ₯ web of enterprise software ππ₯οΈ
Paper: https://t.co/9WvM7xOWyC
Website: https://t.co/lfNj3LnzmV
𧡠1/7
π§΅2/4
paper: https://t.co/TjvvuEyMPa
The original aim was to build a strong backend for our new benchmark #WorkArena. Since our backend is flexible we included MiniWoB++ and WebArena.
Part of the gain comes from a better extraction of the accessibility tree.
Very excited about #Llama3 . We are finally able to get some tasks to be solved in #WorkArena using open-source LLMs. Previous attempts always gave 0% except for GPT.
https://t.co/hdO9P4XSMo
π LLAMA3 is the first open-source LLM to ace tasks in Workarena, making it the top OSS virtual knowledge worker! (and believe us we've tested many models and prompting techniques π
) Watch it excel in a challenging knowledge base task. Kudos to @AIatMeta for the amazing model π
& THE WINNER IS @avathyrza! You are the winner of our #NAWICNSWAwards IG Comp. Enjoy the Eames Chairs from #Workarena
Last Seen Hashtags on Sotwe
Maharashtra Housing Scheme
Seen from Singapore
minichat()********************************************* *filter:native_video()
Seen from Canada
sadie mckenna
Seen from United States
snapchat
Seen from Poland
ΰΈΰΈ²ΰΈ’ΰΉΰΈΰΉΰΈΰΈ«ΰΈΰΈ΄ΰΈ
Seen from Thailand
岩ο¨ε€§ζθͺηζ₯η₯2023
Seen from Japan
incesto mother & son
anxiouspanda
Seen from Thailand
Most Popular Users
Elon Musk 
@elonmusk
241.7M followers
Barack Obama
@barackobama
119M followers
Cristiano Ronaldo
@cristiano
114.5M followers
Donald J. Trump
@realdonaldtrump
111.9M followers
Narendra Modi
@narendramodi
107.2M followers
Rihanna
@rihanna
98.7M followers
NASA
@nasa
92.4M followers
Justin Bieber
@justinbieber
91.8M followers
KATY PERRY
@katyperry
90.1M followers
Taylor Swift
@taylorswift13
84M followers
Lady Gaga
@ladygaga
75.5M followers
Virat Kohli
@imvkohli
73.5M followers
Kim Kardashian
@kimkardashian
70.9M followers
YouTube
@youtube
68.8M followers
Neymar Jr
@neymarjr
66.5M followers
Bill Gates
@billgates
65.2M followers
Selena Gomez
@selenagomez
63.1M followers
The Ellen Show
@theellenshow
62.3M followers
CNN
@cnn
61.8M followers
X
@x
60.7M followers