Awesome work by my colleagues @joinHandshake. You can just ask AI and it will teach you better than a human can! All you need is an internet connection and you have access to the best tutors in the world.
Today we establish that AI is as good as expert human tutors for immediate GRE learning gains (p=.015, n=2,383 students, study conducted July-Sep 2026).
One hour with an expert GRE tutor: $75.
One equivalent hour with an AI tutor: 7 cents .
918x cheaper, equivalent learning (p=.044, n = 140).
In 5 of 7 academic topics, the top AI tutor beat the expert human tutors on average.
How we measured it: pre-test -> 1 hour with (AI or human or no) tutor -> post-test.
There are no LLM judges. Learning gains are post-pre. Everything is real students.
Why we did this:
> 1 trillion USD is being spent per year on machines making machines better. StudentBench shows us how to shift these resources so machines also make humans better.
Why I did this:
I grew up in rural Kentucky. My dad, grandad, and great grandad were all mailmen. Getting into a good college changed my life. Now we have done a rigorous study to help AI labs evaluate LLMs and help show how bright AI can be for students of all incomes.
I believe in good science that leads to the democratization of opportunity.
The research paper behind StudentBench: https://t.co/JfkDDllP4i
Data, code, details: in this thread
If you're wondering what I'm selling, sorry to disappoint: we released all study data for free on Hugging Face, and made https://t.co/5G9L8yAxrt free to use. Enjoy.
lots more in the video / thread!!
@jonstull@Noahpinion Exactly what I was going to post. The fare gates have been a game changer (I have been a daily rider for close to 10y!).
PS: My kids take muni and while those trains are fine, the buses are still a bit of an adventure.