Jakub Macina

AI/ML Scientist, mountain biker

[Jakub Macina @dmacjam]

Happy to present my research later today at the National Institute of Informatics in Tokyo! #llm #research #education #reasoning

https://t.co/ZZI0nW7wLS

[Jakub Macina @dmacjam]

📄 Paper: https://t.co/KgiEGp47oY
💻 Code: https://t.co/vZSj41AsVv
Model: https://t.co/hi3MelOINY

@DavidDinucu @ndaheim_ @idohakimi @IGurevych @mrinmayasachan

Learn now with our open-source tutor directly on your laptop: ollama run https://t.co/lXJnkxLbMa

[Jakub Macina @dmacjam]

🔍Thinking assistants instead of homework solvers. Most LLMs are helpful at the turn-level but lack planning for long-term student learning. How can we make LLMs more collaborative and better at tutoring?
#EMNLP2025

[Jakub Macina @dmacjam]

Altogether, this allows us to train smaller LLMs for tutoring that match or surpass the performance of larger specialized tutoring models while navigating a trade-off between leaking and student solve rate.

[Jakub Macina @dmacjam]

Try out Apertus, a truly open-source model from ETH Zurich and EPFL.

[EPFL @EPFL_en]

🚀 Together with ETH Zürich and the CSCS, we have just released Apertus, 🇨🇭 Switzerland’s first large-scale, open, multilingual language model — a milestone in generative AI for transparency and diversity.

Find out more: https://t.co/mDsDg3Dj5e

[Jakub Macina @dmacjam]

Slide deck is online: https://t.co/ozf6OGhRTp

[Jakub Macina @dmacjam]

Join us tomorrow morning #ACL2025NLP #ACL2025

[Mrinmaya Sachan @mrinmayasachan]

If you're at ACL, join us for the tutorial "LLMs for Education: Understanding the Needs of Stakeholders, Current Capabilities and the Path Forward" at the BEA workshop (Room 1.85–86) 9:00-12:30am tomorrow (July 31st) @aclmeeting

[Jakub Macina @dmacjam]

Paper: https://t.co/KgiEGp4Few

[Jakub Macina @dmacjam]

AI alignment for tutoring🎓 We use full online RL with conversation-level rewards—not just single-turn signals like DPO. Did the student actually learn by the end?
Using GRPO, the model learns real teaching strategies like when to hint or when to correct.
Explore models below⤵️

[Rohan Paul @rohanpaul_ai]

This paper introduces an online reinforcement learning framework using simulated student-tutor interactions.

It trains LLMs to prioritize guiding students pedagogically instead of simply revealing solutions, aligning models with better teaching methods.

This helps students learn how to solve problems independently.

Methods 🔧:

→ The online reinforcement learning method trains the tutor model directly on conversations simulated with a separate student LLM.

→ A custom reward function scores full conversations based on two objectives: increasing the student's success rate after the dialog and ensuring the tutor follows good pedagogical principles.

→ This reward system penalizes the tutor for leaking solutions, promoting guided problem-solving.

→ The framework uses LLM judges to evaluate pedagogical quality.

→ Controllable reward weighting balances these objectives, enabling navigation of the trade-off between student solving gains and pedagogical support.

→ Thinking tags are included to enhance the tutor model's interpretability and instructional planning.

📌 Online Reinforcement Learning using model rollouts directly trains on interactive teaching, avoiding static data limitations.

📌 Reward function lambda explicitly controls the crucial pedagogy versus student success trade-off.

📌 Preservation of reasoning benchmarks demonstrates RL's superior transferability compared to Supervised Fine-Tuning baselines.

----------------------------

Paper - arxiv. org/abs/2505.15607

Paper Title: "From Problem-Solving to Teaching Problem-Solving: Aligning LLMs with Pedagogy using Reinforcement Learning"

[Jakub Macina @dmacjam]

TutorRL-7B-think: https://t.co/hi3MelPgDw
TutorRL-7B: https://t.co/FSoV8DmXIj
Github: https://t.co/vZSj41B0L3

[Jakub Macina @dmacjam]

🔥 Try it now!
Run MathTutorBench locally with your own models or submit them to our leaderboard. Open-source! 👉https://t.co/Qrk6uxi9Qx
@ndaheim_ @idohakimi @ Manu Kapur @IGurevych @mrinmayasachan @ETH_AI_Center

[Jakub Macina @dmacjam]

🚀 𝐇𝐨𝐰 𝐰𝐞𝐥𝐥 𝐜𝐚𝐧 𝐋𝐋𝐌𝐬 𝐭𝐞𝐚𝐜𝐡?
Evaluating LLMs for education is key to making real progress, yet we lack a reliable and simple benchmark. Introducing 𝐌𝐚𝐭𝐡𝐓𝐮𝐭𝐨𝐫𝐁𝐞𝐧𝐜𝐡—an open-source benchmark designed to assess holistic tutoring capabilities in AI.

[Jakub Macina @dmacjam]

🤔 𝐌𝐨𝐫𝐞 𝐤𝐧𝐨𝐰𝐥𝐞𝐝𝐠𝐞 ≠ 𝐛𝐞𝐭𝐭𝐞𝐫 𝐭𝐞𝐚𝐜𝐡𝐢𝐧𝐠?
Subject expertise does not always correlate with effective teaching; instead, pedagogy and subject knowledge may present a trade-off.

[Jakub Macina @dmacjam]

🎯 How do we measure teaching quality?
We train a reward model that scores open-ended teacher responses and accurately distinguishes expert-level from novice teaching.