i14 Journal Club: Foundation Models Where Math Meets Cognitive Science
Next week we will discuss “SlimQwen: Exploring the Pruning and Distillation in Large MoE Model Pre-training” - @shengkun_t52337, @liangyuwang10, @szq0214 et al. (2026)
i14 hosts a weekly online discussion group for researchers exploring the intersection of generative AI, mathematics, and cognitive science. We analyze how architectural design impacts learning, memory, and reasoning in foundation models.
Join us to dissect training dynamics and explore how cognitive principles can inform the next generation of architectures. Our next session will be hosted via Google Meet on: Monday, May 25 · 12 PM AEST (Melbourne) which is Monday, May 25 · 10 AM CST (Beijing) which is Sunday, May 24 · 7 PM PDT (San Francisco)
Apply to join HERE: https://t.co/fOU6DQVSVq
Next week we'll discuss ”Asymptotic theory of in-context learning by linear attention” — Yue M. Lu, Mary Letey, Jacob Zavatone-Veth, Anindita Maiti, Cengiz Pehlevan (2025).
i14 Journal Club: Foundation Models Where Math Meets Cognitive Science
i14 hosts a weekly online discussion group for researchers exploring the intersection of generative AI, mathematics, and cognitive science. We analyze how architectural design impacts learning, memory, and reasoning in foundation models.
Next week we will discuss ”Asymptotic theory of in-context learning by linear attention” — Yue M. Lu, @maryiletey, Jacob A. Zavatone-Veth, @AninditaMaiti7, @CPehlevan (2025).
Join us to dissect training dynamics and explore how cognitive principles can inform the next generation of architectures. Our next session will be hosted via Google Meet on: Monday, May 11 · 12 PM AEST (Melbourne) which is Monday, May 11 · 10 AM CST (Beijing) which is Sunday, May 10 · 7 PM PDT (San Francisco)
Apply to join HERE: https://t.co/fOU6DQVSVq
i14 Journal Club: Foundation Models Where Math Meets Cognitive Science
i14 hosts a weekly online discussion group for researchers exploring the intersection of generative AI, mathematics, and cognitive science. We analyze how architectural design impacts learning, memory, and reasoning in foundation models.
Next week we will discuss "Loss-to-Loss Prediction: Scaling Laws for All Datasets" — @brandfonbrener, @nikhil_anand91, @vyasnikhil96, @EranMalach, @ShamKakade6 (2024).
Join us to dissect training dynamics and explore how cognitive principles can inform the next generation of architectures. Our next session will be hosted via Google Meet on: Monday, May 4 · 12:00 PM AEST (Melbourne) which is Monday, May 4 · 10:00 AM CST (Beijing) which is Sunday, May 3 · 7:00 PM PDT (San Francisco)
Apply to join HERE: https://t.co/fOU6DQVSVq
Join our weekly online journal club on the mathematical and cognitive underpinnings of foundation model architectures: training dynamics, memory, reasoning, and what the brain can teach us about building better AI.
i14 Journal Club: Foundation Models Where Math Meets Cognitive Science
i14 hosts a weekly online discussion group for researchers exploring the intersection of generative AI, mathematics, and cognitive science. We analyze how architectural design impacts learning, memory, and reasoning in foundation models.
Next week we will discuss ”Attention Residuals” — Kimi Team: Guangyu Chen @yzhang_cs@Jianlin_S@Yulun_Du@FanqingMengAI@zxytim@nathancgy4@bigeagle_xd@GuanduoChen et al. (2026). @Kimi_Moonshot@KimiProduct
Join us to dissect training dynamics and explore how cognitive principles can inform the next generation of architectures. Our next session will be hosted via Google Meet on: Monday, April 27 · 12:00 PM AEST (Melbourne) which is Monday, April 27 · 10:00 AM CST (Beijing) which is Sunday, April 26 · 7:00 PM PDT (San Francisco)
Apply to join HERE: https://t.co/fOU6DQVSVq
i14 Journal Club: Foundation Models Where Math Meets Cognitive Science
i14 is launching a weekly online discussion group for researchers exploring the intersection of generative AI, mathematics, and cognitive science. We analyze how architectural design impacts learning, memory, and reasoning in foundation models.
Join us to dissect training dynamics and explore how cognitive principles can inform the next generation of architectures.
Our next session will be hosted via Google Meet on: Sunday, April 13 · 12:00 PM AEST (Melbourne) which is Sunday, April 13 · 10:00 AM CST (Shanghai) which is Saturday, April 12 · 7:00 PM PDT (San Francisco)
Apply to join HERE: https://t.co/fOU6DQVSVq
We're launching a weekly journal club on the mathematical and cognitive underpinnings of foundation model architectures: training dynamics, memory, reasoning, and what the brain can teach us about building better AI.
First session this Monday (Melbourne) / Sunday evening (SF)
i14 Journal Club: Foundation Models Where Math Meets Cognitive Science
i14 is starting a weekly online discussion group for AI researchers and engineers exploring the intersection of generative AI, mathematics, and cognitive science. We analyze how architectural design impacts learning, memory, and reasoning in foundation models.
Join us to dissect training dynamics and explore how cognitive principles can inform the next generation of architectures,
with our first session hosted via Google Meet on
Monday, March 30 · 12:00 PM AEDT (Melbourne time), which is
Sunday, March 29 · 6:00 PM PDT (San Francisco time)
Apply to join HERE:
https://t.co/fOU6DQWqKY
Last week I had the privilege to act as the moderator and as a speaker for the International Conference on Artificial Intelligence, Machine Learning, Data Science & Robotics in Rome
I'm thrilled to have achieved two milestones this year: writing for the Nelson VCE Psychology textbook and receiving the Australian Psychological Society Prize for graduating with the highest honours grade in my cohort last year. Excited to see what doors these will open in 2023!
The Symposium on AI and Mental Health was excellent! All very interesting talks. There was a great energy in the room and everybody was so excited that this event has been created. @sjdalf did a fantastic job of hosting and making everybody feel welcome. #AIMH2021
The Mello research trial launches today! Mello is a smartphone app designed to help young people experiencing worry and rumination. Please get in touch if you’re a young person aged 16-25 w these experiences and would like to be involved in trying the app! https://t.co/p5Vcsq5vbE
Andres Camargo, using Linguistic Inquiry & Word Count (LIWC) in Exploring Linguistic Dimensions of Psychological Distress and Mental Well-Being. #AIMH2021
New paper by the brilliant Piyumi Kahawage and our global chronobiology crew. Adrift in time: the subjective experience of circadian challenge during COVID-19 amongst people with mood disorders https://t.co/cqLLWearrY