Had so much fun hosting this panel “Is Scale Enough?” on Algorithms Day for the Open Problems for AI Summit in Tokyo 🇯🇵 with @kaixhin@EmtiyazKhan@jad_tarifi@SamPassaglia Masanori Koyama 🤖 we discussed definitions of AGI, and how we can advance algorithmic research 🚀
New Differential Transformer paper (@ytz2024 ++) is really cool: they make attention heads differential, computing two attention maps per input and subtracting them.
This improves performance by cancelling out noise, like a humbucking guitar.
https://t.co/faaBKTKfJk
I had such a blast at @tokyoaijp's NLP session last night hearing from our 4 amazing speakers, @lhl@ayase_lab@ayaniwa1213@loem_ms, and speaking to the ~100 attendees!
Now I'm pumped to organize more events with @kaixhin and @ikulyatin in the future :)
7th August is our 3rd TAI AAI (@tokyoaijp Advanced AI) session, focused on NLP. Come listen to researchers and engineers from the top Japanese labs presenting their work on LLMs.
Apply to attend: https://t.co/KbdCGHyZ5y
Organizers: @kaixhin and @SamPassaglia
My team at Elyza has been selected by the Japanese government to receive a major supercomputer grant to develop foundation models!
Excited to put these GPUs to work :)
Today we announced our plans to deepen our investments in Japan, spanning cloud and AI infrastructure, skilling, research, and cybersecurity, as we continue partnering to accelerate the country's AI transformation.
@PatBlanchfield Here's a brief clip from the 1972 event
https://t.co/rYVonHNUU2
That clip is an extract from a 2minute and 20 second CBS Evening News segment on Nov 23 1972, which I don't have access to
https://t.co/NljKzxMK6N