Very proud to announce that we placed 1st on the @AIatMeta x @cerebral_valley Llama hackathon last week in Oslo!
In just 24 hours, we created Nordic Response - a platform to triage non-urgent medical concerns in rural areas with low internet access.
At the heart of Nordic Response lies a 3B Llama model that we trained to function as a medical reasoner on the edge. First stage of training was PPO on math puzzles (to teach it to use tokens to reason), then in the second stage, PPO on easily verifiable medical question-answer pairs (to steer it towards the medical domain).
Kudos to my amazing team: William Booth-Clibborn, Keerthanen Ravichandran and Caspar Schwahn!
🏆 1st Place 🏆 - $15,000 USD + $9K Nebius Cloud Credits + Meta Ray Bans
⛑️ Nordic Response – a platform to triage non-urgent medical concerns in rural areas with low internet access. Designed for northern Norway, hosting expert medical AI, the first-ever open-source Llama reasoning model, and supporting 5-way language translation (including Sami).
@keerthanenr
🏆 1st Place 🏆 - $15,000 USD + $9K Nebius Cloud Credits + Meta Ray Bans
⛑️ Nordic Response – a platform to triage non-urgent medical concerns in rural areas with low internet access. Designed for northern Norway, hosting expert medical AI, the first-ever open-source Llama reasoning model, and supporting 5-way language translation (including Sami).
@keerthanenr
Molnar et al. analyze context usage in LMs and connect it to psycholinguistic effects observed in humans for context locality and repetition https://t.co/ku5m4MHIF2 (@aronmolnr@JumeletJ@glnmario@janiesinclair) 6/
Busy day today at #EMNLP2023, looking forward to interesting chats! You’ll find me at the LChange workshop in the morning (I’ll give a keynote on word representations at 9:30). In the afternoon between @GenBench (definitely the panel) and #conll2023 (come to our poster at 1:45👇)
📢✨Attribution and Alignment: Effects of Local Context Repetition on Utterance Production and Comprehension in Dialogue✨ will be at #CoNLL2023 🥳 Proud of this work with @aronmolnr@JumeletJ & @glnmario: my first last-author paper! 🤩✨ #EMNLP2023 https://t.co/p4QDexNvBk