I’m excited to share my new book, Puzzles to Unravel the Universe, based on a freshman seminar I teach at Harvard. It includes over a hundred puzzles and discussion on how they relate to deep ideas in physics and math.
Available in paperback and Kindle:
https://t.co/DajQjvFgvN
Can an AI model predict perfectly and still have a terrible world model?
What would that even mean?
Our new ICML paper formalizes these questions
One result tells the story: A transformer trained on 10M solar systems nails planetary orbits. But it botches gravitational laws 🧵
New paper: How can you tell if a transformer has the right world model?
We trained a transformer to predict directions for NYC taxi rides. The model was good. It could find shortest paths between new points
But had it built a map of NYC? We reconstructed its map and found this:
Belated updates:
1- I defended my PhD in May! Big thank you to my committee and especially to my advisor, @blei_lab.
2- I'm excited to start a postdoc at Harvard! Very grateful to @harvard_data for the opportunity.
1/ I had the opportunity to join the @DataSkeptic podcast to discuss CAREER, a method that uses transfer learning to model career trajectories. This is a project I've been working on with @blei_lab and @Susan_Athey's group. Thank you for having me on!
https://t.co/K7h3GdRp20
Excited to speak this Saturday at the #NeurIPS2022 Workshop on Distribution Shifts about CAREER, a transformer-based method for modeling career trajectories from labor sequence data.
https://t.co/zUQnv6TzKH
w/ @Susan_Athey, @blei_lab, @EmilPalikot, @TianyuDu7, @AyushKanodia
New paper: https://t.co/8CjhtqB1j8
Consider a sequence generated by a language model. Which words were most important for generating each word?
We propose greedy rationalization: greedily finding the smallest subset of words that would make the same prediction as the full text.
Tune in this Friday, August 21 at 11am EDT for @bgreene’s live conversation with @brkthroughprize winner @cumrunv. They will discuss the past, present and future of string theory and how puzzles ignited his interest in physics. Join us here: https://t.co/iAaXL2NWXO #WorldSciU
I’m excited to share my new book, Puzzles to Unravel the Universe, based on a freshman seminar I teach at Harvard. It includes over a hundred puzzles and discussion on how they relate to deep ideas in physics and math.
Available in paperback and Kindle:
https://t.co/DajQjvFgvN
Will you be watching curling at the #Olympics? Last year the Crimson curling program finished 4th in the country at the USA College Championships https://t.co/lFGDiVA6wJ