@vin_sachi Who has a clue what’s in the train set in these models? The evals are basically marketing material now, so reasonable to assume labs cook up/buy/generate similar types of problems to train on
(Unsolicited) Advice for a young PhD student - “This is not vocational training”
I spent most of my afternoon today at Stanford. It’s the week before autumn quarter and 8 years since I came out to the farm with wide eyes. It was as good a time as any to reflect at a place that is still the most beautiful I’ve had the chance to call home. One thing I kept thinking about was the advice I’d give to those that were now starting on this path - things have changed so much. Nevertheless, I’d reiterate the advice that had been given to me that was most meaningful in retrospect.
Before coming out west, I’d built a startup in Boston. My first boss and CEO, a professor at MIT, had finished his PhD at Stanford 9 years prior. Through the infinite wisdom of hindsight, he’d provided me many pieces of prescient advice. One that stuck out, and is somewhat under communicated, was to not treat the degrees vocationally.
A parallel he drew is the historical origin of research based academia - that of patronage towards gifted youth. You see, many of the greats, such as Gauss, were given the privilege to learn and discover the fundamental truths through noble patronage. He’d told me that framing the program in this manner would be effective at making the most of it - an exceedingly rare privilege to retreat from the world to learn, discover, meet great people, and introspect. Not as a stepping stone or accomplishment towards a set path or career outcome - a unique aspect relative to any other degree.
In this vein, the PhD is not a means to an end and extrinsically a negative EV bet (maybe this is not true anymore with 7 figure AI salaries). The way to truly win the wager is not carefully crafting the best outcome at the end of the tunnel but through intrinsic value gained in discovery and relationships - learning to be a first principles reasoner, a cogent communicator of complex thought, an adept meta learner, and building authentic connections with those who are invariably the brightest in the world. The best way to do this is to be open-minded, non-transactional and throw out any plans you made on the way in. You have a lot of time, so try a lot of things.
If you play your cards right, you get the chance to live a very interesting life, compound knowledge tremendously, and enjoy the company of the best people along the way
@vin_sachi One’s knowledge cutoff was obviously after the paper was posted, obviously a lm can’t do symbolic differentiation (nor would it ever make sense to use it for that). Kind of a trivial example imo
@Jayyzaba Yeah, tbf would never have predicted Nelli’s output to fall off so much. Competition for Him + Saka has to be a priority this summer you’d think