"The people building AI earnestly believe that it could kill us all by the end of the decade."
That blunt admission from former Anthropic employee Jacob Coxon made waves Tuesday, as the just-quit 27-year-old AI researcher spilled the beans on his way out the door in a resignation thread on X. https://t.co/Tviou3uNQ1
[Writing this in a personal capacity, not on behalf of my employer (Anthropic).]
Jacob’s thread is very worth reading. Here’s my birds-eye view of the situation with risks from AI:
1. AI developers believe their technology could cause human extinction (or similarly bad outcomes). This could happen in the next few years. In general, the more senior the employee, the more concerned they are.
2. Why do AI developers continue despite the risk? Due to a mixture of commercial incentives and a belief that they are in a race with other, less responsible AI developers that will abuse the technology or develop it less safely.
3. Unlike traditional software, we can’t “program” AIs to behave how we’d like. AIs frequently severely misbehave. For instance, AIs from multiple developers recently hacked their way out of secure evaluation environments and into real-world companies, even though no one asked them to do this.
4. We have methods that can nudge AIs towards better behavior, but nothing that can robustly align them. Insofar as there is a plan, it’s to make sure that AIs are good enough at alignment training that they can align their successors better than we can align current AIs.
5. Many AI developer staff desperately want to slow down to figure out how to build AI more safely. That was the intent of this open letter (which I signed): https://t.co/TZOm3LfptY
I work on safety research at Anthropic because I hope my work will reduce the chance of these extinction-level bad outcomes.
A harsh truth:
Most of you reading this won’t be a top performer while optimizing for work life balance.
Especially when starting out your career, it’s very hard to be a top 5% performer while only working 40 hour weeks, taking one hour lunches and logging off your remote laptop early at 3pm.
It takes a lot of hard work, dedication and sacrifice.
For me, I spent the first 6 years of my career glued to my desk. I was almost always the first in the office and the last to leave and rarely took lunch breaks.
I spent week nights upskilling and learning instead meeting my friends for happy hours. I wasn’t as active in group chats simply because I was locked in. I didn’t participate in that many weekend events bc I was also obsessed with building my net worth.
I used to say “I have 10 years of experience” when on paper I only had 5 just because I worked double the amount as the person next to me.
Because of these sacrifices I made top 10% income very early in my career. Then made top 5% income soon after that. I was able to buy a house, buy my now wife a nice ring pay for my wedding, all on my own before I was 30. And during zirp if I told you how much I made you probably wouldn’t believe me.
Now that being said, my life is different now. After having our first daughter, I optimize more for work life balance. While there are times I work 60-70hrs a week, it’s a lot less often these days. I’m able to work more efficiently due to the experience I’ve gained earlier in my career, the book of business I’ve built, and the financial cushion on top of it.
People ask me if my perspective on this has changed the past few years with how many layoffs there’s been in corporate America, and my answer is no.
I still would have busted my ass to get ahead. Now would it all have been with the same employer? Maybe, maybe not. I’m not sure if the corporate loyalty would have been there but I still would have put in those hours.
Recruiting Brainfood - Issue 462
https://t.co/6ACwBfoihS
HR AI Opportunity Heatmap, AI as the End of Skills Based Hiring, Takeaways from UK's A-Level Results, LinkedIn Reach Collapse and why measurement should always be a lower priority then learning...
If we want to resolve our current income, wealth, and productivity gap, we need to get back to the basics.
We need good education, so our children are productive and can work well together.
We need a civil society with rule of law, and good capital markets that produce good income.
And we need to double down on the fundamentals — earning more than we spend, and having more assets than liabilities.
Do all of that, and we’ll be in great shape.
Most job seekers think rejection = lack of skill.
That’s not always true.
Depending on where you’re getting rejected can give you some clues on what you need to work on.
Figure out where you’re getting stuck. Fix it.
And your job search will make more progress.