Until labs come clean as to what is in pre-training, we need to be more skeptical about what is going on. Especially with trillion dollar IPOs on the line
Super Intelligence is great, but it can't be controlled. Best we can do is use it to propose ideas, try to understand them, and then use that new wisdom to improve things.
There are two ways AI progress could go very badly and that we must avoid.
First, we could lose control of the future to AI. This is unacceptable; we are unapologetically on Team Humanity, and AI must always serve people. To ensure that, we need ways to ensure that alignment and safety techniques stay ahead of progress in model capabilities.
Second, we could end up in a world with too much concentration of power. If an extraordinarily powerful AI is used by one person or company to impress their worldview onto everyone else, the results could be extremely dystopian.
Avoiding these two threats requires walking a narrow middle path; for example, one country could gain too much power. Another example is one lab ending up with too much power.
I signed this statement because I believe that Anthropic is in many ways the AI company doing the most harm. In public, their leaders warn of recursive self-improvement (RSI) creating uncontrollable systems that could cause human extinction within a decade. But in private, they are pedal to the metal on RSI, driving the race and boasting to prospective investors that it is their "competitive advantage". Ahead of today's IPO, prospective investors should consider whether the ROI is worth risking the lives of their loved ones.
Here are some ways in which Anthropic IMHO does more harm than competitors:
1) They’re driving and arguably leading the race to RSI.
2) With inflammatory rhetoric, they’ve done more than any other US company to pour gasoline on the geopolitical AI race, which harms US national security.
3) WaPo reporting suggests that they’re implicated in more civilian deaths than any other AI company (more than 100 little girls in a school selected for targeting by Claude as part of their Palantir collaboration). When Google left Project Maven after employee pressure, Anthropic chose to join.
4) They're the company leaning hardest into transhumanism and the idea that we should build conscious beings with rights, not controllable tools.
5) They and closely associated donors have done more than any other AI company to co-opt and neuter much of the AI safety ecosystem to back their stance: “RSI is very dangerous but let’s race to it anyway”. People have told me that they support today’s statement but are afraid of losing funding or other opportunities if they sign.
@daviddoel He's saying Quebecor can't compete against the rest and needs to join with Telus. Bit weird it's buying Telus and not the other way around, but whatever
The Trump administration is considering a requirement that US companies publicly disclose any use of Chinese AI models on their websites. They want to discourage the widespread use of models like Qwen without imposing literal bans that would upset the industry and China.
“If you don’t bring Jensen back I would not hire an outsider,” to run @nvidia, @JeffBezos tells @semafor’s Silicon Valley & the World. Outside CEOs in complex companies have a “vanishingly small chance of succeeding.”