Today we're launching an exciting new project: Highlights
Highlights is a syntax highlighter that outputs HTML. It improves on both speed and correctness compared to the existing industry standard libraries.
It's an optional drop-in replacement in Diffs, and it's ready to use today. In fact, it's already powering diffshub․com!
Check it out at https://t.co/jji0c8fzC4
OR `pnpm install @pierre/highlights`
.@SenJohnKennedy wants AI models to have a “kill switch.”
The Louisiana Republican says he plans to introduce a bill Wednesday requiring companies to be able to shut their models down if they move beyond human control. (1/3)
for some reason, many smart folks seems to be kinda sleeping on Bend (??). so I want to give my take as to why this is so good.
Bend 2 is basically a software factory language. the issue with models is that they will fuck up for your stuff without telling you, and in general cannot be trusted blind, thus making the "software factory" not super viable in practice. Bend acts as basically a replacement for what a .md does in a software factory. it defines the objectives and then it is up to the model to figure out the impl. you dont need to look at the impl because it is formally verified by the end of it. It's the whole point. YOU DONT NEED TO LOOK AT THE FINAL IMPL ANYMORE, THIS IS THE IMPORTANT PART. this is also why it is superior to lean. you can write the shittiest laws known to man in the most shitty and inneficient way possible and the final code will still be as performant as it can get within Bend's bounds. while disregarding concurrency and all that other annoying stuff.
the last 20% to get a product shipped and successful is as difficult as ever
this is where 99% of programmers have always fallen off
the first 80% is a lot easier and so we're seeing more abandoned projects than ever
@PessimistsArc Right. Dario was already claiming that GPT2 was too dangerous to open source back in 2019.
I made fun of them then.
Everyone should make fun of them now.
Dario has written that we need to “pace the frontier,” and Sam has agreed. People may be surprised by my response: go ahead.
You guys are the frontier. By any reasonable metric — market share, revenue growth, model capability — the two of you have a duopoly on frontier intelligence. You’ve also claimed the lead is widening because of recursive self-improvement.
I don’t see what you see in the lab. If the unreleased models are scary enough that you think you should slow down, I support your decision to be responsible.
But stop pretending you need anyone else’s permission. Stop pretending antitrust law has to be suspended so you can form a cartel. Stop pretending you need a regulatory approval process that supersedes product liability. Stop pretending METR is independent when it is intertwined with Anthropic’s investors and staff. Stop pretending you need those same evaluators to police competitors who aren’t even at the frontier.
Most of all, stop pretending the motivation to slow down is purely altruistic. You face massive product-liability exposure if your products enable a truly damaging cyberattack. The market already punishes models that behave in unpredictable or unauthorized ways. After the Hugging Face episode, it is simply good business for OpenAI and Anthropic to trade some raw power for reliability and predictability. Call it alignment if you want. It is also just giving customers what they want.
Pacing the frontier would also create breathing room for a more intelligent conversation about regulation than Bernie Sanders’ “shut it all down.” China is very unlikely to join a global agreement, as you know, and that has to be taken into account as well.
So go ahead and pace the frontier. You are the ones setting it. The easiest way not to build superintelligence is for you to agree not to build it. Demanding your preferred regulatory framework as the price of that will look like blackmail of the public and the political system. So just do it.
If you do, you’ll buy goodwill for the next conversation. If you don’t, we’ll know this was just another bid for regulatory capture — or an election-season psyop.
We Must Pace the Frontier: I’ve written a new essay on why the AI industry should slow down, with a three-part plan for doing so.
Anthropic is unilaterally committing to the first of these steps. We’ll provide third-party evaluators with permanent, employee-level access to our systems, so that they can verify adherence to our safety measures, report on incidents, and assess models’ alignment during training.
You can read the full post here: https://t.co/OGyPb7yaYt
i’m afraid of KYC and you should be too.
KYC is a risk to your personal safety.
collecting personal information in the age of cyber security breaches everywhere is extremely irresponsible. and it’s not going to get any better any time soon.
our laws shouldn’t require institutions to KYC, they should prevent them from doing so.
institutions that leak KYC information or fail to defend it from hackers should be punished by the law for risking their user’s safety.