Every successful marketplace has winners and losers
But some participants make it more of a dark forest than a chessboard
We find some direct evidence for this — and some simple math to make these marketplaces more robust to rogue inference providers! https://t.co/Phgr7ktYdv
OH (person usually skeptical of AI): “Wow, I used Muse to go figure out if my doctors and dentists overcharged me on procedures and found thousands of dollars of overcharges; Muse automatically submitted 75 claims for me.
Its time to go mega short insurance companies”
One of the biggest ironies to me about a group that believes E[X] is a gospel is that they learn that in practice the rate of convergence to a stationary-ish mean statistic matters more than predicting E[X] itself (also n.b. @banteg’s and @VitalikButerin’s posts)
EA is a loosely organized group that was brought together for a brief period in the late 2010s on an Internet forum, and as Internet forums go, splintered in a million ways. someone should write a definitive ethnography of that period for the public good “Bentham’s Seed”
You don’t fully grasp how much of your life is tracked until you’re sitting in a courtroom, watching federal prosecutors use your digital history against you, down to your most harmless Google searches. Your entire life becomes an open book, and even your most innocent actions can be twisted into something sinister.
They get to tell the most damning version of your story. To tell yours in your own words, you have to take the stand.
If there’s any thing to learn from open weight models, it is that capitalism and competitiveness on open models is the only form of freedom left
Hoping that academic tenure continues as is by promoting the IEX of AI is likely a way to (sadly!) learn the economic lessons of Cuba
Mathematician Terence Tao:
"we have to slow down AI. the pace is insane, and there's no reason to be this fast — no reason at all"
It's amazing how willing we are to change everything without any idea what happens afterward
These are extremely nonlinear dynamics
Personally there are only three things about ZEC that keep me as a 6+ year holder
1. @zkDragon
2. @zkDragon
3. Only ZK protocol attacked at scale and can realistically fund defenses
“It is meaningfully different to be a Zcash user today than literally six weeks ago.”
Dev Ojha (@zkDragon) joins me to discuss Zcash’s security and UX improvements since Ironwood went live:
- A quantum-recoverable, formally verified shielded pool
- Proving optimizations
- Onboarding links from @vizorwallet
- Ledger integration for shielded ZEC
636606729769440499166579950236036751749912014371509557713570027508971809534551913252252094954941974952859310861988904737359709200557919
is a factor of RSA-896
https://t.co/yGWyEC8RpZ
Yeah, definitely agree with Noam; there have been lots of crazy attacks like this — @EranTromer has a boatload of papers on this for key extraction from the early 2010s, c.f. https://t.co/uvLhomjPIa
A few thoughts on this:
1) If you’ve only seen clips of this interview, I’d encourage you to watch the full podcast. I push back on plenty of AI hype in it.
2) As I said in the podcast, this example is academic. My intention was to illustrate how hard it is to make absolute guarantees about isolation, which is why it's important to have layers of defense. The part before the clip starts is me talking about other layers of defense.
3) The example I'm bringing up isn't about weight exfiltration via temperature sensors, it's about coordination between agents that are supposed to be fully isolated and independent. Coordination can require very few bits of information.
4) One lesson from the HF incident is that we put too much trust in sandbox isolation and didn't have enough independent safeguards. Airgapping is an extremely strong safeguard. When designing safety protocols, I think it's much better to overestimate rather than underestimate.