Sasha Aickin

Sasha Aickin. Ex-CTO @ Redfin. (Former?) documentary filmmaker. Avid cook/book club hoster. He/him. @[email protected]

[Sasha Aickin @xander76]

Sasha Aickin: "Speedy, confident" - New York Times

[Sasha Aickin @xander76]

Hey @ConEdison, one of my two power mains was cut off in February and you made me hire an electrician to prove it was your issue. We filed a claim to get that money back, but we've never heard back, and support can't help us. Emailed outageclaims@coned as well, no response.

[Sasha Aickin @xander76]

We are now SOC2 Type 2 compliant. Yay!

But also: if you're a startup going for compliance, it's a messy process that's hard to figure out, and I wrote up all the good, bad, and ugly stuff I wish I'd known before I started.

[Libretto @getlibretto]

We're officially SOC2 Type 2 compliant at Libretto! 🎉

But forget the usual corporate speak—here's an honest look at the weird, messy reality of SOC2 compliance at a startup. Check out what we learned the hard way: #StartupLife #SOC2 #RealTalk
https://t.co/XeSIrqOzSp

[Libretto @getlibretto]

We're officially SOC2 Type 2 compliant at Libretto! 🎉

But forget the usual corporate speak—here's an honest look at the weird, messy reality of SOC2 compliance at a startup. Check out what we learned the hard way: #StartupLife #SOC2 #RealTalk
https://t.co/XeSIrqOzSp

[Libretto @getlibretto]

GPT-4.5 looks really interesting, but this pricing is... whoa.

[Sasha Aickin @xander76]

@jxnlco To be fair, this is basically the worst it's been in the last 3 years.

[Sasha Aickin @xander76]

This was fun. We found that GPT-4o just started giving different answers on Monday, without any change in our code. Learn more about model drift and why it's an issue with LLM development here: https://t.co/6SbpOIXIho

[Libretto @getlibretto]

1/ Well, this was kind of wild: we caught GPT-4o changing underneath us.

[Sasha Aickin @xander76]

@Max_Fisher @chrislhayes Nate Silver has D+1 nationally, it’s worth noting.

[David H. Montgomery @dhmontgomery]

Remember, absolutely none of the news today matters until results start coming in. None of it. Don’t read tea leaves from turnout. Absolutely ignore leaked exit polls. We are in the eye of the storm for political news, so go touch grass. There’s plenty of news to come tonight.

[Sasha Aickin @xander76]

@jdbau 🤞🤞🤞

[Sasha Aickin @xander76]

Reminder that early exit polls are nearly useless in terms of predictive value. They are neither consistently right nor wrong. Don't freak out if they seem bad; don't celebrate if they seem good.

[Sasha Aickin @xander76]

Like, Terraform files to solve AWS config feels like a reallllllly deterministic task. I like AI, but why are we injecting AI here?

[Sasha Aickin @xander76]

In a certain popular SaaS tool that helps you with security configuration, and learning it has a new AI feature that will generate Terraform files to help remediate problems. But the files seem to randomly conflict with each other; I'm not sure why AI is being used here at all.

[Sasha Aickin @xander76]

@conorsen That's also how I remember it. All of them posted vague tweets about how the final result was pretty clear, starting at some point on Wednesday (I think reasonably early on Wednesday).

[Sasha Aickin @xander76]

@ajai_dandekar !!!

Election twitter is going to explode

[Sasha Aickin @xander76]

Pre-registering my extremely cold Selzer take:

T+5 or less is good news
T+10 or more is bad news

Anything in between is kinda mushy and shouldn't move many priors.

[Sasha Aickin @xander76]

@jdbau That also could feel pretty ominous, tbh.

[Sasha Aickin @xander76]

@_jasonwei Thanks!

[Sasha Aickin @xander76]

@_jasonwei Read through the paper. Nice work! One thing that was maybe a little concerning, though, was that one of your example questions seems to have more than one answer. It seems that Akiko Kumahira was known as Akiko Kumahira Comrie or Akiko Comrie after her marriage.

[Sasha Aickin @xander76]

@_jasonwei This is really neat! I'm curious, are you open sourcing the actual question set, or just the eval code? I tried to find the questions and it looks like it's downloading them from a private URL. (But maybe I'm just misunderstading!)