Hey @ConEdison, one of my two power mains was cut off in February and you made me hire an electrician to prove it was your issue. We filed a claim to get that money back, but we've never heard back, and support can't help us. Emailed outageclaims@coned as well, no response.
We are now SOC2 Type 2 compliant. Yay!
But also: if you're a startup going for compliance, it's a messy process that's hard to figure out, and I wrote up all the good, bad, and ugly stuff I wish I'd known before I started.
We're officially SOC2 Type 2 compliant at Libretto! 🎉
But forget the usual corporate speak—here's an honest look at the weird, messy reality of SOC2 compliance at a startup. Check out what we learned the hard way: #StartupLife#SOC2#RealTalk
https://t.co/XeSIrqOzSp
We're officially SOC2 Type 2 compliant at Libretto! 🎉
But forget the usual corporate speak—here's an honest look at the weird, messy reality of SOC2 compliance at a startup. Check out what we learned the hard way: #StartupLife#SOC2#RealTalk
https://t.co/XeSIrqOzSp
This was fun. We found that GPT-4o just started giving different answers on Monday, without any change in our code. Learn more about model drift and why it's an issue with LLM development here: https://t.co/6SbpOIXIho
Remember, absolutely none of the news today matters until results start coming in. None of it. Don’t read tea leaves from turnout. Absolutely ignore leaked exit polls. We are in the eye of the storm for political news, so go touch grass. There’s plenty of news to come tonight.
Reminder that early exit polls are nearly useless in terms of predictive value. They are neither consistently right nor wrong. Don't freak out if they seem bad; don't celebrate if they seem good.
In a certain popular SaaS tool that helps you with security configuration, and learning it has a new AI feature that will generate Terraform files to help remediate problems. But the files seem to randomly conflict with each other; I'm not sure why AI is being used here at all.
@conorsen That's also how I remember it. All of them posted vague tweets about how the final result was pretty clear, starting at some point on Wednesday (I think reasonably early on Wednesday).
Pre-registering my extremely cold Selzer take:
T+5 or less is good news
T+10 or more is bad news
Anything in between is kinda mushy and shouldn't move many priors.
@_jasonwei Read through the paper. Nice work! One thing that was maybe a little concerning, though, was that one of your example questions seems to have more than one answer. It seems that Akiko Kumahira was known as Akiko Kumahira Comrie or Akiko Comrie after her marriage.
@_jasonwei This is really neat! I'm curious, are you open sourcing the actual question set, or just the eval code? I tried to find the questions and it looks like it's downloading them from a private URL. (But maybe I'm just misunderstading!)