Josh

2nd year NLP PhD @ Penn, I like looking at the data 🤠

[Ekdeep Singh Lubana @EkdeepL]

Super excited about this work! This paper was driven by a claim I've been making to anyone who'll listen: "interpretability is the language of data". (1/3)

[Goodfire @GoodfireAI]

#4: fart fishing

Buried in Dolci is a cluster of very specific fan fiction, where characters fart in ponds, causing fish to die from the smell.

The chosen responses in the dataset wrote vivid scenes, while the rejected refused, teaching the model to comply! (7/9)

[Josh @JMRLudan]

I wonder if you can find out what anthropic thinks are frontier model level ideas by testing what kind of prompts trigger lower performance

[Moongazer @joeybeastmarket]

The only time someone in my family who wasn’t my mom or grandma hit me was when I was 16 and my uncle was working on his 1970s Mustang in the driveway and I asked how someone could fix a car every day for 20 years and it still didn’t work

[Sara Hooker @sarahookr]

Looking at data is actually critical work. It corrects so many issues very quickly that skew algorithmic performance. Should be owned by everyone.

I agree with Alex here.

[Josh @JMRLudan]

beginning to adopt the calm unc mindset

[audrey @phlegmme]

Learn 👇

[Benjamin Todd @ben_j_todd]

Grad school is a comparable public health hazard to all STDs:

~400k US grad students
~40% have moderate-to-severe depression vs. 6% general population
DALY estimate is ~40% reduction in quality of life
So cost is 54,000 DALY per year

Similar to HIV and all STDs in N. America

[🅱️askerville 🇦🇪 @WB_Baskerville]

Excuse me, I think there’s been a mistake, I need to speak with the manager. I was supposed to be part of the in-group the law protects but does not bind, not the out-group it binds but does not protect.

[Josh @JMRLudan]

Was digging through my drive and found this random 11th grade homework assignment from 8 years ago

My favorite part is me claiming - without reference - that "it is often said that the dream of coding is to use english" and saying that once this happens coders will go extinct.

[Josh @JMRLudan]

maybe the real PhD was the friends we made along the way

[Gabriele Berton @gabriberton]

Really cool

When they trained GPT3 they had loss spikes because they scraped from a subreddit of microwave noises

That training batch was literally text like "mmmmmmmmmmmmmmm"

[Josh @JMRLudan]

@garvvee zero offers is so bleak, good luck out there

[Josh @JMRLudan]

No one ever talks about getting fortune cookie psychosis from sycophantic fortune cookies

[Pizza @number_pizza111]

Whenever I see someone knock down one of those stone stacks I think “Oh yeah, you totally would’ve participated in the Rwandan Genocide.”

These people display so much eagerness to participate in condoned violence.

[Josh @JMRLudan]

Northernlion Supercruise im keeping space in the calendar for you

[Josh @JMRLudan]

@zeta_globin seems adjacent to https://t.co/YEn63V8KZu

[Josh @JMRLudan]

Pause AI, Stop AI, Control AI, Open AI, has anyone ever stopped to ask the - oh anthropic's already doing that?

[Josh @JMRLudan]

@freganmitts The study is purely observational with no controls. In other words they just found an association, not necessarily proof that sweeteners cause anything. Many nutrition papers are problematic for the same reason.

[Josh @JMRLudan]

they used to teach this on day three of reddit school :(

[🦂finn @dogsmellsgood]

Holy fucking shit. Finally found the name for it. Im going to cry Ive never been able to explain this to anyone they never know what im talking about