Kristjan Greenewald

QR @ Jump Trading. PhD @umich, postdoc @harvard. AI research

[Grant Slatton @GrantSlatton]

i'm convinced all these people with multi-LLM workflows are placebo psyopping themselves

"yeah i have gemini do literature search that i feed to claude for high level design then have gpt implement"

you are not well, seek help

[Tiberiu Mușat @Tiberiu_Musat_]

Why does deep learning generalize? What does weight decay really do? Can algorithmic information theory address these questions?

In my latest preprint, I give a proof that the minimum neural weight norm matches the minimum program length (aka Kolmogorov Complexity), up to a logarithmic factor. In other words, the neural network with the smallest possible weight norm (that fits the data) must encode the shortest program (that fits the data).

The result only holds for fixed-precision neural nets: infinite precision nets can store infinite information with finite (small) weights.

https://t.co/eMZIGQDf2f

[Kristjan Greenewald @KGreenewald]

@RNPanda69 @xurbanxcowboyx How WERE you ever employed

[Kristjan Greenewald @KGreenewald]

@RNPanda69 @xurbanxcowboyx I see your skills really are bottom of the barrel, good grief. Very entertaining

[Kristjan Greenewald @KGreenewald]

@RNPanda69 @xurbanxcowboyx Ok then! And no I did not. Another datapoint on ex-meta I guess. Yikes

[Kristjan Greenewald @KGreenewald]

@RNPanda69 @xurbanxcowboyx I don’t care what you are saying, I said something that you insist on misconstruing.

[Kristjan Greenewald @KGreenewald]

@RNPanda69 @xurbanxcowboyx I’m saying I see this, I’m not saying its good or bad. How hard is this to understand?

[Kristjan Greenewald @KGreenewald]

@RNPanda69 @xurbanxcowboyx Nobody is judging anyone. I stated that something is happening. It IS happening. What is your problem

[Kristjan Greenewald @KGreenewald]

@RNPanda69 @xurbanxcowboyx low opinions of meta resumes are spreading

[Kristjan Greenewald @KGreenewald]

@xurbanxcowboyx @skulllllkid @blancmontagnard Honestly Google is still solid

[Kristjan Greenewald @KGreenewald]

@xurbanxcowboyx @skulllllkid @blancmontagnard Ok there’s some disconnect here. FAANG is automatic, many bad candidates. Not kiss of death (obviously). Not a passport either. Facebook seems especially low quality

[Kristjan Greenewald @KGreenewald]

@skulllllkid @blancmontagnard @xurbanxcowboyx ngmi

[Kristjan Greenewald @KGreenewald]

@RNPanda69 @xurbanxcowboyx lmao, do you even read

[Kristjan Greenewald @KGreenewald]

@skulllllkid @blancmontagnard @xurbanxcowboyx Ok buddy then not “wherever they want” lmao

[Kristjan Greenewald @KGreenewald]

@skulllllkid @blancmontagnard @xurbanxcowboyx definitely not, see this firsthand

[Kristjan Greenewald @KGreenewald]

@RNPanda69 @xurbanxcowboyx how would you know lol

[Kristjan Greenewald @KGreenewald]

@xurbanxcowboyx Facebook? Yes that’s happening

[will brown @willccbb]

god what a beautiful objective. i wonder how general you can push this. best non-distillation answer ive seen for knowledge acq during RL, feels bitter-pilled in a way that most self-teaching methods aren’t.

[Subbarao Kambhampati (కంభంపాటి సుబ్బారావు) @rao2z]

Guys, stop pestering Mech Interp researchers about causality please! It's this inexplicable obsession with causality that made us lose beautiful sciences like Astrology, Palmistry and Phrenology! 😡