nvimchad

a rough estimator

[𝒶𝓁𝒾𝓈 @import_alis]

@deepseek_ai Liang Wenfeng after packing up other labs

[Nick @nickcammarata]

interpretability might be the most important scientific problem in the world right now, as I don't think we can solve alignment if we don't know what we're building. I think I have good news about it. I co-authored early work in mechanistic interpretability at OpenAI and came away pessimistic, because neural networks appeared to fold into arbitrary tangled knots. years later, I started openai's first large-scale automated interpretability project, finding about 2% of neurons legible with the primitive tools we had

with modern agentic tools and a much closer look, the picture looks totally different. the vast majority in models up to trillions of parameters are legible, and their circuits beautiful. many famous examples of tangled neurons turned out to be misunderstood. The roadblocks I expected mostly aren't there. I now think ambitious interpretability will be solved by the time we need it most, and possibly quite soon, as automated scientists keep improving. it may be a bitter lesson for interpretability: the simple thing, at absurd scale, works

https://t.co/zHij5zwKGT

[nvimchad @cxmtsucks]

@nickcammarata This is incredibly interesting!!!

Thank you for putting the time and effort in to connect the dots!

[Beff (e/acc) @beffjezos]

"Oh this? This is just an entity from the nether realm I summoned by enscribing runes on magic stones I forged in a sacred kiln, then proceeded to cast certain spells to distill the collective conscious to imbue it into the substrate. Don't worry, it doesn't have a soul."

[nvimchad @cxmtsucks]

@Lihong062 Economically speaking how is it possible for everyone to be rich? Like will I actually be able to buy a mansion and multiple hypercars or is that still reserved for a class above the regular rich people

[george hotz archive @geohotarchive]

Lobbying https://t.co/nf6kH6gzmd

[nvimchad @cxmtsucks]

@zephyr_z9 Or it could end up more like how Netflix streams video to millions of households/phones everywhere, but for AI: many many specialized, small inference systems piggybacking telecomm infra (towers etc) and user requests r bounced like cell signals/streaming video/music/etc

[nvimchad @cxmtsucks]

@djeong This is like Christmas for every degenerate crypto gambler. Big stuff guys!!

[nvimchad @cxmtsucks]

@__tinygrad__ Can you make the resources available to students online too so I can take it?

[Lucas Beyer (bl16) @giffmana]

Guys hear me out: Jev, but multimodal!

Imagine there was a model that you can give any image, and any set of freeform texts, and it would return you for each text, how well it fits the image.

It could also do a set of yes/no (Noul) by using sigmoid in the right places.

And the scores could be calibrated!

I think i should be able to do this, though i might need to raise xxxM. But as one of the inventors of vision encoders but also one of their biggest haters because i know better, i can pull this off.

And now imagine i would manage to open-weight it, wouldn't that be awesome?

And EVEN BETTER, imagine i could do it with fewer than 1B params?! Maybe like 400m or so?

I think I'm onto something here, wdyt??

[shlummi @shlummi]

guy discovers how profitable inference is

[nvimchad @cxmtsucks]

@swe11er This is actually really really bad advice for young people. It’s your life and you should do with it what you please

[nvimchad @cxmtsucks]

@austinsemis I could train a microwave on the internet corpus and it would still burn my toast once every 100 times.

The internet is 99.9999999999% absolute garbage

[nvimchad @cxmtsucks]

@GergelyOrosz @deebeenguyen I’m not sure, basically every good role out there requires lots of hackerrank and dsa knowledge as a litmus test for intelligence, even though it’s more just a test of how much free time that person has.

I’m mid-recruiting rn and dsa is a barrier at EVERY good company…

[nvimchad @cxmtsucks]

@industriaalist How tf u gonna run a 190T param model on a couple VRs?

[O #FlickOut @omarvsthewrld]

uni student life

[nvimchad @cxmtsucks]

Figure lowkey most underrated for ASI.

They should at least be in the “the world ended because of these guys” conversation