viz

compilers, dl, hardware and everything inbetween
Physical Intelligence @eyecandyrobots

[viz @_viz_7]

@w0rdgenerator

[viz @_viz_7]

@NeelNanda5 Happy birthday!

I really liked your work on interpreting transformers. Really cool!

[viz @_viz_7]

The lion hunts everyday

[viz @_viz_7]

@arcgustine *John McAfee intesifies*

[viz @_viz_7]

Bengaluru

[viz @_viz_7]

@atharvasp8 Happy diwali!!
Spent a crazy night yesterday with the boys :)

[viz @_viz_7]

Touching grass is genuinely overrated af. There is nothing to do in life anymore. Is this it?

[viz @_viz_7]

Underground @ koramangala

[viz @_viz_7]

@taykv2 @robocurve Lmaooooooo

[viz @_viz_7]

@emm0sh Everything is a computation problem

https://t.co/48jMDoLyi5

[Paul Graham @paulg]

"Most hardware engineering is actually software engineering in disguise."

[viz @_viz_7]

@krazyfrog Lmaooooo so true

[viz @_viz_7]

16GB DDR4 just sitting cuz I'm on 16GB DDR5. Never felt more rich while drinking sting....

[viz @_viz_7]

@shekitup Qwen my 🐐

[viz @_viz_7]

@infraflakes Nah she is stupid af

[viz @_viz_7]

@LewisCTech Specific algorithms such as the ones related to graphs, sorting, etc... Sure no one really remembers them except for the specialized few. But inverting a binary tree?? Cmon, in trees, the oonga boonga method is usually the most efficient one and there is nothing to memorize.

[viz @_viz_7]

@sannsuka_

[viz @_viz_7]

Imagine random bit flips on Qwen and it turns evil

[Fireside Alpha @firesidealpha]

Elon Musk says a chip for space should run hot, since raising the temperature 20% in Kelvin cuts radiator mass in half, and that a multi-trillion parameter model does not care about a few bit flips

“Well, I guess you want to design it to be more radiation tolerant and run at a higher temperature. So roughly, if you increase the operating temperature by 20% in degrees Kelvin, you can cut your radiator mass in half. So running at a higher temperature is helpful in space."

"There’s various things you can do for shielding the memory, but neural nets are going to be very resilient to bit flips. So most of what happens for radiation is random bit flips."

"But if you’ve got, like, you know, a multi-trillion parameter model and you get a few bit flips, it doesn’t matter. Heuristic programs are going to be much more sensitive to bit flips than some giant parameter file. So I just design it to run hot. And I think you pretty much do it the same way that you do things on Earth, apart from make it run hotter.”

[viz @_viz_7]

@jnvcia @marktyrkba I do this activity of thinking if I can come up with an art piece if I had pursued that art form. Of course, it's just a though experiment and I understand the answer will be no most of the time, but if I had to come up with the witness, I would have to be a different caliber.

[viz @_viz_7]

@IndieGameJoe Peak