SlayerLab

Research account

[SlayerLab @FabrykaAI]

@alz_zyd_ N^2 matrix multiplication would help almost anything

[Ashley Fitzgerald @RizomaSchool]

My one thing I've really chilled about as a parent is "the dose makes the poison"

[kache @yacineMTB]

they changed the algorithm to show you posts from your beloved moots and now i'm getting 3k likes on every post again. turns out that everyone is my beloved moot. yes, YOU, my dear.

If I met you on the street, and you showed me your profile picture, I'd say "oohh" and hug you

[hardmaru @hardmaru]

Real brains follow Dale's principle: a neuron can either excite its neighbors or suppress them, but never both. Standard deep learning ignores this and uses backpropagation.

In our new paper, Diffusing Blame, we fix this disconnect. By introducing a routing method that broadcasts error signals directly to the hidden layers, we can train networks made of dedicated positive and negative neurons to strictly obey Dale's principle, all without relying on backprop!

This method works surprisingly well on image recognition tasks despite the strict biological constraints. We also achieved competitive, backprop-free reinforcement learning on complex locomotion tasks and the open-ended Craftax environment.

It is neat to see that representation learning remains possible even when we force deep learning to play by the rules of real neurons.

[the Rich @Duderichy]

for many people, a job is the best way to have regular focused interviews, and achieve some level of "flow", which is a highly enjoyable state

heavily distracted states (scrolling social media/otherwise) are often highly uncomfortable

if you've done much meditation you can see this sort of thing play out

[SlayerLab @FabrykaAI]

@mrwittmayer Book?

[vicki @vboykis]

There are like only three design patterns you need to use 80% to make stuff good and fast and elegant

Make it a lookup (hashmap)
Split it up into smaller pieces (sharding)
Combine it into one large piece (map reduce)

[kache @yacineMTB]

The ideas that people are coming up with: "hey I was wondering if we could reapply the same Monte Carlo graph approach used for Alpha go on optimizing pcb circuits and optimize the training loop by writing custom GPU kernels both for the environment and for the training"

[gabriel @gabriel1]

People Listen To You Only Because They Think Others Do To, Not Because You Post Clever Things

Be Internet Famous

[✮ راينر براون @dondawastaken]

Never forget that you are the main data center. Drink water, and consume as much literature as possible.

[SlayerLab @FabrykaAI]

@effi288 @yacineMTB How much did it cost

[ali @waterloo_intern]

it took 1 intern 3 months of continuous work, but eventually, a quantization method that beat every other algo in the market, including @nvidia's official modelopt

to explain why this matters, i ask for exactly 69 seconds of your attention (275 words @ avg reading speed of 238 wpm):

frontier models (like glm52) are huge (~0.8T params). as released, each parameter takes 2 bytes (bf16), so overall size is about 1.6 tb

a b200 has 180gb of memory. a node of 8 gives you 1.44 tb, barely fits weights, much less activations / kv cache

must quantize the model (reduce the size of each individual parameters) to serve. fp8 quantization means each parameter takes 1 byte (fits in 0.8 tb), fp4 takes 1/2 a byte (fits in 0.4 tb)

cutting the model to a quarter its original size is necessary for it to run a) cheap b) fast, and every lab serving models does this.

but, quantization lobotomizes the model if not done correctly (this is why you see people complain about @AnthropicAI nerfing claude or @OpenAI nerfing codex)

there are currently several algorithms (like Nvidia's official model-opt) that attempt to figure how to quantize a model with the least amount of damage.

they find the redundant layers that can be slashed, and sensitive/important layers that need to stay in full-precision.

these algo's have two drawbacks:
1) they take a long time to run
2) they quite often result in a sub-optimal configuration

for the past 3 months, a research (and, as always, waterloo) intern on our model perf team (@the_joshua_hill) came up with a new quant algorithm.

it consistently finds the optimal configuration:
a) in less time than SOTA
b) with more aggressive quant than SOTA
c) scoring higher on benchmarks than SOTA

achieving just one of the above is a feat on its own.

all three...excited for the paper to come out this week

[Peter Gostev @petergostev]

GPT-5.6-Sol-Ultra is so good at maths that it created Minecraft clone in Lean (yes that Lean)

[SlayerLab @FabrykaAI]

@i2cjak It’s fosfor Acid that’s dissolving it

[Vacha @TVachaW]

My dad set a very high bar for me when it comes to love.

On my mom’s death bed, her last words to him were:

“No woman has ever been loved more than you loved me.”

I try every day to make sure my fiancé’s last words to me will be something similar when the time comes.

[SlayerLab @FabrykaAI]

@willccbb It’s the core of Christianity

[Simon Willison @simonw]

The idea of "AI employees" feels so short-sighted to me - both disrespectful to humans and a complete misunderstanding of what these tools can do and how to best put them to work

You may as well start adding Excel spreadsheets to your org chart

[SlayerLab @FabrykaAI]

@superalesha Which Motherboard you use?

[bubble boi @bubbleboi]

“But can you attract top tier talent?”

The question should really be how good are you at identifying talented people who are less recognizable and arbitrage the labor market.

[Brian Huang @brianryhuang]

Every frontier lab new grad I know started dressing like a fuckboy, that’s how you know they’re post-economic