nobody has ever applied diffusion language models to Hindi
not once
so we did it 160 experiments, 4 diffusion models vs 4 autoregressive models, Hindi translation + summarization + legal NLP, zero-shot all the way to agentic prompting
turns out the "AR models dominate everything" assumption doesn't hold the same way once you leave English
cc @aaron_lou (we ran SEDD on Hindi for the first time) @ai4bharat
paper dropping soon
https://t.co/wpk99W2j0e
too many mfs are building βai agentsβ that are basically prompt β tool call β result β repeat and calling that autonomous. where the fuck is state? counterfactuals? if your agent canβt test what happens before acting, maybe itβs not reasoning. itβs just clicking shit faster.
@sullaxive@ThePerryAgent a fly evolved to navigate a few millimetres of air.
we gave its nervous system a B-2.
now we're asking a much bigger question:
how much of the efficiency of biological intelligence is hiding in the wiring itself?
more soon :)
I GAVE A HOUSE FLY A B-2 BOMBER.
we took the wiring of a fruit fly nervous system, the Janelia MaleCNS v1.0 connectome with ~125M synapses, and put it in the loop controlling a virtual B-2.
this is what happened. β
@sullaxive@ThePerryAgent Instead of starting with an empty neural architecture, we start with connectivity shaped by evolution.
~125M synapses encode far more than a parameter count suggests.