Philosopher, Self-taught Programmer, Self-taught Cognitive Scientist, Marine Corps Veteran, Will talk about Artificial General Intelligence with anyone
We compiled tools into a language model’s weights.
A language model with tools compiled into its weights.The model writes the call. Exact ternary circuits, in the same weights, do the work. Everything runs in your browser. ↓
A browser compiled to weights: DNS queries + answer parsing + IP selection, HTTP requests and HTML parsing. Tested through real HTTPS and exact replay. No training or LLM API. Python/NumPy runner; socket transport/TLS remain outside.
I've been working on some weird stuff and thought this was a fun demo to pull out of it. Like, why are we using harnesses that make tool calls when you can put the tool call in the weights?
@boldlygrow basically some of non-transformer ml architectures use k-means, and this new one can speed up “all” of them as a drop in replacement. but idk
Introducing e-means, an algorithm beating k-means in 10x fewer epochs.
With order of magnitude wall-clock speedups, e-means is released in FAISS and needs no hyperparameter tuning beyond k. It is robust to various scales and datasets. Still skeptical ? Just try e-means [1/10]🧵
We compiled tools into a language model’s weights.
A language model with tools compiled into its weights.The model writes the call. Exact ternary circuits, in the same weights, do the work. Everything runs in your browser. ↓
A browser compiled to weights: DNS queries + answer parsing + IP selection, HTTP requests and HTML parsing. Tested through real HTTPS and exact replay. No training or LLM API. Python/NumPy runner; socket transport/TLS remain outside.
I've been working on some weird stuff and thought this was a fun demo to pull out of it. Like, why are we using harnesses that make tool calls when you can put the tool call in the weights?
@jessi_cata yeah, local information has always been the most important thing. Nobody can know what an individual wants at any particular moment outside of their interactions with the outside world.
And a toy where the whole thing is one program: a tiny trained model, its sub-agents and an addition skill, lowered into 5.9M ±1 gates and executed gate by gate in your browser.
https://t.co/NXFE1M6owj
How it works: a 225M ternary, integer-only LM never types the numbers. It points at them; exact circuits in its own weights do the arithmetic, sorting & chaining.
Try it:
https://t.co/aJBkS5TkPB