tamas

[Zephyr @zephyr_z9]

"reaffirmed commitment to open source to promote AI "openness and win-win"

LessWrongcel hardest hit

[the tiny corp @__tinygrad__]

What is tinygrad?

tinygrad is a formalist project. It attempts to capture the full gamut of software 2.0 in a non leaky abstraction. The methods on Tensor class create a directed graph of immutable RISC UOps defining what the computation is.

Tensor is a frontend, in addition we have an ONNX frontend and a PyTorch frontend. Whether you code in tinygrad, torch, or import ONNX models, it all boils down to the same very simple UOp graph, which you can see with VIZ=1

This graph contains nothing like matmul or conv, it's just movement ops, elementwise ops, and reduction ops. Seriously, try VIZ=1.

Below that, there's a scheduler which breaks that graph up into kernels. Then we do more graph transforms on each kernel subgraph until we have code which can run on an accelerator. See the kernels with DEBUG=2.

Then we have runtimes capable of running that code. For AMD, our runtime goes all the way to the physical hardware; we are mmaping the PCIe bus and peeking and poking it. It's all in Python, but it is fast because once you have the graph compiled, you are running the same graph over and over; just ringing a doorbell.

The hope is that, similar to Linux and LLVM, we will prevent a major source of rent seeking in our AI future. By clearly and simply specifying the job, being able to precisely spec what is bought and sold, you can have a fair marketplace for compute.

By the end of the year, we should be similar in speed on NVIDIA to the existing torch CUDA backend, except without CUDA. We will also have a test cloud up where you can run jobs from any of the three frontends.

You don't want to rent a GPU per hour on a machine, you want to rent a couple FLOPS in a lambda function. That's what the OpenAI API is. Now offer it decoupled from the specific model.

[OptionalFlag @OptionalFlag]

@elder_plinius Why does this feel like it is written by Lumon Industries from Severence

[gfodor.id @gfodor]

“Oneshot this app” is just a weird party trick. Today’s best models all have the IQ to build an app if they had the agentic skills and tools to run code and observe the results in a loop. We long passed the point where programming is default dead.

[Hernan Moraldo @hhm]

Prompt: "Bear writing the solution to 2x-1=0. But only the solution!"

[vittorio @IterIntellectus]

“first time”

[luffy @0xluffy]

listening to thiel core as i accelerate

[Joseph 🕊️ @CaudilloXIV]

Ideal male living space

[Rothmus 🏴 @Rothmus]

🎯

[Jonathan Blow @Jonathan_Blow]

Why does software almost always do the opposite?

[cold 🥑 @coldhealing]

construction crews in northern virginia getting ready to build another aws data center

[Joseph Lubin @ethereumJoseph]

Today, Consensys took an important step towards preserving access to ether and by extension the Ethereum blockchain in the U.S. We are suing the SEC and fighting back against its overzealous regulatory overreach. You can find more of my thoughts here:

https://t.co/tvq9KcsbrN #EthforAll

[Web Design Museum @WebDesignMuseum]

Fight Club movie flash website in 1999

#WebDesignHistory

[Nikita @nikmel2803]

RPC of a smoker vs RPC of a healthy person

[cloud @cloud11665]

the memes write themselves now.
"everytime the gpu crashes - 1 minute meditation" - @realGeorgeHotz

[terminally onλine εngineer @tekbog]

haha print statements go brrr

[harry law (hopfield network truther) @lawhsw]

Not gonna lie this looks overengineered to hell

[10x'er @10x_er]

if we brought back the smoke break we would eliminate 85% of meetings

[pikuma.com @pikuma]

"The work I do in video games is actually far more complicated than the aerospace work." - Carmack

[@goth @goth600]

“Mom, can we have a Dyson sphere??”

We have a dyson sphere at home baby

The dyson sphere at home: