Mesh LLM

Distributed inference for the people. Private and public mesh, sharing hardware for inference.

[Mesh LLM @Mesh_LLM]

@Wbackdown I would expect not as fast as a trade off, larger but possible vs smaller faster (such is life).

[Mesh LLM @Mesh_LLM]

New Mesh plugins for Apple Silicon:
⚡ Uzu: high-throughput Metal inference for Qwen 3.8 & more
🧠 DwarfStar: run huge DeepSeek V4 models locally
💾 Slotstream: SSD-backed MoE for Macs with less RAM

https://t.co/kc9Zjf7zYW
https://t.co/NAMwQvCCtX
https://t.co/jwXGMJPFzB

[Mat Balez @matbalez]

this was fun to build

- fork of signal
- agent built with GDK
- using open weights model
- served via e2ee mesh-llm
- via private GPU TEE
- making private search tool calls
- paid for with ₿ over LN

a cool stack of permissionless & open source tech all working together!

[Mesh LLM @Mesh_LLM]

Right on - this is what we made MeshLLM for (well that and some procrastination: https://t.co/2475r46Zii

Metal, CPU, CUDA (various), ROCm, Vulkan, x86_64, arm, windows/mac/linux and appropriate combinations.

(fingers are sore).

[Mesh LLM @Mesh_LLM]

Who wants ads?

So great to have ads. Everyone wants ads. More ads. Should we put ads in?

[Mesh LLM @Mesh_LLM]

Who wants ads?

So great to have ads. Everyone wants ads. More ads. Should we put ads in?

[Mesh LLM @Mesh_LLM]

we have shifted a fair bit of dev to buzz to try out multi player agents, just to see how it goes. Some findings from the other month: https://t.co/bEjQmS4QfX

[Mesh LLM @Mesh_LLM]

Right on - this is what we made MeshLLM for (well that and some procrastination: https://t.co/2475r46Zii

Metal, CPU, CUDA (various), ROCm, Vulkan, x86_64, arm, windows/mac/linux and appropriate combinations.

(fingers are sore).

[Georgios Konstantopoulos @gakonst]

this is THE time to be revisiting distributed inference on heterogeneous hardware, software is collapsing the barriers of hardware incompatibility

[Mesh LLM @Mesh_LLM]

welcome to ... https://t.co/AdXAbXlgXE