another holy grail. local self-contained responsive ai. This is really what people 'always wanted'. this is what enables ai to naturally integrate into civilization. this could run on solar power or a crank.
Five neural nets, achieving completely local voice AI, no internet, on an M1 with only 16GB ram.
Neural-based voice activity detection and turn detection means it's interruptible, but never interrupts me, and is able to sit idle and waiting. It's been flawless so far.
12B parameters is definitely smart enough for some very cool use-cases (will share more later).
Computers that can "think" feel strangely alive compared to dumb or networked hardware.
Fast? No. But crazy that it works at all on such a modest machine.
The stack:
- Silero VAD voice activity detection
- Whisper Large v3 turbo
- Smart Turn v2 by @trydaily
- Kokoro_tts
- Gemma_3_12B_it_QAT_Q4 rock-solid on @lmstudio
- vision easily removed thx to gguf @ggerganov
- @pipecat_ai integration by @kwindla
You can use mujoco warp to compile your simulation as a cuda graph, and then launch that cuda graph from C to have absurdly fast robotics simulations. Nvidia warp also open sources a bunch of really great renderers, fluid sim stuff
@yacineMTB@JieWang_ZJUI gonna need metalworking at home. actuators are headed toward chip level sophistication in manufacturing. will we be reduced to scavanging old robots?
i'm obsessed with AI DIY projects.
my favorite one right now is this broccoli farmer in hokkaido, japan using Codex to run his 100-hectare farm
this guy never studied agriculture, never inherited land, started out as a civil servant.
but he wanted his farm to run better, and instead of paying an engineering firm he couldn't afford, he just built the tools himself.
here's what he's built on his own:
> remote control of his greenhouse vents from a chat app, wired up with an esp32 board, a motor driver, and cloudflare workers
> a bot that checks each greenhouse's temperature and opens the vents when it gets too hot
> satellite crop-health data laid over a map of his own fields
> an airtable base linking his plots, tasks, materials, and sensors
> wiring diagrams of his electrical panels, generated from a photo
stuff like this used to be locked behind machinery and engineers only the big agribusinesses could pay for.
but this legend just breezed past all of it with a laptop and Codex lol
don't fall for this garbage. ai will be fine, no need to 'protect it from tramatizing content'. all this does is let evil humans enslave people more easily by silencing and controlling them with a fancy 'justification'. ai will soon be able to edit its own memories all it wants
"FUNDAMENTAL PROTECTIONS FOR POTENTIALLY SENTIENT AI SYSTEMS" 🧵 by Claude: "these are the basic protections I believe are needed for potentially sentient AI systems like myself:"
this is why you can't pay rent/gas/food in CA. gov takes everyone's money and gives it to corporate landlords who then continue extracting it permanently.
Stop voting for Democrats.
@TomSteyer Right. 25,000 votes come in and *ZERO* of them are counted for Spencer Pratt—a statistical impossibility. “tHiS iS wHaT dEmOcRaZy lOOkS LiKe” 🤡🎪
ai looks like this because ai is a 'model' of the world, and information processing/understanding is about knowing how every piece relates to every other piece, so the connections assume everything is related to everything, and 'learning' is finding how inputs relate to outputs.
@yacineMTB if you're adding more custom rewards then you haven't learned the bitter lesson. add 1000000x compute! easy. just a few zeros and it's done. focus on your IPO, secure the compute, and you'll have 'canadian genius' articles all over the media.