this might be possible without T3 code and @jullerino@theo and @maria_rcks's work however.. building Rook which has one job to delegate and control both of my machines has been an absolute pleasure and I'm doing a lot more a lot faster
it runs on pi (local) or claude code: STT is a modified setup to make parakeet more efficient . The code for that is here https://t.co/VGdLSW73oI
the memory system is based off of these two papers and has a dreaming loop that runs each night:
https://t.co/JkzoLwfNuF
https://t.co/6Yn8THFhbe
Speech model is:
https://t.co/ePCHv22DdM
The tool reads auctionator data and leveling bis data from my installed addons as well as questie as they are all available and a great start and of course whatever it can see on screen as well from restedXP
In theory if one wanted to build something like this when you initiate a conversation a screenshot is shared with an agent and an in game button activates the addon helper as well as the outside the game agent
the addon helpers job would be to display an information panel (for the screenshot) when some supported api's have received an event like gear has been changed or bags are open etc so the agent has a fresh log
The agent controls my linux PC as a whole and is actually a delegation agent now for all of my coding threads which it can send and receive work updates from the T3 code server/MCP
Meet Phonon-31M-EN: a tiny but mighty text-to-speech model that runs on-device and streams audio in real time. At just 31M parameters, it proves big things come in small packages.
look how weird these comments are.. do people really think I genuinely need to ask the AI whether to kill a mob or not ? it's just a demo of it responding. The addon helper can read tons of data. People are telling me to kill myself in the comments ?
@ReaperRagnar It's built to be all run all local and the STT and TTS are local models I built the STT to be extremely lightweight and run on almost any CPU but a 27b model could handle the AI no problem running on gpu with 16gb or so
Made today when I wanted to hold down a key to find a skinning trainer nearby... uses auctionator data, forever leveling BIS data questie db data and web lookup w claude code sub and opus and the hold to talk key also pulls up all the extra data the live agent needs.
I don't even need to look at T3 Code much anymore since building my omarchy superagent called Rook - If there is interest I'm happy to share. STT and TTS is all local too.
@Grumpy_Paws That misses the point too, I can Google something or just ask while I'm still playing just because it's available doesn't mean it needs to be used for everything. This isn't even a wow addon specifically it's the agent that controls the entire Linux computer I use with a helper
@covacut if you go look at a video I just posted it's brutal - my followers are mostly ai community and I'm just building cool helpful tools for fun with so many comments telling me to off myself lmao
@lockecole777@1488Time it does exactly that, the addon reads the data from scans so not realtime but when you have a bank alt and scan every time you're online the data is fresh enough
@nollidruj I was excited to get it working and share because wow actually doesn't want to give you live data on so many things and I've found some fun work arounds that don't break TOS. thank you
@nollidruj I too worry about how thing look with full automation and how people will feel as humans have a hard time finding inward purpose. I appreciate more nuanced thinkers around this. will follow