To see how we continue optimizing the performance of how agents running on AI Factories optimize the performance of AI Factories, follow along on Github: https://t.co/J1V11xAKUa
The reason I chose this example to demo is that as we grow the performance ceilings we unlock new configuration options / optimizations. In the past this may have been seen as complexity but with agents, the datacenter can recursively self improve to customize to your needs.
We developed an agent to help streamline AI factory operations management.
The AI Factory Operations Agent uses specialized agents to detect failures and correlate root causes across hardware, telemetry, Kubernetes, and more, all from one chat interface.
Meta's Muse runs a 37.8M-param reranker on 2 CPU cores.
@rohanadwankar tore down the Muse agent VM. In its memory stack: jina-reranker-v1-turbo-en, 153 MB on disk.
Muse searches its users' memories in Postgres with vectors plus keywords. The Jina reranker orders those hits before the agent reads them.
Per the teardown, retrieval runs inside the VM, so memory chunks stay on the encrypted volume.
It's our English-only reranker from 2024. It still earns its place on a box with no GPU.
You can also run our latest @JinaAI_ models with Jina On-Prem. For self-contained and air-gapped deploys, with no outbound calls. .
Rohan's full teardown: https://t.co/W18dgq9Nt8
tried out instinct it was the best ive seen! fun fact with ws-term you can pull your agent’s s3 bucket and read its git repo to see what it really thinks about you 😉
@inventcures@noahrshinn coolest thing was probably one time i asked for something and it didnt get it the first time, then 24 hours later unprompted it comes back with a demo video. that was very impressive feels like were moving beyond chatbots to agents with great memory systems
fyi claude gives free vms for their mobile app. and you can ssh into it and run deepseek nano on @opencode. probably the easiest mobile multiagent setup
made snake, except every square has a number and negative numbers shrink you. this makes solving it harder because the normal hamiltonian path solution gets more complex as the tail shrinks and you need enough room to make up for it