llmcontroller

Self-hosted AI infrastructure for GGUF inference.
Benchmarking, analytics, orchestration, and runtime control.
NVIDIA • AMD • Linux • Windows

[llmcontroller @llmcontroller]

LLM Controller CE v1.4 is here.

Local voice dictation.
A better experience throughout.

[llmcontroller @llmcontroller]

LLM Controller Pro will bring scalable, brand-agnostic, AI inference with multi node model splitting, speculative decoding, automatic user routing and more!

[Nick Dodd @nickdodd]

The largest software project I've ever created is:
- not completed yet
- over 100k lines of optimized code
- a scalable AI inference platform
- LLM Controller Pro

@llmcontroller

[llmcontroller @llmcontroller]

https://t.co/yJNlhMHYxv

[llmcontroller @llmcontroller]

🚀 LLM Controller CE v1.6 is LIVE!

Our biggest release yet! Persistent Memory, native Tools + Web Search, rebuilt Benchmarking V2, Enhanced Search, major stability improvements and MUCH more!

7 releases in 4 months. Local AI, under your control.

[llmcontroller @llmcontroller]

Benchmarking v2 was broken in v1.5 - it has been fixed and enhanced even further in this release!

[llmcontroller @llmcontroller]

LLM Controller CE v1.6 is shaping up to be a big release.

Enhanced tools with web search, Benchmarking v2, all-new Enhanced Search, and much more.

Coming soon!

[llmcontroller @llmcontroller]

Working on tool use and a better search!

[llmcontroller @llmcontroller]

Hard at work testing v1.5! We brought memory into v1.5! LLM Controller CE will remember you now!

[llmcontroller @llmcontroller]

If you have an @NVIDIA or @AMD GPU, or no GPU at all, you can run LLM Controller CE!

Don’t want to set it up yourself? Point your AI assistant at our GitHub and let it handle the setup.

[llmcontroller @llmcontroller]

Working on adding memory to LLM Controller CE! We already have a Beta build running our custom integration of @mem0ai - Profile Memory, Project only Memory and no memory optional!

[llmcontroller @llmcontroller]

@nickdodd https://t.co/oIYDiBgdw6

[llmcontroller @llmcontroller]

https://t.co/yvR9KNwiIl

[llmcontroller @llmcontroller]

🚀 LLM Controller CE v1.3.0 is live!

Projects + Project Instructions, System Instructions, Docling document understanding, expanded image/file support, API Analytics, improved imports, security fixes, and a whole lot of polish.

One of the biggest CE updates yet. 🔥

[llmcontroller @llmcontroller]

LLM Controller CE v1.3 is almost ready. 👀

Projects + Project Instructions.
Personal System Instructions.
Document understanding with Docling.
API analytics.
A much bigger attachment pipeline.

Final testing is nearly done. One last audit, then release.

[llmcontroller @llmcontroller]

LLM Controller CE v1.2 releases tomorrow. 🚀

• Multimodal image support
• Better attachment handling
• OpenAI-compatible API
• Better title generation control
• Expanded Model Management

#LocalAI #OpenSource #LLM

[llmcontroller @llmcontroller]

LLM Controller CE v1.1 is available now! https://t.co/yJNlhMIwn3

[Nick Dodd @nickdodd]

@kelvinbuildss @llmcontroller LLM Controller makes it super easy and a new version is coming out today or tomorrow!

[llmcontroller @llmcontroller]

Update for LLM Controller CE v1.1 will be on github tomorrow! https://t.co/yJNlhMIwn3

[llmcontroller @llmcontroller]

LLM Controller CE v1.1 is in final testing. Plan to update main in a day or 2!

URL IDs, title search, better UX in several drawers, auto start/stop logs+monitor, bug fixes.

#opensource #localLLM

[llmcontroller @llmcontroller]

@Jokerbernrin Don't I know it 😉

[llmcontroller @llmcontroller]

@MatthewBerman Yay for more excellent open source!