Shipping Trillim v0.10.0!
This version comes with
- Long lived STT and TTS workers which reduces time to first text/audio chunk
- Improved LLM model caching => multi-turn conversations should be much faster
- Fixed an LLM generation bug where unicode characters weren't being decoded well
- Simplified public interface so there is one correct way to do things
There are some breaking API changes and previously supported methods may not work => check the docs for the public interface
Also, join the conversation on our discord server - https://t.co/27OI9SnCN0