Your local agent can now hear what was said, who said it, and what happened around them.
parakeet.cpp transcribes audio, separates speakers, detects 527 sound classes, and now enrolls and remembers named voices across recordings. One pass, local C++.
Funny thing, it looks they use genai models with images from your camera to reconstruct the surroundings. You can notice also from how some details around. Still, very smart and cool application of it for a good UX. @elonmusk is that right? I wonder if it's a local model or all shooted to the cloud
LocalAI tip of the day: the new release has agent sandboxing working out of the box.
- You can decide how much access it has to internet
- Switch between two sandbox profile, "base" and "media". The media one is slightly bigger but has tools to create video animation, manipulate images.
@MythomancerX@LocalAI_API@huggingface@thepirateface It should never reach that, and if it does I'd treat it as a bug and recommend what it can really fit. I don't tend to like software that acts on my behalf without knowing what's happening.
Tip of the day on the upcoming features on LocalAI (@LocalAI_API ) : you can now search and import models directly from @huggingface and @thepirateface . And now with the addon system this can be extended easily.
@MythomancerX@gr3yg00@LocalAI_API I've managed to make it do small tasks and code changes to a relatively small Golang repo. But, not using it for real coding challenges. Had to steer it a lot and failed pretty much along the road
I've been quiet a bit, but been really focused on @LocalAI_API . Next release is gonna be really nice. I'm so excited for it. If you point your harness to LocalAI's master now it's gonna go crazy for the things it can do with it.
@MythomancerX@gr3yg00@LocalAI_API Got to say that MTP and w/MTP is not doing the real big difference there. Both versions hold with tools very well. You can tell it's limited of course, but for document, recurring tasks, mail, search, and small html pages it's more than enough.
@MythomancerX@gr3yg00@LocalAI_API For the model, I'm actually having my daily driver with https://t.co/0Pj5np94pr which is less than 30b. It is pretty good and never breaks, I've also did my space invader clone with it.
@MythomancerX@gr3yg00@LocalAI_API It can't really break the entire page, at max it will break the widget/portion of the page associated with it if you tell LocalAI to make it in HTML. It can also support structured data, such as for simple things like lists it will never break it.
@mudler_it@LocalAI_API Found some time to play a bit more with it and holy shit, I love it!
Just using now the built in functions, which does work fine, but the interface rework, ability to stop and inject new prompts and the compaction feature - works like a charm!
glad to hear! The more you use you'll find many features. You can ask it to create pages, to change the UI, add widgets that automatically update.. hand over to you tasks results to telegram, and yeah, many many workflows that now it opens up. The chat now is the agent harness, and can also use the underlying LocalAI API!