0xShugo

Private, secure, edge-native AI. Building real-time inference, speech systems, and AI that runs on real devices.

[0xShugo @0xShug0]

One month ago, audio.cpp was open-sourced. Yesterday, audio.cpp reached 1,000 GitHub stars and Alibaba Tongyi Lab integrated audio.cpp into the FunASR deployment platform🎉.

In one month:
📷 The project grew from 12 to 44 model families, with 31 contributors.
📷 Engineers from Alibaba and Mistral AI contributed models and improvements to make them more production-ready.
📷 Shared model specifications, reusable components, CLI and server interfaces, streaming support, and experimental pipelines moved the project closer to the original vision of a unified AI runtime.

Thank you to everyone who has contributed, tested, reported issues, or simply given the project a star. Here's to the next milestone. 📷🎉🚀

[0xShugo @0xShug0]

Want to run VibeVoice 1.5B locally on your iPhone? The source code for the XCFramework and demo app is now available: https://t.co/lenMfeXRJA

Note: the additional Metal optimizations merged into the main branch have not been applied to this branch yet, so performance can be further improved.

[0xShugo @0xShug0]

Want to run VibeVoice 1.5B locally on your iPhone? The source code for the XCFramework and demo app is now available: https://t.co/lenMfeXRJA

Note: the additional Metal optimizations merged into the main branch have not been applied to this branch yet, so performance can be further improved.

[0xShugo @0xShug0]

Want to run VibeVoice 1.5B locally on your iPhone? The source code for the XCFramework and demo app is now available: https://t.co/lenMfeXRJA

Note: the additional Metal optimizations merged into the main branch have not been applied to this branch yet, so performance can be further improved.

[0xShugo @0xShug0]

Want to run VibeVoice 1.5B locally on your iPhone? The source code for the XCFramework and demo app is now available: https://t.co/lenMfeXRJA

Note: the additional Metal optimizations merged into the main branch have not been applied to this branch yet, so performance can be further improved. @Microsoft

[0xShugo @0xShug0]

Want to run VibeVoice 1.5B locally on your iPhone? The source code for the XCFramework and demo app is now available: https://t.co/lenMfeXRJA

Note: the additional Metal optimizations merged into the main branch have not been applied to this branch yet, so performance can be further improved.

[0xShugo @0xShug0]

The official audio.cpp UI is currently under active testing on the dev branch , alongside the Release 0.6 preview models: DotTTS, NeuTTS, and MuScriptor. Please try them, report issues, and share feedback so the workflow can be polished before it becomes the default release experience. https://t.co/vzFqFIhEQu

[0xShugo @0xShug0]

The official audio.cpp UI is currently under active testing on the dev branch , alongside the Release 0.6 preview models: DotTTS, NeuTTS, and MuScriptor. Please try them, report issues, and share feedback so the workflow can be polished before it becomes the default release experience. https://t.co/vzFqFIhEQu

[0xShugo @0xShug0]

@shinshin86 Check our C++ version of Omnivoice (along with 40+ other audio models in one runtime). No Python and 1.8x to 8x faster than Python on CUDA! https://t.co/RpQznHV5Cw

[0xShugo @0xShug0]

https://t.co/rMGYINytcn

[0xShugo @0xShug0]

@C_of_Creativity Thanks for including the benchmark in the repo! I’m working on porting text-to-audio to audio.cpp, with text-to-video as a free bonus 😄. This is exactly the kind of reproducible performance baseline I’ve been looking for.

[0xShugo @0xShug0]

@simplifyinAI Check our c++/ggml version of pocket-tts (and 40+ other audio models in one runtime)! https://t.co/RpQznHV5Cw

[0xShugo @0xShug0]

Nice work! In case anyone is interested in a local version, audio.cpp is an all-in-one AI audio runtime that supports 40+ state-of-the-art audio models across TTS, ASR, music generation, and more, with highly optimized performance. A new UI is also open for testing now! https://t.co/K9H1vbstsx

[0xShugo @0xShug0]

One month ago, audio.cpp was open-sourced. Yesterday, audio.cpp reached 1,000 GitHub stars and Alibaba Tongyi Lab integrated audio.cpp into the FunASR deployment platform🎉.

In one month:
📷 The project grew from 12 to 44 model families, with 31 contributors.
📷 Engineers from Alibaba and Mistral AI contributed models and improvements to make them more production-ready.
📷 Shared model specifications, reusable components, CLI and server interfaces, streaming support, and experimental pipelines moved the project closer to the original vision of a unified AI runtime.

Thank you to everyone who has contributed, tested, reported issues, or simply given the project a star. Here's to the next milestone. 📷🎉🚀

[0xShugo @0xShug0]

VibeVoice 1.5B running locally...On an iPhone! Only ~2.2 GB of memory and up to 1.28× faster than realtime.

[0xShugo @0xShug0]

@OpenAI Vibevoice 1.5B running locally on an iPhone! 2.2GB VRAM and 1.2x faster than realtime.

[0xShugo @0xShug0]

Star our repo so you don’t miss future updates! The model was uploaded to the audio.cpp HF repo. I will upload the xcframework later, and then push the code to a branch after release 0.6.

[0xShugo @0xShug0]

VibeVoice 1.5B running locally...On an iPhone! Only ~2.2 GB of memory and up to 1.28× faster than realtime.

[0xShugo @0xShug0]

Another longform demo

[0xShugo @0xShug0]

We’re working on a C++/GGML implementation of Muscriptor in audio.cpp! It should be easy to port to other platforms, including iOS. If you’re a fan of music models, audio.cpp already supports ACE-Step, HeartMuLa, Stable Audio, and more. Follow our repo or X account so you don’t miss the update!