Kalidoface | KalidoKit

Mocap for 2D + 3D Vtubers. Start Vtubing with just your browser webcam! [email protected]

[Kalidoface | KalidoKit @kalidoface]

It’s finally here! Kalidoface has an official Discord server!
https://t.co/y9AOnUegJ3

[Rich 🍈 @yeemachine]

Kalidoface Lab 0.1.0 Updates:

🥺Vroid VRM blendshape support
👀 Eye movement for Vroid models
💃Preset resting poses
💡Scene light editor

(ARKit rigging is still highly recommended 😉)

[Rich 🍈 @yeemachine]

Kalidoface Lab was rewritten from the ground up so not all features have been ported over from Kalidoface. It supports ARKit rigged VRM models.

You’ll be able to fine tune the blendshape tracking and adjust your camera angle/position 📐in app.
https://t.co/FyOTNbKuH2

[Rich 🍈 @yeemachine]

Thank you for your support at #GoogleIO 🙏. Here’s what’s next!

Kalidoface Lab is a #Vtuber web app powered by the latest motion capture tech from MediaPipe. Starting with ARKit blendshapes. 😉

You can try it here… 👇

[Kalidoface | KalidoKit @kalidoface]

It's finally time to make it official.

[Rich 🍈 @yeemachine]

It’s finally here! 🎊
We open sourced our #vtuber motion capture solution at #GoogleIO!

Our new MediaPipe model predicts 478 face landmarks + 52 blendshapes from your webcam and is compatible with any ARKit rigged avatar! 😺🧵

[Kalidoface | KalidoKit @kalidoface]

Soon…

[Rich 🍈 @yeemachine]

It’s finally here! 🎊
We open sourced our #vtuber motion capture solution at #GoogleIO!

Our new MediaPipe model predicts 478 face landmarks + 52 blendshapes from your webcam and is compatible with any ARKit rigged avatar! 😺🧵

[Kalidoface | KalidoKit @kalidoface]

@ANYA_PEANUTTT There is a chance. 🤞

[Kalidoface | KalidoKit @kalidoface]

Thank you for all your support 🙇

The Live2D version of Kalidoface will be graduating on Nov 20th, 2022. We weren’t able to come to an agreement with the licensing team to keep the app free and so it will be shut down for now.

Don’t worry, Kalidoface 3D will still remain free.

[Rich 🍈 @yeemachine]

Happy 1st anniversary, @kalidoface 3D! 🎂

Thank you for all your support. I've met a ton of cool people along the way and am grateful to now be working alongside the AI researchers that made this app possible.

Gonna continue accelerating Vtuber tech from the inside 😉!

[Kalidoface | KalidoKit @kalidoface]

Mediapipe just shared their newest model for 3D avatars. You will be able to get joint rotations for 3D avatars directly from the Mediapipe graph.

KalidoKit’s pose and hand calculator will be deprecated. Thank you so much for the support over these few months!

[Rich 🍈 @yeemachine]

It still feels like a dream.
Yes, I am working on #Vtuber tech at Google AI!
💪😎💪

Our new BlazePose GHUM Holistic model predicts full body and hand joint rotations for 3D avatars. Available soon at https://t.co/X6nWTWdkqa. 🐎💃🎵

Paper and live demo at @CVPR for #CVPR2022.

[Kalidoface | KalidoKit @kalidoface]

Thank you so much for almost 4000 stars!

[Rich 🍈 @yeemachine]

Is this the first #Vtuber feature at the @TheWebbyAwards ? 🎉🎉🎉

Happy to share @kalidoface was an Honoree for Technical Achievement at this year's #Webbys!

💪👁️👄👁️💪

Yet again, I was the only solo developer among a sea of corporate winners 😅!
https://t.co/cMrX99MCEX

[Rich 🍈 @yeemachine]

Oya? Is that a @kalidoface cameo at #GoogleIO ? 🥰

We should have Vtubers on the main stage with Sundar next year.

JK…unless 👀????

https://t.co/qyALqx7yyg

[Rich 🍈 @yeemachine]

@kalidoface desktop app in development...

[Kalidoface | KalidoKit @kalidoface]

@albus_c Thank you! Check out our Glitch templates as a starting place to learn to use it locally https://t.co/5ttz1kKotq

[Kalidoface | KalidoKit @kalidoface]

It’s Leg Day! 🦵🦵🦿

Kalidoface 3D and KalidoKit v1.1.5 released with updated leg tracking.
Not perfect yet, but should be enough for some #Vtuber squats!

Pomu not included. 🍃

Test it here ➡️ https://t.co/KS4FMnDJre

Code stuff ➡️ https://t.co/lX7dQQs4XH

[Kalidoface | KalidoKit @kalidoface]

Thanks to a generous contributor, better leg tracking is coming soon!

[Kalidoface | KalidoKit @kalidoface]

@ldenoue We would need to look into this, but there’s a chance you can achieve similar speeds using TFJS’s Mediapipe backend instead of WebGL.

[Kalidoface | KalidoKit @kalidoface]

Mobile Safari has been upgraded in the latest version of iOS. Now, we can finally use Mediapipe tracking on iOS devices.

Kalidoface and Kalidoface 3D have been updated and should have significantly faster face tracking on iOS. (Full body still not recommended on mobile)

[Kalidoface | KalidoKit @kalidoface]

Bug patch: Fixed an issue with older Cubism 2.0 Live2D models that would freeze the app.

[Kalidoface | KalidoKit @kalidoface]

🥳🧁🎈