Rich 🍈

Emoji Kitchen, Android UX @google, Vtuber Mocap @googleai (MediaPipe) • Solo projects: @kalidoface, @thereminapp

[Rich 🍈 @yeemachine]

It’s finally here! 🎊
We open sourced our #vtuber motion capture solution at #GoogleIO!

Our new MediaPipe model predicts 478 face landmarks + 52 blendshapes from your webcam and is compatible with any ARKit rigged avatar! 😺🧵

[Rich 🍈 @yeemachine]

@possiman0512 参加します！ https://t.co/hEXywuB1oE

[Rich 🍈 @yeemachine]

I remember all the late nights trying to make Vtuber face tracking apps by hand like this. No AI, just pure trial and error.

Gemini 3 is very impressive and what I use nowadays for most things too. It's a different era now.

[みゅみゅ @miyumiyuna5]

顔の認識ができなくなったら、リアルの顔が出てくるのがよくないと指摘があったので Gemini3さんに直してもらったよ。
・顔の認識がなくなったら黒画面に
・黒画面の時の画像をアップロードできて、顔認識ないときはそちらに

１行もコード書いてないです。
https://t.co/gALSVHCN5O

[Rich 🍈 @yeemachine]

It’s been so long since my last feature launch at Google 😭. This time they made a fancy promo video.

You’ll be able to create custom stickers right in Gboard using your own photos or text powered by Pixel Studio.

[Made by Google @madebygoogle]

Your Pixel just keeps getting better! This time, with new features to help you stay more connected 👯‍♀️ and be more creative 🎨

See what’s new with the latest #PixelDrop: https://t.co/dgfwjIP4wt

[Rich 🍈 @yeemachine]

It's a crazy time to be in Japan. Hope nothing happens on the 3rd day of 2024

[Rich 🍈 @yeemachine]

@tkasasagi @GoogleDeepMind Awww. Wish I could have stopped by to say goodbye. Cheers and congrats on your next adventure!

[Rich 🍈 @yeemachine]

At Nijifes 😊

[Rich 🍈 @yeemachine]

@CrimsynVT_ Yeah, at the moment, it should work if you add eye tracking blendshapes to your model. That is how the current sample character is rigged. If you have a legacy VRM model, it will use bones to track eyes.

[Rich 🍈 @yeemachine]

Kalidoface Lab 0.1.0 Updates:

🥺Vroid VRM blendshape support
👀 Eye movement for Vroid models
💃Preset resting poses
💡Scene light editor

(ARKit rigging is still highly recommended 😉)

[Rich 🍈 @yeemachine]

Kalidoface Lab was rewritten from the ground up so not all features have been ported over from Kalidoface. It supports ARKit rigged VRM models.

You’ll be able to fine tune the blendshape tracking and adjust your camera angle/position 📐in app.
https://t.co/FyOTNbKuH2

[Rich 🍈 @yeemachine]

Seeing Emoji Kitchen on stream is definitely the highlight of my week

[名取さな @sana_natori]

用意出来たらすぐ開始！

emoji kitchenで
"最強"の"うんち絵文字"探すぞ！！！！！！！！！！！１１１１１１１１

https://t.co/QUsk3Tjvd9

[OJavan🍆 @OJavanP]

Emoji Kitchenで作り出したオタクたちがめちゃくちゃ仲良さそうで草生える #名取さな生放送

[Rich 🍈 @yeemachine]

@Tom_8o Saw Mengo playing around with it too!

[Rich 🍈 @yeemachine]

You no longer need Gboard to play with Emoji Kitchen! We're now in the prime real estate of Google search!

Props to the teams on this launch!

[jennifer daniel @jenniferdaniel]

FINALLY

FINNNAAAALLLLLLYYYYYYY

F🫦I🔥N👑A🌵L🌍L 😈Y

@EmojiKitchen

now exists on the web!!!! Officially!!!!! And all you have to do … is google emoji kitchen🌷

https://t.co/t8jb2OC9Fr

[Raelice @TheRaelice]

Just an example of what AI voice changers can do these days. Both fascinating and terrifying.

[Rich 🍈 @yeemachine]

Can't hurt to try it out right? 🧵

[852話(hakoniwa) @8co28]

wonder dynamicsでのAIによる
実写動画（左）→　VRoid製3Dモデル（右）への置換
モーションキャプチャーとかトレースがいらなくなるんだろうか。凄いな。
#wonderdynamics #VRoid

[Rich 🍈 @yeemachine]

@KafuXYuka The M1 Max was on sale. Need at least that much power for new ventures.

[Rich 🍈 @yeemachine]

🐱

[Rich 🍈 @yeemachine]

@aheze0 I’m gonna need a lil more power than that 😉

[Rich 🍈 @yeemachine]

1 year later at the same spot 😊

[Rich 🍈 @yeemachine]

It still feels like a dream.
Yes, I am working on #Vtuber tech at Google AI!
💪😎💪

Our new BlazePose GHUM Holistic model predicts full body and hand joint rotations for 3D avatars. Available soon at https://t.co/X6nWTWdkqa. 🐎💃🎵

Paper and live demo at @CVPR for #CVPR2022.