Jarlan Perez

Design Director @YugaLabs Formerly @Google @RTFKT @Nike • AI • UX • AX • XR • Digital Identity. Exploring agentic systems & human-centered computing • 🇵🇷/🇵🇸

[Jarlan Perez @JarlanPerez]

First day at @yugalabs and I definitely felt the love!

Huge thank you to everyone for the warm welcome and kind messages. Your energy, excitement, and confidence in me mean the world and will only push me to go harder.

Stoked to be here and even more excited to help shape @OthersideMeta.

Let’s cook 🫡🔥

[Jarlan Perez @JarlanPerez]

@Prospernwo Idk about the hardest but unlocking the mic and getting the speed of communication to what it is now took a little extra work. Worth it

[Jarlan Perez @JarlanPerez]

Fun experiment getting Hermes, active and operational on a Nintendo 3DS.

I can talk to it from the 3DS and it does real work on my Mac. It can searches the web, writes and runs code, and pretty much anything else an agent can do. The 3DS is the remote.

Getting voice in was interesting part. The 3DS browser can't reach the mic, so Hermes and I installed custom firmware and wrote a small homebrew app in C. Hold A to talk and let go to send. The audio goes over to my Mac, Whisper turns it into text, and Hermes takes it from there. The 3DS is completely unaffected still works as intended.

Anything needing approval is surfaced. The screen goes dark and the command shows up. A approves, B denies.

The Hermes Girl animates through every state: listening, thinking, searching, writing code, sending helpers, done, asleep. There are 13 states in total.

Anyways here’s a few simple interactions.
🤖🖤

[Jarlan Perez @JarlanPerez]

@witcheer ✊🏽

[Jarlan Perez @JarlanPerez]

@alexcovo_eth Looks great! I picked up a few StackChans a while back and waiting for them to arrive to play around with. Nice work

[Jarlan Perez @JarlanPerez]

@o_oNexCrafto_o It’s been super fun experimenting interactions with it

[Jarlan Perez @JarlanPerez]

She talks now!

Hermes on a Nintendo 3DS, round two, let’s go

Hold A to talk and she answers out loud. Press B and she stops mid-sentence. Press R and she sees through the 3DS camera. The 3DS is the mic, the speaker, and now the eyes.

Everything but the model runs on my Mac. Whisper turns my voice into text, Hermes does the work, and VoiceStudio runs Kokoro locally for her voice.

[Jarlan Perez @JarlanPerez]

@RocketmanSh Yep. I do have local models for back ground and automated tasks but I do like using Opus as the orchestrator

[Jarlan Perez @JarlanPerez]

@Teknium @NousResearch we have voice!

[Jarlan Perez @JarlanPerez]

And the initial build that kicked this off

[Jarlan Perez @JarlanPerez]

Fun experiment getting Hermes, active and operational on a Nintendo 3DS.

I can talk to it from the 3DS and it does real work on my Mac. It can searches the web, writes and runs code, and pretty much anything else an agent can do. The 3DS is the remote.

Getting voice in was interesting part. The 3DS browser can't reach the mic, so Hermes and I installed custom firmware and wrote a small homebrew app in C. Hold A to talk and let go to send. The audio goes over to my Mac, Whisper turns it into text, and Hermes takes it from there. The 3DS is completely unaffected still works as intended.

Anything needing approval is surfaced. The screen goes dark and the command shows up. A approves, B denies.

The Hermes Girl animates through every state: listening, thinking, searching, writing code, sending helpers, done, asleep. There are 13 states in total.

Anyways here’s a few simple interactions.
🤖🖤

[Jarlan Perez @JarlanPerez]

These are the 15 different animated states that it currently supports

[Jarlan Perez @JarlanPerez]

@RocketmanSh All except the model Hermes is using. I’ll share another post with an update in a bit :)

[Jarlan Perez @JarlanPerez]

@RocketmanSh Using a local whisper server in the Mac

[Jarlan Perez @JarlanPerez]

@pkyanam Good luck! I was going to try the SP but my brother took that one haha

[Jarlan Perez @JarlanPerez]

@EBMRadio Try it!

[Jarlan Perez @JarlanPerez]

@suliaoqing It feels nice and super responsive

[Jarlan Perez @JarlanPerez]

Haha well the reality of it is I’ve been building an entire workspace for my agents and I to work better in. The thought came of wouldn’t it be interesting if my agent could use additional surfaces nearby as a way to either communicate, remote into, or jump into a device for movement. So this is one of many explorations. Also a super fun way to breathe some new life into an older device

[Jarlan Perez @JarlanPerez]

@NousResearch Incredible agent

[Jarlan Perez @JarlanPerez]

@DirtyRobotWorks Yessss

[Jarlan Perez @JarlanPerez]

@allanmelsen @Teknium For fun and the joy that comes from exploration?

[Jarlan Perez @JarlanPerez]

@TropicalTanker ✊🏽

[Jarlan Perez @JarlanPerez]

@Chahatusharma @Teknium Yep, the 3DS is the remote. Holding A records from the mic and when I let go it sends the audio over home wifi to a small relay on my Mac. Whisper turns it into text and Hermes takes it from there.