HERMES CAN NOW CONTROL YOUR PHONE. π€―π±π₯
A new Phone Harness plugin gives Hermes the ability to actually operate an iPhone or Android.
We're talking real phone control:
β’ See what's on the screen
β’ Open apps and navigate menus
β’ Tap, swipe, scroll, and type
β’ Read the results and continue working
β’ Handle multi-step tasks inside mobile apps
And here's what makes this so interesting...
Hermes doesn't need a dedicated API integration for every app. It can interact with the same interface you use.
Supports iPhone through Mac mirroring, Android through ADB, and cloud phones.
Think about how many new workflows this opens up for Hermes.
Repo + setup in the first reply. π₯
@phone_harness
Hermes Agent can use your real phone the way you do, and it's one install away in the Hermes plugin catalog: phone-harness.
(1) what you get:
- it sees the screen, taps, swipes and types, so it works with apps that have no API or plugin of their own
- ask it to check the forecast in Weather, or to open Notes and write something down for you
- iPhone through iPhone Mirroring on a Mac, Android over adb, or a cloud phone
(2) and you stay in charge:
- every script asks you first: allow once, for the session, or always
- on the phone, it checks with you before it sends, posts, buys, deletes or changes a setting
- it never types passwords, PINs or 2FA codes, it hands the phone back to you
@bot can use my personal iPhone! π€
It used @phone_harness to post on X for me
My Grok Bots can now:
> Control my phone like a human, anytime
> Use my iOS apps with my existing logins
> Order food, message anyone, and more!
Try it now β
Jev can use my iPhone! π€
I asked Jev to use TikTok:
> Uses the phone like a real human (tap, hold, drag)
> Send a task, i.e. "Find videos with food in them"
> Classifies videos based on user's prompt and interacts
phone-harness + Jev is genuinely insane
Real-time agents are here
Try it now β
For the first time, scientists have mapped the complete brain and central nervous system of an adult male fruit fly β a key model organism in science. πͺ°
Working alongside HHMI Janelia Research Campus and the scientific community, @GoogleResearch scientists and researchers used AI to combine millions of 2D images into 3D neural shapes, reconstructing a record-breaking 166,000+ neurons. This foundational map of the adult male fruit fly brain can help accelerate our understanding of the brain, and is a major milestone in neuroscience.