Pleased to have both my cofounder, @emiliiale, and me mentioned as not only winners of the 2nd place at AGI House's "Enterprise Build Day" but also the fact that it was our team's third podium at the house!
Big thanks to @rockyrmit for driving @agihouse_org, holding these Build Days, and giving startups like ours to share our original research with the best of the best!
https://t.co/Ow4yTD78id
AI agents get lost in unfamiliar software, just like people get lost in a new city. We’ve just open-sourced UI Atlas, a tool that maps Windows apps—their screens, buttons, and what happens when you click.
Learn more in the article below ⬇⬇⬇ https://t.co/c8tn6QNN3P
Computer-use agents have a data and grounding problem.
Language models had an enormous corpus to learn from: the web, books, code, conversations.
Computer-use systems don't yet have an equivalent corpus of structured experience describing how real software behaves.
To operate software reliably, an agent needs to answer questions like:
* Which control is this?
* What actions does it support?
* What changed after the click?
* Have I seen this state before?
* Where did this popup come from?
* And what evidence tells me any of this is true?
Today, much of that understanding still has to be reconstructed from pixels, accessibility information, and the current interaction context.
So we started asking a different question:
What if software could be mapped instead of rediscovered from scratch every single time?
Today, @emiliiale and me (with support from @MikhailBurtsev and our friends and advisors) at @AISuccessors are open-sourcing UI Atlas.
UI Atlas is our experiment in open infrastructure for computer-use data and grounding.
It observes real desktop software and turns UI evidence, controls, interactions, states, and transitions into structured, reusable UI Maps.
The goal isn't to build another autonomous agent.
It's to explore whether persistent, evidence-backed representations of software can become useful infrastructure for:
grounding → evaluation → testing → and eventually better computer-use training data.
The first release is deliberately narrow: Windows, local-first, attended observation and map construction. The project is MIT-licensed, and we're opening it because this problem is much bigger than the applications and environments we can test ourselves.
And alongside the code, we finally wrote down what we actually mean by a UI Map — what it is, what it isn't, how UIAtlas constructs one, and which assumptions we want the community to challenge.
O UI Map, What Art Thou? Introducing UI-Atlas
→ Medium: https://t.co/vMgf9oNIEq
Try / inspect / break UI Atlas:
→ GitHub: https://t.co/8dBqRv5Wjr
LLMs had the web.
Computer-use agents need a map of the software world.
#ComputerUse #Autonomy #AIAgents #AGI
Junior PM: I'm shipping everything on time, team loves me, but my manager says I'm "not strategic enough." I'm exhausted trying to figure out what that means.
Senior PM: What did you tell him you accomplished last quarter?
Junior PM: Delivered 5 features, reduced tech debt, improved team velocity by 15%.
Senior PM: And what did he hear?
Junior PM: That I delivered 5 features?
Senior PM: He heard "I kept the team busy with stuff that doesn't move numbers I get asked about."
Junior PM: But velocity improvement is strategic.
Senior PM: To who?
Junior PM: To... the team?
Senior PM: Your manager spends 20 minutes a week with his director explaining why you exist. Can he use velocity to justify your headcount?
Junior PM: I... probably not.
Senior PM: What business metrics did those 5 features move?
Junior PM: Three were tech debt, one was a sales request, one was compliance. We don't really measure impact on that stuff.
Senior PM: There's your problem. Half your work is invisible by design.
Junior PM: But that work was necessary. The platform would break without it.
Senior PM: I believe you. Your manager's director doesn't care.
Junior PM: That seems unfair.
Senior PM: It is unfair. It's also how companies work. Your manager gets grilled about revenue and retention, not platform stability.
Junior PM: So I should have said no to the tech debt?
Senior PM: You probably couldn't. But you should have framed it differently.
Junior PM: How?
Senior PM: "Prevented $200K in potential downtime costs" sounds better than "reduced tech debt."
Junior PM: But I don't have that number.
Senior PM: Then you're fighting organizational reality without weapons.
Junior PM: I don't have analytics support or time to instrument everything.
Senior PM: Most junior PMs don't. That's the trap - you get judged on business impact but don't get business resources.
Junior PM: So what do I do?
Senior PM: Acknowledge the game is rigged, then play it anyway.
Junior PM: Meaning?
Senior PM: Make allies in sales and marketing. They have the numbers you need. Shadow customer calls. Connect your work to their goals.
Junior PM: That feels political.
Senior PM: Everything above a certain level is political. The choice isn't political vs pure. It's visible vs irrelevant.
Junior PM: What if I try this and my manager still doesn't care?
Senior PM: Then you learn your manager doesn't know how to evaluate PM work. That's a different problem - one you solve by finding a better manager.
Junior PM: This is harder than just building good products.
Senior PM: Building good products is table stakes. Surviving organizational dysfunction while building good products - that's the actual job.
Last Friday we vibe-coded “Macrohard” in a weekend hack, riffing off @elonmusk’s idea. 🚀Grok-approved!
It’s hilarious, but also raises a serious Q: Could a company run fully on AI agents?
We think hybrid > agent-only (small human core, large agent fleet).
Curious what you think, @paleofuture@hannahparker@bylloydlee@gruber.
🎥 Here’s 45s preview (humans, agents, customers, KPIs, $MRR all moving in real time).
When @elonmusk says “Macrohard” and we accidentally built it in a weekend…
(Powered by @Grok, @xAI & @SentiusAI, after what we've built at hackathons at @agihouse_org)
Showed @SentiusAI tech paired with @google Agent Development Kit at @agihouse_org!
Demo showed automating complex B2B app - @QuickBooks - using our high-accuracy web browser AI agent running in ADK environment.
What makes our approach unique?
We use own in-context learning tech invented by our very own @MikhailBurtsev. It utilizes successful task execution traces of interactions with complex web apps at each step of the agentic workflow. It allowed us to jump in accuracy to 94% in December '24, and to even higher levels for our commercial customers.
@JustAnotherPM Entertainment for which segments and what distance. For family with kids to give small drawing kit, kid sketch book/ or make some kid area with materials.. Long flights can be tough. 9-10 hours. For others would choose rent films/serials with more content that have now
As one of my instructors once said, the key to successfully using wireframes lies not only in their creation but also in understanding when and how to apply them to foster, rather than hinder, innovation.
Wireframes, simplified drafts of future interfaces, play a crucial role in the design process, acting as a framework for ideas and concepts. Beginners should avoid mindlessly repeating blocks in wireframes, as this can reduce creativity and make it more of a hindrance than a help