josh

eng @openai • prev: @skybysoftware, founder @packfleet, engineer @monzo @apple & indie iOS/mac dev ☕️

[Ari Weinstein @AriX]

Another one: today we released Remote Computer Use in Codex!

This means you can use all the apps on your Mac from Codex Mobile, even when your computer is at home and locked.

It's kinda magic.

[Ari Weinstein @AriX]

Today we’re releasing Appshots in Codex.

I love this feature! It makes it so easy to integrate Codex into everything I do on my Mac.

[Ari Weinstein @AriX]

This is the first time I've ever seen an LLM operate a GUI as fast as a person, and it's surreal.

[Kieraj Mumick @kierajmumick]

Cursor Details:
- It takes a playful path when moving between points
- It wiggles to indicate the model is thinking
- It's color is derived from the portion of the wallpaper thats directly behind it
- the fog around the cursor makes a small cursor easier to see

[Ari Weinstein @AriX]

So excited to share that we're bringing Computer Use to Codex. Computer Use lets Codex see, click, and type into your Mac apps, with its own cursor.

It's a magical feeling to have agents using your apps in the background, and still get to use your computer at the same time.

[Sam Altman @sama]

Ari and team are super talented and we can't wait Sky x ChatGPT!

[josh @jgarnham]

been a pleasure working on Sky with an amazing team these past few months.

such a delightful product and excited to see its impact scale up across millions of users at OpenAI.

[Sky @skybysoftware]

We're excited to share that...

[OpenAI Newsroom @OpenAINewsroom]

We’ve acquired Software Applications Incorporated, the maker of Sky—a natural language interface for Mac.
https://t.co/Vm6GtMtGoU

[Sky @skybysoftware]

We're excited to share that...

[forest @ephemeralapps]

If you want to understand the future of iOS:

App Intent Snippets

https://t.co/BUU2pY2fie

[Marcin Krzyzanowski @krzyzanowskim]

Can't wait to ship it! iOS support in #notepadexe

always blue, always blue!

[josh @jgarnham]

@AriX @SoftwareAppsInc super cool! very excited about this space after having experimented with similar things.

very glad to see what you’ve built in action! 👏

[Sky @skybysoftware]

Introducing Sky for Mac.

Here's a 90-second sneak peek:

[Parker Ortolani @ParkerOrtolani]

just gonna say it

the lil Face ID guy would be a great AI companion and it should live in the island and it should be ready to go at any time

it’s just personified enough to be cute but not weird

[josh @jgarnham]

as far as I can tell, yep, all intents and other events too (like safari navigation, app focus, focus mode, low power mode etc)

no private frameworks but needs full disk access / user permission to access certain directories

and obvs could need updating if the way the info is encoded changes

[josh @jgarnham]

successfully implemented tracking 'donations' of Intents (and similar events) from system + third party apps on macOS

these typically represent things like 'sent message', 'navigated to X url', 'created calendar event', etc.

v helpful for proactive suggestions & predictions

[josh @jgarnham]

think of these being exposed as actions to the mac ai asst or an MCP server

immediate actions for the ai to work with from all your installed apps

deep integration with not just the os but all your apps too

[josh @jgarnham]

technical accomplishment today:

got something working where I can call individual https://t.co/hlbnJEb9wd actions/intents, including 3rd party apps

SIP still enabled, no special entitlements, but a lil private API

also solved getting the definitions for all the intents across installed apps too

[josh @jgarnham]

@UniekLee definitely. the pain point I find with mcp right now is that for most folks (outside of the engineering space) it's not the most user friendly thing to set-up. lots of room for that to improve too i think

[josh @jgarnham]

sent out a new alpha build to a few more testers

one thing i want to look at soon is more specialised support for certain apps, e.g. finder to pull selected files

combine that with allowing the ai asst to invoke shell commands and you unlock a whole load more actions

[Jonas Templestein @jonas]

Looking for experienced system/platform engineers with an interest in AI to join our founding team in the UK 🇬🇧

Building an application and workflow platform on Cloudflare in typescript

Email me directly [email protected] with links to some of your work