Join me, Claire Martin, Pearson Henri, and @hi_ZachParent on November 19 for a deep dive into how OpenAI’s Forward Deployed Engineering team works with leaders across the Life Sciences industry. I’m excited to show some of my recent work!
We’ll be live on OpenAI Forum, talking about AI in research and clinical development. Bring your questions.
Thursday, Nov 19, 10:15–11:00 a.m. PST
https://t.co/xl9AOnhSRI
Most of you probably haven't noticed this, but dots have a new feature called multi-exec that we quietly released on friday. I've been using it all weekend on my personal dot and it's incredibly powerful.
I'd like to share why this is a big deal and how to use it.
At a high level, multi exec lets your dot run commands directly on any computer. This immediately turns your dot into a real virtual employee. Here's why it's a gamechanger:
- you can attach a powerful machine with persistent storage to your dot (I attached it to my maxed out Mac Studio Ultra)
- the dot can now drive your computer directly via Computer Use
- this extends to browser use
- all your websites stay logged in, residential ip etc
- you set up all your CLIs and authentication ONCE and the dot can use them directly (no more fighting the default ephemeral cloud computer)
- the dot can save skills locally for repeated workflows and subagents can use those directly
- if you have a local obsidian memory vault for your agents, your dot can use that too
- building ios app end to end and testing it in xcode, and showing me screenshots of progress as it works
- all of the above also applies to any subagents your dot delegates to in the cloud (subagents share context unlike separate threads).
To enable it, open the desktop app on your computer and hit "allow computer", then give your dot this prompt:
"Hey I just connected my computer. Can you attach to it directly so it's your default computer and you can run commands directly on it? Do it in your root thread so that all subagents inherit this computer for running commands. Run whoami to run water through the pipes and verify it works end to end."
I recommend attaching your dot to the most powerful machine you have and investing time into it up front:
- Log into all the emails & websites you need e.g. stripe cli, gcloud, firebase, etc
- Install and auth all the CLIs, git you need
- Make sure computer use is turned on and allowed to use your computer while its locked
- I also enabled Allow All for Browsing and Downloads so my dot could use computer use to download whatever it wanted from websites without asking me for approval for each domain (use at your own risk).
- Important: I HIGHLY recommend to ask your dot to build out repeated workflows as skills, and iterate to make those skills bulletproof by running water through the pipes with its subagents.
As of this weekend, my dot is sending me screenshots of its progress building my iOS app end to end on my Mac Studio Ultra via xCode, and clicking around and testing things end to end. It's able to configure things in stripe via the CLI and use websites when it needs to download images for my workflows. It’s night and day. Don't sleep on it.
Last month I joined the product team at @OpenAI alongside my life sciences work. As a former consultant, I’m excited to lead our work on AI for consulting!
We’re hiring founding full-stack engineers in SF. If you know consulting and love to build, reach out.
https://t.co/1sFT9g3vQ7
@sherwinwu@nickaturley@MollyJackman
I know it’s only been 4 days but persistent agents have changed how I work with AI
Yesterday it saved me from a nasty surprise
Passing on the mental load of admin to AI is one of the quality of life improvements im most pumped about. And this is just the start….
This is kind of cool with dots
I got a little bit sick in Hawaii and after an 8 1/2 hour delay last Monday, the idea of flying to San Francisco for Dev Day was simply not happening (I appreciate the invite OpenAI, it was just too much all like 5 days before)
But I had dots go cancel my non-refundable hotel and flight and try to get me a refund. It emailed the hotel, who didn’t respond. After 2 days it decided to email the general manager of the hotel and request it, then got the GM to approve the cancellation with no fee. It noticed there was a $210 charge on my card after the GM agreed, so it followed up to ask why for me.
It also submitted a request with Delta for me, citing the 8.5 hour delay and saying the idea of getting on a plane after that was brutal and requesting an exception. I got a call an hour ago from support saying they’ll approve the request and do a full refund.
Couldn’t make it to Dev Day, but it still got me a full refund on 2 non-refundable bookings.
I’m excited to announce my partnership with OpenAI. We have some interesting things coming up, and I can’t wait to share them with you.
I’ve always been curious... One question usually leads to another, and ChatGPT has certainly encouraged that habit. But it has also proved useful when I’ve needed to get things done, like planning my last trip with the family.
That’s what I’m looking forward to with this partnership. Discovering what else I can do with ChatGPT, sharing what I find useful, and encouraging more people to give it a try with something they care about.
A question, an idea, something you’ve always wanted to explore. There are so many places to start.
Looking forward to exploring together.
#Partnership
@signulll In many ways this how the rich and powerful have lived for centuries, relying on other humans to simply enact their expressed intent. Personal agents will be the great democratizer to bring that to everyone
we're going to see more and more of this - the capability overhang on models like Astra is so vast that building custom capabilities for specific domains is going to be what drives impact in the real world.
we're seeing the same in bio with our Rosalind model series and the Workbench. So much more to come
Astra for Law: Frontier intelligence built for your practice.
A new offering powered by GPT-6 Astra with tools, settings, and context to support the expertise and judgment of lawyers and legal technology firms.
OpenAI achieved a goal of an automated research intern. Here’s a transparent view showing how research at OpenAI is rapidly changing.
https://t.co/NyUEWFHImX
ChatGPT Work can now use its computer and browser to sign in to websites on web and mobile, without ChatGPT ever seeing your username or password.
That means you can ask it to:
• Set up utilities for a new apartment
• Book a DMV or passport appointment
• Check reimbursement costs through your insurance
• Find and book an in-network doctor around your availability
• Check when your car registration expires and prepare the renewal paperwork
• Compare your rental insurance policy with an issue you’re emailing your landlord about
• Find and save apartment listings that match your criteria
• Restock something just by uploading a photo
• Schedule a package pickup for a return
• Cancel tickets for a rescheduled trip
• Book a vet appointment
• Submit reimbursement paperwork for medical treatments
• Check resale sites for new drops and save things you might like
• Find candidates with specific experience and draft outreach
• Take invoices from your email and submit them to your accounting software
• Draft replies to rental property inquiries
• Fill out permit applications for your small business
• Add action items to a vendor portal based on a recent client call
• Analyze the latest ad campaign for your small business
Science is a team sport, so we're bringing together experts across coding agents, biological reasoning, specialist models, bench science, and hardware acceleration for three days of building.
Four tracks:
🛠️ OSS build
🔗 Orchestration
📊 Benchmarking
💡 Open Track
Apply here: https://t.co/ThKoERNVcH