Prof. Michael Schwertel

Media Professor @CBSinfo, Media Producer, Filmmaker, Designer #DigitalMarketing #Animation #AI #VR #AR #KI #goa24

[Prof. Michael Schwertel @MSchwertel]

AI Animation: A Gamechanger. Just weeks ago, this would have taken days, but now it’s only 2 minutes! With #LivePortrait, I turned my facial expressions into an animated video from a Midjourney still. Is this freedom for our visions or a threat to jobs? #AI

[Prof. Michael Schwertel @MSchwertel]

@craigmiller1973 Yes. It's so easy to use...

[Prof. Michael Schwertel @MSchwertel]

🎥 Just conducted a virtual interview with the late Gordon Moore using #AI tools! Created his image with MidJourney, text via ChatGPT, and video with #Hedra. Raises questions about ethics and possibilities. What do you think? 🤖✨ #Innovation

[DW Global Media Forum @DW_GMF]

"Journalists need to make a topic out of this," says @MSchwertel (CBS International Business School).

He asks for a critical observation of AI companies who are not transparent about the data they use to train their software or about what ultimately happens to the user data.

[Prof. Michael Schwertel @MSchwertel]

Yesterday @DW_GMF, I had the honor to speak right after @ABaerbock and @mariaressa at the the session „Quality Assessment and Control of AI in Journalism“ It was inspiring to see the audience‘s keen interest in adressing theses rapid developments. #gmf24

[Prof. Michael Schwertel @MSchwertel]

So many good thoughts of @mariaressa in such a short time: „It is not about content - it‘s about data!“ like McLuhan the medium is the message… at @DW_GMF with @ABaerbock @CultonScovia #gmf24

[Prof. Michael Schwertel @MSchwertel]

Unbelievable! #Sora not fully launched. #OpenAI held back due to fake video risks or Hollywood deals? China and Google have rival solutions. Now, Luma’s quick and high-quality video conversion tool is here. We’re at the dawn of a new video production era. #DreamMachine #ai

[Sam Altman @sama]

her

[Prof. Michael Schwertel @MSchwertel]

Excited to announce I'll be speaking at #ICTADC2024 by Istanbul Arel University! "Artificial Intelligence and Culture Production" 🎨🤖 It's a deep dive into #DigitalCulture and #MediaInnovation Can't wait to share insights and learn from others! 🌍💡 #ArtificialIntelligence #AI

[Prof. Michael Schwertel @MSchwertel]

Heute bei Media Workshop: Auspacken des Zukunftsbaukastens 🧱 '#Medientrends - von KI bis VR'. Ein Tag voller Einsichten und lebhafter Diskussionen! Besonders spannend: Ordnung in die 'Innovationsexplosion' bringen. 🤖💡 Von #ChatGPT bis #MetaQuest3, wir deckten alles ab. #KI

[Barsee 🐶 @heyBarsee]

AI turning memes into video

It's funny and scary at the same time.

A thread: 🧵👇

[Prof. Michael Schwertel @MSchwertel]

Experimented with #ChatGPT & #DALLE3: After analyzing my website, it generated an image with my work objects. Same prompt to #Midjourney, different photo. Which is better: Image 1 or 2? 📸🤖 #AI #DigitalArt #KI

[Prof. Michael Schwertel @MSchwertel]

Wir werden durch KI alle arbeitslos… oder doch nicht? 🤖🧠 Mein neuer Artikel in @Horizont beleuchtet, warum jede Marketing-Agentur heute einen #KI Experten braucht. #KIimMarketing #ZukunftDesMarketings #TechTrends

[Prof. Michael Schwertel @MSchwertel]

Ein inspirierender Tag in der @RTLDE_Corporate Journalistenschule für die #GrimmeAkademie @grimme_institut. Tief eingetaucht in #Transmedia und Plattformen wie TikTok & Instagram. Morgen: #KI in Social Media und ein Blick in die Medienzukunft. 🎙️📲 #Medienbildung #DigitalerWandel

[Prof. Michael Schwertel @MSchwertel]

AI Video out of one picture: #pikalabs and #runway for „journalistic“ content?
@DJVde @AHA_agrar #ai #GenerativeAI

[Prof. Michael Schwertel @MSchwertel]

Mensch & Maschine @DJVde in Wuppertal #ki im #journalismus

[Prof. Michael Schwertel @MSchwertel]

Reflecting on the "#AI in Journalism, PR & Marketing" #workshop, we've marveled at AI advances from ChatGPT plugins to LLM interpreting brainwaves. We've relished discussing these opportunities and risks. Excited for more learning and breakthroughs in AI. #WeekInAI🚀

[Prof. Michael Schwertel @MSchwertel]

Screen distancing efforts then introducing a new product that would literally need to be strapped to your eyeballs… #vr

[Prof. Michael Schwertel @MSchwertel]

The @Apple #VisionPro is also „detecting the mental state of users based on data from their body and brain when they were in immersive experiences.“ #vr #mr #xr

[Sterling Crispin 🕊️ @sterlingcrispin]

I spent 10% of my life contributing to the development of the #VisionPro while I worked at Apple as a Neurotechnology Prototyping Researcher in the Technology Development Group. It’s the longest I’ve ever worked on a single effort. I’m proud and relieved that it’s finally announced. I’ve been working on AR and VR for ten years, and in many ways, this is a culmination of the whole industry into a single product. I’m thankful I helped make it real, and I’m open to consulting and taking calls if you’re looking to enter the space or refine your strategy.

The work I did supported the foundational development of Vision Pro, the mindfulness experiences, ▇▇▇▇▇▇ products, and also more ambitious moonshot research with neurotechnology. Like, predicting you’ll click on something before you do, basically mind reading. I was there for 3.5 years and left at the end of 2021, so I’m excited to experience how the last two years brought everything together. I’m really curious what made the cut and what will be released later on.

Specifically, I’m proud of contributing to the initial vision, strategy and direction of the ▇▇▇▇▇▇ program for Vision Pro. The work I did on a small team helped green light that product category, and I think it could have significant global impact one day.

The large majority of work I did at Apple is under NDA, and was spread across a wide range of topics and approaches. But a few things have become public through patents which I can cite and paraphrase below.

Generally as a whole, a lot of the work I did involved detecting the mental state of users based on data from their body and brain when they were in immersive experiences.

So, a user is in a mixed reality or virtual reality experience, and AI models are trying to predict if you are feeling curious, mind wandering, scared, paying attention, remembering a past experience, or some other cognitive state. And these may be inferred through measurements like eye tracking, electrical activity in the brain, heart beats and rhythms, muscle activity, blood density in the brain, blood pressure, skin conductance etc.

There were a lot of tricks involved to make specific predictions possible, which the handful of patents I’m named on go into detail about. One of the coolest results involved predicting a user was going to click on something before they actually did. That was a ton of work and something I’m proud of. Your pupil reacts before you click in part because you expect something will happen after you click. So you can create biofeedback with a user's brain by monitoring their eye behavior, and redesigning the UI in real time to create more of this anticipatory pupil response. It’s a crude brain computer interface via the eyes, but very cool. And I’d take that over invasive brain surgery any day.

Other tricks to infer cognitive state involved quickly flashing visuals or sounds to a user in ways they may not perceive, and then measuring their reaction to it.

Another patent goes into details about using machine learning and signals from the body and brain to predict how focused, or relaxed you are, or how well you are learning. And then updating virtual environments to enhance those states. So, imagine an adaptive immersive environment that helps you learn, or work, or relax by changing what you’re seeing and hearing in the background.

All of these details are publicly available in patents, and were carefully written to not leak anything. There was a ton of other stuff I was involved with, and hopefully more of it will see the light of day eventually.

A lot of people have waited a long time for this product. But it’s still one step forward on the road to VR. And it’s going to take until the end of this decade for the industry to fully catch up to the grand vision for this tech.

Again, I’m open to consulting work and taking calls if your business is looking to enter the space or refine your strategy. Mostly, I’m proud and relieved this has finally been announced. It’s been over five years since I started working on this, and I spent a significant portion of my life on it, as did an army of other designers and engineers. I hope the whole is greater than the sum of the parts and Vision Pro blows your mind.

[Aakash Gupta @aakashgupta]

2. AI Antibiotic

Scientists published a paper using AI to discover a new antibiotic.

It came out last week in the prestigious Nature Chemical Biology.

They used deep learning AI methods to prune through many options and find an ideal candidate.

Source: @Nature