Seems like people have found ways to exploit iOS to make this happen, I’m pretty sure Apple will patch this. And hopefully they create a proper API for it alongside the patch for devs to use.
@Apple really needs to allow keyboard extensions to capture mic input like the native dictation, it feels way too creepy to run your app constantly just so your keyboard extension can capture microphone input
@Mokhalil01 True to some extent, UI is mostly for interpretability and debugging these days. Also sometimes nice to see deterministic representation when something feels to good to be true
As model capabilities get better at nailing end to end workflows we're unlearning more things every day. The gap of understanding in doing something by hand 0 times vs even just 1 time is so big. I bet we'll need to build the teaching into the model alongside the new capabilities.