XPeriential XRchitect, XRevangelist, CD 🌴 forever muse. Holding your brand’s hand at the door of the Metaverse. @Penn Grad. Moonlighting venture scout.
Diversity in #AI is proving difficult to achieve in systems where bias is often complicated. I am proud of fellow @Columbia and @Cornell alumnus @JohnPasmore, who is working to solve this problem through his startup @LatimerAI. https://t.co/XoNJRwn7ga
Clap it up for @NFL, inventing a new form of torture: watching your friends lose their minds, and become absolutely unrecognizable after a few seasons of ball
One aspect of #VisionPro that I think people haven't fully been able to appreciate is the advanced Spatial Audio system. It's insane, and the whole device is really the most advanced consumer electronics device ever created.
The audio system creates the feeling that sounds are coming from the environment around you. The system measures the geometry of your ears and head with an iPhone depth camera to create a personal profile. It also analyzes your room's acoustic properties, including the physical materials. And when a sound is played it uses audio raytracing.
What's all that mean? Imagine you're in nature and you hear a bird chirp to the left of you. The sound waves the bird makes travel in all directions, bouncing off of trees, the grass, your body, and finally into your ears. Some of those objects dampen the sound, some reflect the sound, others bend the sound. And the sound takes a slightly different amount of time to reach each of your ears. Then the sound echos off of the unique shape of your ears, which changes its pitch, and all of this lets your brain know what direction the bird chirp came from, and also what else is in your environment.
So again, the advanced spatial audio system of Vision Pro knows the geometry of your ears if you've calibrated that with an iPhone, it analyzes the acoustic properties of your room including the physical materials, and simulates the propagation of sound using audio ray tracing. I don't think theres any other system on earth capable of this. When you're in a face time call, it sounds as if people are speaking right from where they are. That sounds obvious and like a simple feature, but this is impossible to fully appreciate without experiencing it.
George Lucas is famous for saying sound is more than half the experience when watching a movie. And there's really no way of fully communicating the spatial audio system without hearing it for yourself. Imagine putting on a high end pair of headphones to Vision Pro and watching a 3D movie with a screen that feels 100 feet wide.
There haven’t been nearly enough XR events at LA Tech Week since its inception. Inclusivity also hasn’t been adequately addressed. @a16z@a16zclf@a16zcrypto: WYD?