@Raspberry_Pi Event cameras are awesome but currently too expensive. Hopefully this module gets a reasonable price but I doubt it after seeing "request a quote".
@SkarredGhost Unity has a class called TextureConverter that allows to convert a WebcamTexture to a Sentis Tensor directly. I'm not sure how it is implemented internally but I can hope it's well optimized.
https://t.co/Sv5M3xlKSv
@SkarredGhost with camera access, quite easily.
without camera access, it requires an annoying calibration process like for mixed reality capture and cannot live-recalibrate to compensate for drift while moving.
@cixliv@VibeFitnessGame If you try to make it work on older devices, you'll probably get trouble with thermal throttling unless the AI model is very light. It may be worth to add external cooling in the dock to avoid losing ~75% of the AI power on older devices.
@SkarredGhost@UploadVR Open-source / simple to decode protocol or locked to pico ecosystem only?
Would be great if they add optional external cameras for higher accuracy mode or for use for other purpose than VR.
@XolotlVtuber@NimaZeighami I tried on quest 2 ( scrcpy -> OpenCV -> tag detection) for AR but the resolution and distortion were too bad to detect the AR tags except when perfectly centered.
I don't have quest 3 to test it.
Another problem is that if we render over the tag, it cannot be detected anymore
@CezaryXR@Lunayian The leap-motion sensor, for example, was not a depth-camera but an IR illuminator with 2 IR cameras. Close range objects (hands,...) became bright while far range was less illuminated. This helped to get high quality segmentation and do precise depth estimation by stereo.
@CezaryXR@Lunayian Depth sensors generally have a lower resolution than cameras and are not good for thin structures (fingers,...) but are good for uniform surfaces at which stereo-cameras are bad.
It would be interesting to know the technology of the depth cam (structured light, tof,...).
@MetaQuestVR But the quest loses 90% of its AR potential by not providing camera access to the developers 😭
Interaction with moving object cannot be recognized. We cannot detect when a plate is washed or the location covered by the vacuum cleaner (could spawn some enemies to vacuum),...
Interesting full-body-tracking research I saw at ICCV23 from Eth Zurich and Meta reality labs.
They use electromagnetic sensors for full-body-tracking without occlusion problem, and they refine it from a single rgb camera
#VR#MetaQuest#fullbodytracking
https://t.co/YIk3qg5Rj4