@Szy_Paula Real floors in sim is the right call. We do the same for live ops: build a 3D model of the plant or warehouse from its existing cameras, then track people and products moving through it on real shifts.
One ceiling camera over a hand-fed paper-bag press. Same feed answers four questions: who's in shot, how many bags, is the press running, is anyone at the station.
Every overlay here is model output. π§΅
"Is the operator still there?" is a different question from "is the press running". That one goes to a VLM reading short clips: 6.5 s from walking away to the alert.
People are masked before any other model sees the frame.
@polynoamial@OpenAI We saw this in our video tests. Flash was much cheaper than Astra and closer in tracking accuracy than I expected given the price gap.
@ArtificialAnlys We ran into a different issue on video: Sol and Astra sometimes changed the name of an object between frames, so our tracker treated it as a new object. Giving each object a number helped.
Updated the VLM tracker. GPT-6.1 Sol is close to Astra on video tracking and much cheaper.
Closed models still lead on accuracy. Qwen and Nemotron cost less to run, but aren't there yet. Curious to see what @Alibaba_Qwen does next!