I lead AMAP-ML at Alibaba AMAP.
We build product-scale AI systems for spatial intelligence, agents, world models and generative AI, connecting research, open source and products used by 300M+ people every day.
I will share papers, code and AI team lessons here.
NeurIPS26 1/14 DreamX Urbex
redefines city-scale 3D grounding as active spatial search — an agentic VLM that queries landmarks, zooms into regions, and renders oblique views before committing a bounding box.
Say hello to DreamX-Creator 1.0, a 7B native audio-video generator with local 2K refinement. Apache 2.0.
🤖 https://t.co/mXfsOgor7n
🏆 Delivers results comparable to much larger SOTA models like MiniMax H3 on Verse Bench, reaching 0.1351 DeSync after RL and 0.6930 VQ with the 2K Refiner.
🎬 Turn a first frame and prompt into synchronized video, dialogue, action sounds, ambience, weather, crowds, and music. No separate dubbing stage.
🔊 Gated Cross-Modal Attention lets sound and visuals shape each other, while modality-aware RL improves video, audio, and their alignment.
✨ The one-step 2K Refiner tops the compared refinement methods on MUSIQ (0.7073) and MANIQA (0.4382) while preserving motion and audio timing.
🎬 DreamX-Creator 1.0 is here.
Video and audio, generated together—not stitched together afterward.
From a first frame + prompt, our 7B model jointly creates sound and motion. 1-step 2K refinement delivers synchronized 2K output.
Project & roadmap
https://t.co/LcfjTad5xh