Chaitat Utintu

Computer Vision Researcher

[Chaitat Utintu @CHAITronai]

🎄🔔 𝘌𝘹𝘤𝘪𝘵𝘦𝘥 𝘵𝘰 𝘚𝘩𝘢𝘳𝘦 𝘖𝘶𝘳 𝘕𝘦𝘸 𝘞𝘰𝘳𝘬 𝘰𝘯 𝘊𝘩𝘳𝘪𝘴𝘵𝘮𝘢𝘴 𝘋𝘢𝘺! 🎄🔔

☁️🌈 𝐃𝐫𝐞𝐚𝐦𝐂𝐨𝐥𝐨𝐮𝐫: 𝐂𝐨𝐧𝐭𝐫𝐨𝐥𝐥𝐚𝐛𝐥𝐞 𝐕𝐢𝐝𝐞𝐨 𝐂𝐨𝐥𝐨𝐮𝐫 𝐄𝐝𝐢𝐭𝐢𝐧𝐠 𝐰𝐢𝐭𝐡𝐨𝐮𝐭 𝐓𝐫𝐚𝐢𝐧𝐢𝐧𝐠

Project page: https://t.co/iYZTtOiEuH

[Bilawal Sidhu @bilawalsidhu]

Imagine making 2D concept art for a game world –pressing a button – and suddenly you can walk around an interactive 3D world.

That's what Google DeepMind's new paper Genie 2 can do – simulate virtual worlds, including the consequences of any action (e.g. unlock door, jump, swim etc).

Right now Genie 2 can generate consistent worlds for up to a minute. And this world model seems to generate larger 3D worlds than what World Labs showcased yesterday. Plus they're dynamic vs. static worlds – the foliage moves in the wind, the water ripples etc.

Not quite ready for prime time, but promising on two fronts:

1. For game developers: enabling rapid prototyping of interactive experiences straight from concept art

2. For AI research: providing unlimited, diverse 3D environments for training and testing AI agents

The race for building the biggest, baddest world model is very much on. Meanwhile, all I can think is "if only Stadia was still around!"

[Kosta Derpanis @CSProfKGD]

😒

(with audio)

[Dreaming Tulpa 🥓👑 @dreamingtulpa]

SketchDeco can turn black and white sketches, masks, and colour palettes into realistic image without a user-defined text prompt.

https://t.co/B6g9LGiP80