Oran Goodman

Video Diffusion Models @ Decart

[Oran Goodman @OranGoodman]

@datologyai With the falling cost of pretraining small models, I am excited to see alignment researchers attack this!

[Oran Goodman @OranGoodman]

Could be related to the misalignment problem. Most models form lasting representations very early on, from pre-training data, and once those priors are formed, it is seemingly very hard to reform them in someway more “aligned.” RPT approached this by just removing pre-training earlier this year, but pre-training is important! Could adding in alignment data early on help bake in better priors?

[Andrej Karpathy @karpathy]

Diffusion video models but now - **realtime**!

Simple video filters are real-time but can only do basic re-coloring and styles. Video diffusion models (Veo and friends) are magic, but they take many seconds/minutes to generate. MirageLSD is real-time magic. Unlike simple video filters, diffusion models actually *understand* what they are looking at, so they can style all parts of the feed intelligently (e.g. putting hats on heads, or light sabers into hands, etc.). And they are arbitrarily steerable, e.g. by text prompts.

Customizable, intelligent video filters unlock many cool ideas over time:
- transform camera feeds into alternate realities
- direct and shoot your own movies, acting out scenes with props. Realtime => instant feedback/review.
- vibe code games around just simple spheres/blocks, then use a real-time diffusion model to texture your game to make it beautiful.
- style and customize any video feed: games, videos, ... e.g. Skyrim but "MORE EPIC"? DOOM II but modern Unreal Engine quality with just a prompt? Horror movie but "cute, pink and bunnies only"? I don't know!
- zoom call backgrounds+++
- real-time try on clothes virtually
- glasses: e.g. cartoonify your vision in real time?
- we can now build Harry Potter Mirror of Erised, showing the "raw feed" of you in the mirror but augmented with your deepest desires (as inferred by the AI).
- I don't know, I'm probably missing the biggest one, so many things!

(Disclosure I am (very small) angel investor in Decart, I was excited because imo this technology will get very good very fast and it feels general, powerful but it's also technically very difficult. Congrats on the launch to the team!)

[Decart @DecartAI]

Introducing MirageLSD: The First Live-Stream Diffusion (LSD) AI Model

Input any video stream, from a camera or video chat to a computer screen or game, and transform it into any world you desire, in real-time (<40ms latency).

Here’s how it works (w/ demo you can use!):

[hamza zia @ziahamza]

I am excited to finally share that we have shipped over a billion lines of code by @GitStart, with under 1.7 average code review cycles to get it merged.

Here is how we did it and why we are raising more capital on our initial bet ⬇️

[Oran Goodman @OranGoodman]

According to GPT-3:
“being human typically refers to the capacity for rational thought and emotion”

[Oran Goodman @OranGoodman]

@Degentraland @deecooksheat @blackmirror

[Oran Goodman @OranGoodman]

@TheNFTers @metahousemafia!! Their discord has grown by 20% since I joined earlier today!

[Oran Goodman @OranGoodman]

@elf_DAO Wow!

[Oran Goodman @OranGoodman]

@YellowGiantNFT You too! Hype times

[Oran Goodman @OranGoodman]

@knightsofdegen @NFT_NYC @NFTRedZone @CurioNFT @SLATENY Super Hype🔥🔥🔥, Cant wait!

[Oran Goodman @OranGoodman]

@sharifshameem I am also working with GPT-3's API. how did u solve the problem of the JSX being larger then the maximum amount of tokens?

[Oran Goodman @OranGoodman]

@elonmusk @annerajb @waitbutwhy Hi Elon,
Approximately how much per unit does the terminal cost you to build?