Dear friends, dear internet, dear enjoyers of splats,
today I'm releasing not just one, but two projects to the world that I'm extremely proud of:
The first is Frankensplat:
an all-new, browser-based, free-to-use, superfast 3DGS training studio built entirely in Javascript and WebGPU!
Frankensplat is a complete BEAST of an engine.
In fact, it's the fastest 3DGS training engine that we know!
Despite using "only" WebGPU and JS in the browser it outperforms even the fastest native apps while being SOTA on quality (study link in reply).
Since it runs natively in your browser, it works
* offline (data never leaves your device)
* on virtually all modern computers
* without any download, setup, build or install
And since it's so fast you can enjoy training great Gaussian Splats even on older or cheap consumer GPUs. No 4090 required!
If you like 3DGS, go give it a try!
>>> Links in reply <<<
-----
The second project is the Frankensplat launch video.
This is my first time getting really serious with AI for video production.
It's only 3:44 minutes long but *a lot of work* went into it.
Every single clip in the video was prompted as a still frame (many, many times!), then style-adjusted using img2img, then animated using different video models until it was right.
Final editing, mixing, color grading and rendering was done in Davinci Resolve.
In the end, it really did come out exactly the way I imagined it, which is a great feeling and which I didn't assume was possible when I started it.
If you have four minutes, I think it'll be worth your time.
PS: the 3DGS jokes start in the second half of the video, so be sure to watch till the end!
PPS: due respect to @janusch_patas who helped bring 3DGS to a broader audience with LFS and has helped the community in countless ways. Janusch, thanks for starring in the video -- don't take it too seriously!
@GoogleAI your latest Gemini models are the GOAT, but ASI not required to zip up some invoices in Gmail.
Please, just put one good SWE on this integration for 1 month.
If you can't find a good SWE to do it, I'm happy to return for a month and do it myself!
@GeminiApp@gmail
Well, it's nuanced!
Ofc you're correct the gradient borders would cause 'flying pixels'. But those are easy to remove.
More interestingly though, we can see in the pics that the actual geometry (fine hairs) is sub-pixel, hence there is no single correct answer for a pixel covering both foreground (hairs) and bg (plants).
The correct answer would be dual- or triple-return channels, as we get them with certain lidars.
Fellow Gaussian Splat fans,
Frankensplat is out!
* A new 3DGS training tool & engine, written entirely in JS & WebGPU
* Up to 2x faster than LFS at comparable quality
* Fully browser-based
* No cloud, no downloads, no installs, no builds, no EXE files
Links in reply.
Enjoy!
Dear friends, dear internet, dear enjoyers of splats,
today I'm releasing not just one, but two projects to the world that I'm extremely proud of:
The first is Frankensplat:
an all-new, browser-based, free-to-use, superfast 3DGS training studio built entirely in Javascript and WebGPU!
Frankensplat is a complete BEAST of an engine.
In fact, it's the fastest 3DGS training engine that we know!
Despite using "only" WebGPU and JS in the browser it outperforms even the fastest native apps while being SOTA on quality (study link in reply).
Since it runs natively in your browser, it works
* offline (data never leaves your device)
* on virtually all modern computers
* without any download, setup, build or install
And since it's so fast you can enjoy training great Gaussian Splats even on older or cheap consumer GPUs. No 4090 required!
If you like 3DGS, go give it a try!
>>> Links in reply <<<
-----
The second project is the Frankensplat launch video.
This is my first time getting really serious with AI for video production.
It's only 3:44 minutes long but *a lot of work* went into it.
Every single clip in the video was prompted as a still frame (many, many times!), then style-adjusted using img2img, then animated using different video models until it was right.
Final editing, mixing, color grading and rendering was done in Davinci Resolve.
In the end, it really did come out exactly the way I imagined it, which is a great feeling and which I didn't assume was possible when I started it.
If you have four minutes, I think it'll be worth your time.
PS: the 3DGS jokes start in the second half of the video, so be sure to watch till the end!
PPS: due respect to @janusch_patas who helped bring 3DGS to a broader audience with LFS and has helped the community in countless ways. Janusch, thanks for starring in the video -- don't take it too seriously!