Hugues Bruyère

Try / Share / Iterate — Creative Technologist / Chief of Innovation @bonjourdpt

[Hugues Bruyère @smallfly]

Mixed Reality + Diffusion prototype as a tool for exploring concepts, styles, and moods by transforming real-world surroundings into alternate realities.

#MixedReality #MR #AI #StableDiffusion #Quest3

[Hugues Bruyère @smallfly]

@willeastcott I really like capturing staircases… Reminds me of one of my test location 😶‍🌫️

[Hugues Bruyère @smallfly]

Re-captured the staircase of our building with the PortalCam. ~1 year ago, I captured it with the Lixel L2 Pro. The L2 Pro point cloud was denser, but I’ll need a closer comparison of the 3D GS to see the real differences.
#portalcam #3dgs #GaussianSplatting #digitaltwin

[Hugues Bruyère @smallfly]

Back to capturing my neighborhood... this time, our back alley again.

Here is just a quick initial exploration and reconstruction check of this capture. Captured with the PortalCam in between two rain showers.

#GaussianSplatting #3DGS #pointcloud #portalcam

[Hugues Bruyère @smallfly]

@carrabre @DanyBittel @mintdotgg An example…

[Hugues Bruyère @smallfly]

Starting from the real world, capture it, and use it as a base to explore variations, instead of generating from scratch. Here capturing this alley with the PortalCam, then point cloud to 3D Gaussian splats and finally manipulated with Marble/@theworldlabs.

The result is the same space across multiple alternate realities — abandoned, decayed, day, night — connected through portals.

Everything runs real time in the browser using Spark 2.0/@sparkjsdev.

#GaussianSplatting #3DGS #pointcloud #WorldModels #sparkjs #threejs

[Hugues Bruyère @smallfly]

Absolutely, I’m not saying the opposite. I do use models at work and on my personal projects and explorations. That being said, I still like to get my mirrorless and lenses out, or even my PortalCam, and do captures. There is something special about capturing and “saving” an actual artefact that exists in real life. I embrace both.

[Hugues Bruyère @smallfly]

@MartinNebelong This is the way.

[Hugues Bruyère @smallfly]

@DanyBittel @carrabre @mintdotgg Indeed, but tell me that you do not enjoy the capturing process! 😉 As well as capturing the real thing.

[Hugues Bruyère @smallfly]

Back to capturing my neighborhood... this time, our back alley again.

Here is just a quick initial exploration and reconstruction check of this capture. Captured with the PortalCam in between two rain showers.

#GaussianSplatting #3DGS #pointcloud #portalcam

[Hugues Bruyère @smallfly]

@tripoai @toyxyz3 @VastAIResearch This looks impressive. I have been exploring realtime img2img → 3DGS workflows, so very curious to test this in the coming days.

[Hugues Bruyère @smallfly]

@atthatmatt Not sure I understand what you mean by “splats don’t handle mirrors yet”. I mean, reflections are be handled quite well in my opinion. Curious what you mean exactly.

[Hugues Bruyère @smallfly]

Back to capturing my neighborhood... this time, Coiffure Mile-End played the game.

Here is just a quick initial exploration and reconstruction check of this capture. The mirrors facing each other made for an interesting challenge, along with the constantly changing light as the sun kept appearing and disappearing behind clouds.

#GaussianSplatting #3DGS #pointcloud #portalcam

[Hugues Bruyère @smallfly]

@VastAIResearch @siggraph This looks impressive. I have been exploring realtime img2img → 3DGS workflows, so very curious to test this in the coming days.

[Hugues Bruyère @smallfly]

@atthatmatt A bit of that, but mostly I needed to make sure I had enough different POVs of the mirrors’ reflections so that I could be masked out, as in this case it was often impossible to hide myself.

[Hugues Bruyère @smallfly]

Back to capturing my neighborhood... this time, Coiffure Mile-End played the game.

Here is just a quick initial exploration and reconstruction check of this capture. The mirrors facing each other made for an interesting challenge, along with the constantly changing light as the sun kept appearing and disappearing behind clouds.

#GaussianSplatting #3DGS #pointcloud #portalcam

[Hugues Bruyère @smallfly]

@AIDSfinder By making sure to go all around to space.

[Hugues Bruyère @smallfly]

@benlimner In that case I would say 2; after it becomes all mushy.

[Hugues Bruyère @smallfly]

@bilawalsidhu @lichtfeldstudio Oh yes, totally agree. Those early NeRF days 😅 I did love some of those floaters though.

That being said, I just did a quick capture of a small salon full of mirrors in my neighborhood using the PortalCam… pretty good results.

https://t.co/NB0kIELFjr

[Hugues Bruyère @smallfly]

Back to capturing my neighborhood... this time, Coiffure Mile-End played the game.

Here is just a quick initial exploration and reconstruction check of this capture. The mirrors facing each other made for an interesting challenge, along with the constantly changing light as the sun kept appearing and disappearing behind clouds.

#GaussianSplatting #3DGS #pointcloud #portalcam

[Hugues Bruyère @smallfly]

@tokufxug Thanks for sharing. I will try it next.

[Hugues Bruyère @smallfly]

The scenes coming out of The Latent Space (a collaboration with Alejandro Cartagena / @halecar2 ) are now becoming explorable world fragments. Using the LoRAs trained on Alejandro's datasets, paper compositions on my desk are passed through the realtime Diffusion pipeline, then turned into 3D Gaussian Splats using ML Sharp.⁣
⁣
#diffsuion #GaussianSplatting #MLSharp #SparkJS #AI

[Hugues Bruyère @smallfly]

@martin_casado @halecar2 Thanks! The realtime web rendering is done with @sparkjsdev 🫥

[Hugues Bruyère @smallfly]

The scenes coming out of The Latent Space (a collaboration with Alejandro Cartagena / @halecar2 ) are now becoming explorable world fragments. Using the LoRAs trained on Alejandro's datasets, paper compositions on my desk are passed through the realtime Diffusion pipeline, then turned into 3D Gaussian Splats using ML Sharp.⁣
⁣
#diffsuion #GaussianSplatting #MLSharp #SparkJS #AI