Charles Niu

Co-founder @ Frisson Labs | Oto Companions | of Empires nerd |

[Charles Niu @coatol5]

@soleio 10/10 show. Unlike any other

[rohit @bicro_]

trained a MIRA style multiplayer pong world model on a single RTX 5080. I used their training code + added audio, so every pixel and sound is denoised from the same latents (no game engine anywhere).

this clip is the model playing itself in realtime

[Charles Niu @coatol5]

Drawing from latent space is like drawing from the divine

[Charles Niu @coatol5]

@NathanFlurry Sometimes I wonder if AI voice faces the VR problem

[Charles Niu @coatol5]

@prestonattebery @_imdawon @spawn posting spawn to the guy who made @SmirkGames is kind of wild.

Re the topic - we're peripherally in this space, would love to chat regardless.

[Charles Niu @coatol5]

@omarsayha Big congrats!

[Charles Niu @coatol5]

I guess I’ll add a further point - I wonder if future storytellers will mythologize this era of indie game developers.

Indie games are already so culturally influential. And the generation that is coming of age was exactly their market.

Maybe when the controversial politics of this era subside we’ll see people lionize some of these figures again.

[Charles Niu @coatol5]

The indie game developer occupies the same space in cultural mythology as the American cowboy.

Maverick, independent, able to shape/tame the world in their image (only in this case, it’s a virtual one).

It’s part of what makes indie game development so popular. “I” don’t have to listen to the out-of-touch leadership. “I” don’t need your tools - I’ll just build them myself. “I” don’t need to follow timelines, I’ll take 10 years or however long I want.

I have no further point. Just wanted to share a shower thought.

[Charles Niu @coatol5]

@lefthanddraft We did a similar experiment for roblox: https://t.co/SJxv8JQK6k

But something we didn't publish - We also did a similar experiment for an Age of Empires clone we made in house. Used gemini to control the 2nd player in the game. The user could chat with them and command them.

[Charles Niu @coatol5]

@ZDi____ @Clavicular0 wait holy shit this was funny was fuck LOL

[Charles Niu @coatol5]

@Kangwook_Lee Yep! We tried this out when it came out last year😀

[Charles Niu @coatol5]

Are SMEs “slaves”? Is the sword more noble than the fully autonomous drone? Is data collection the new “rare earth mining”?

This past weekend we read through parts of the Pope’s Magnifica Humanitas encyclical. Lots of spirited debate with people working on the exact things the Pope is pontificating about.

First time we’ve held a “reading group” at Frisson Labs. 10/10 I’ve realized I’m exactly this kind of nerd. Huge shoutout to @qualiaspace for the invite!

[Charles Niu @coatol5]

Kyutai Moshi paper for reference: https://t.co/rn8l4iHWtQ

[Charles Niu @coatol5]

The first time we read through Kyutai’s Moshi paper on full-duplex voice we were left thinking:

“There’s no way this should work... but somehow it does.”

If you’ve also found yourself struggling to build an intuitive understanding of how Moshi works, we put together a visual guide for the paper (a "Moshi for Mere Mortals", if you will - linked below).

We made this because we wish we had something like this when we first started. Our ultimate goal is building full-duplex voice that can understand virtual worlds. If this sounds interesting let’s have a chat :)

[Charles Niu @coatol5]

Post: https://t.co/JJKf8Nszzg

[Charles Niu @coatol5]

That’s a wrap for Frisson Lab’s first ever game night! It was so much fun bringing this collection of gamers, researchers and developers together to do what AI still cannot - chill and play games!