Kartik

Engingeering lead for @Roblox Assistant. Past: Smart Reply @GoogleAI, cofounder LetterFeed (exit: @Google), @utcompsci. Opinions not my employers.

[Kartik @ayyar]

We have released a new agentic frontier eval for Roblox game development in Lua.

https://t.co/iB32IWW6Cy

Gemini Flash 3 is currently the best model for Roblox game development.

Congrats @JeffDean @OriolVinyalsML @demishassabis and team - you really cooked !

[Kartik @ayyar]

@TimSweeneyEpic One big question is what the memory bandwidth will be.

[Kartik @ayyar]

@yacineMTB When I worked at Google we never even had GPUs on our local workstations, so we would have a set of hyper parameters that would let us train a smaller version on TF CPU + had unit tests. And then just launch borg jobs for the real deal.

It was a pretty decent setup overall.

[Kartik @ayyar]

@sonyatweetybird @ellev3n11 @cursor_ai @dzhulgakov @FireworksAI_HQ Awesome work @ellev3n11 ! 😀

[Kartik @ayyar]

@dharmesh You cannot compensate for a fundamentally lower quality model beyond a rather low ceiling by doing things by prompting / context engineering .

True intelligence is in the weights. Otherwise we’d by using cheap models / not burning large amounts of GPU compute for better models

[Kartik @ayyar]

@dharmesh I think you are mixing up harness vs context. Great harnesses respect the bitter lesson and mostly get out of the way and let the model drive by calling the LLM in a loop.

And the more “smart” your harness is, the more it interferes with the skill expression of the raw model.

[Kartik @ayyar]

Super exciting.

[Geoff Keighley @geoffkeighley]

Epic Games has teased Unreal Engine 6.

[Kartik @ayyar]

@Onogork Cool.

[Kartik @ayyar]

@altcap @American_Heart @Ctr4HeartAtkPrv @DrOz Thanks to you, I got mine done a few months ago. Everything was okay and it gave me peace of mind. 🙏🏽

[Kartik @ayyar]

@VictorTaelin @lukaszkaiser

[Kartik @ayyar]

@lukaszkaiser Nice, will play around with it this long weekend.

[Kartik @ayyar]

@lukaszkaiser

[Kartik @ayyar]

@lukaszkaiser That said a lot of innovation - especially UX innovation - accepts remixing as a practice.

If the end users problem gets solved and more people are productive, IMO that’s the important part.

[Kartik @ayyar]

@Onogork Nice. Did you use Assistants generative version or write your own generator?

[Kartik @ayyar]

@TimSweeneyEpic Thank you for continuing to fight for the fundamental rights of developers. 🙏🏾

[Kartik @ayyar]

Procedural models in Roblox are super fun!

[Dino @dub_dino]

Building with Procedural Models! 🔨 (part 2)
#Roblox #RobloxDev

[Logan Kilpatrick @OfficialLoganK]

The model is the product

[Kartik @ayyar]

@OfficialLoganK Love the privacy, consistency and temperature / music personalization.

[Kartik @ayyar]

@agarwl_ @_arohan_ Why the exception for ReLU?

[Kartik @ayyar]

@sleitnick Nice. What are the most salient differences vs Roblox?

[Kartik @ayyar]

@adityaag Loved this.