Haresh Karnan

RL post-training @ Amazon AGI | PhD-UTAustin

[Haresh Karnan @KarnanHaresh]

Introducing STERLING 💫: "Self-Supervised Terrain Representation Learning from Unconstrained Robot Experience" 💫 to be presented at CoRL 2023 in Atlanta! 😀

Project Page 🌎: https://t.co/TtNbgZTnjR

Paper 🗞️: https://t.co/12YxBOnFVG

A thread 🧵

[Haresh Karnan @KarnanHaresh]

@YichuanM Have you looked at miles ? It's a fork of slime

[Haresh Karnan @KarnanHaresh]

@natolambert @eliebakouch @dwarkesh_sp @srush_nlp +3

[Haresh Karnan @KarnanHaresh]

@_MaxBlade You need to override in settings. It's using whatever's the default

[Haresh Karnan @KarnanHaresh]

@li78658171 Nice work! qq: the Information Gain ablation uses magnitude only, but IG is signed, and that sign looks like the per-token direction KL throws away. Curious whether you tried using IG's sign, rather than its magnitude ?

[Haresh Karnan @KarnanHaresh]

@hallerite @emaadmanzoor Curious, what in verl do you find is painful ?

[Haresh Karnan @KarnanHaresh]

@ThereseMaggie @_arohan_ I meant the IdlyExpress / Mylapore chain of restaurants (you’ll find them in South Bay). I remember reading somewhere they have an idlyexpress branch open in SF recently

[Haresh Karnan @KarnanHaresh]

@ThereseMaggie @_arohan_ Didn’t they open an idly express in SF?

[Vana AI @Vana_Meeting_AI]

The Cost of Ambiguity: There’s a massive, painful gap between knowing a mental model and applying it exactly when the conversation needs it most. Every Founder, PM, and Exec we spoke to knows this pain. And the result: Meetings dissolving into opinion, or worse, ending with a vague "let’s revisit this next week". 😩

Introducing 🥁 Vana AI. It's not a note-taker. It's not an action-item generator. It’s your proactive AI strategic thinker for real-time insights in meetings.

[Haresh Karnan @KarnanHaresh]

@Devvrit_Khatri @louvishh @rish2k1 @rach_it_ @dvsaisurya @brandfonbrener @agarwl_ nice work! By any chance, did you ablate the sampling temperature in GRPO/DAPO across tasks?

[Haresh Karnan @KarnanHaresh]

@jbohnslav Time to bring back inperson interviews

[Haresh Karnan @KarnanHaresh]

@gowthami_s https://t.co/FoC91fefUr
relevant work on interleaving SFT and RL

[Haresh Karnan @KarnanHaresh]

@ArmenAgha How does this compare to mds ?

[Haresh Karnan @KarnanHaresh]

@iScienceLuvr Tesla is an appreciating asset ?

[Haresh Karnan @KarnanHaresh]

@jaredpalmer @github @pimoroni waaaant!

[Haresh Karnan @KarnanHaresh]

@natolambert Congrats! 🎉

[Haresh Karnan @KarnanHaresh]

@natolambert 💯

[Haresh Karnan @KarnanHaresh]

@sivareddyg @YejinChoinka Thanks for sharing! Is the full recorded talk published on YouTube?

[Haresh Karnan @KarnanHaresh]

@willccbb @trungthvu verl does support all of that. The default params aren’t the most efficient

[Haresh Karnan @KarnanHaresh]

@public_steve @kohjingyu have you heard of "uvx nvitop" ?

[Haresh Karnan @KarnanHaresh]

@Alibaba_Qwen Can your guy see images and videos?