Jonathan Steinberg

Founding Research Engineer, Building safe embodied AI

[Jonathan Steinberg @jonastbrg]

@MerrEngin קריירה, הגשמה עצמית

[Jonathan Steinberg @jonastbrg]

@MidcenturyAI 👨🏼‍🍳👨🏼‍🍳

[Aurel Arnold @aurel_arnold]

HG-DAgger can lead to a worse policy if done wrong.

After the second iteration of intervention data collection I observed that the policy (π2) barely improved on success rate and even had a much longer mean episode duration.

Reason for this is the quality of the interventions. It is hard to correct a policy from a bad situation. Your movements are slower and less smooth than normal demonstrations because you are not in the flow. Too many of such interventions teaches the policy to act slower and generally needs more recoveries.

I found a quick fix for this though: finish the training run during the annealing with clean demonstrations only. This mostly recovers the faster and more precise movement from the demonstrations while keeping the skills to recover from the interventions.

This brought the success rate on our task (full box) up to a 88% success rate.

[Jonathan Steinberg @jonastbrg]

@Eldude86 קנדה

[Jonathan Steinberg @jonastbrg]

@DJiafei Don’t you think it’s mostly AI slop, now entering robotics? It reminds me of the hype around coding agents circa 2024/2025 with generic apps and “see what I’ve “built” with Claude”

Most of the demos here are reusing known, great tools..

[Jonathan Steinberg @jonastbrg]

@ahadj0 They have 3d Keypoints, it’s easy to generate MANO/SOMA based joints

[Jonathan Steinberg @jonastbrg]

@MatanLevi1 @StAJect0r @AmitLeViAI @IlanZendel נתראה בפריז? (:

[Jonathan Steinberg @jonastbrg]

Here we go (:

#NeurIPS

[Jonathan Steinberg @jonastbrg]

@HKydlicek @ch3njus @HKydlicek your blog on hand reconstruction showed real advantages over SOTAs like HaWor.. (tho most of hand reconstruction models currently are non commercial)

[Jonathan Steinberg @jonastbrg]

@HKydlicek @DominiqueCAPaul How about EgoSuite? You find its 3d keypoint annotations good enough?

[Jonathan Steinberg @jonastbrg]

@RotekSong Mmm he just prompts SONIC here which is already a policy capable of doing the task.. sol/gemini/claude or even basic VLM can do that..

[Jonathan Steinberg @jonastbrg]

@TheRealYield זה מגונרט..

[Jonathan Steinberg @jonastbrg]

@FinancialEduX לפחות באזור שרונה יש חניוני צד שמגיעים למחירים סבבה (50 ליום שלם)

[Jonathan Steinberg @jonastbrg]

@YGandelsman @OpenAI 👨🏼‍🍳

[Jonathan Steinberg @jonastbrg]

@muhammdrizwanmr @ultralytics Try EdgeTAM, its amazing

[Jonathan Steinberg @jonastbrg]

@OrianSharoni בואו לרובוטיקה (:
אין קומודיטי בעתיד הנראה לעין

[Jonathan Steinberg @jonastbrg]

@zshobbs Custom SLAM? Of the shelf?

[Jonathan Steinberg @jonastbrg]

@zshobbs Which SLAM you use ?

[Jonathan Steinberg @jonastbrg]

@adjelmohamed Looks great! the focus is on full body motion in general or also exact hand recon?