Sigmund Hennum Høeg

Aspiring roboticist, Ph.D. at NTNU. I like to be outside while skiing, climbing, and hiking. Music enjoyer and amateur practicioner.

[Chris Paxton @chris_j_paxton]

Video action models are data efficient and allow robots to learn complex dexterous tasks. Learn more in our episode with @elvisnavah of @mimicrobotics ->

[mimic @mimicrobotics]

First look at our collaboration with @AudiOfficial on bringing AI-driven robotics into industrial production.

Our end-to-end pixel-to-action model, running on our bi-manual platform, is capable of performing a complex, dexterous and long-horizon insertion task.

[Sigmund Hennum Høeg @sigmundhh]

@siddancha @physical_int Thanks for doing these small summaries! Definitely want to read the paper now

[mimic @mimicrobotics]

Today, we’re excited to announce our $16M seed funding round, accelerating our mission to deploy frontier physical AI across industries.

Led by @Elaia_Partners alongside @speedinvest, with participation from Founderful, 1st Kind, 10x Founders, 2100 Ventures, Sequoia Scout Fund.

[Sigmund Hennum Høeg @sigmundhh]

@GoogleDeepMind I wonder, as these models become smarter, that we'll see the user (ourselves) becoming an escalated bottleneck. We often need to able to interpret the reply to make use of it. E.g. the proof in the video has little value if no human can understand or validate it.

[Sigmund Hennum Høeg @sigmundhh]

@ZeYanjie Yes, I also wonder how the teleoperation interface is! It has to be extremely low latency to allow for this behavior

[Sigmund Hennum Høeg @sigmundhh]

Thank you for the fruitful collab, @du_yilun!

[Yilun Du @du_yilun]

Introducing Streaming Diffusion Policy (SDP)!

SDP allows you to generate actions using a single denoising step, with no distillation!

SDP keeps an action buffer of partially denoised future actions, which is refined over time.

https://t.co/AsaBZJaSBS

Led by @sigmundhh

[Sigmund Hennum Høeg @sigmundhh]

@julianibarz I think so, too! We explored this in our paper on TEDi Policy (https://t.co/5BFrpdbAz1) We implement this for a control policy and show that it increases the control frequency drastically while performing well

[Sigmund Hennum Høeg @sigmundhh]

@du_maximilian Nice writeup, Max!

[Sigmund Hennum Høeg @sigmundhh]

@SashaKhazatsky I want all research videos ever to adopt this format

[Sigmund Hennum Høeg @sigmundhh]

@tonyzzhao @GoogleDeepMind That throw 🤩 Didn't think this would be in the domain of IL already

[Sigmund Hennum Høeg @sigmundhh]

@peteflorence Tangential to this are the inner "visual maps" of the year, month, and week. They're fun to draw out and show to friends!

[Sigmund Hennum Høeg @sigmundhh]

You know your code is bad when all the copilot suggestions have spelling errors

[Sigmund Hennum Høeg @sigmundhh]

@ericjang11 This is so cool! Congratulations to the whole team 🎉

[Sigmund Hennum Høeg @sigmundhh]

@shahdhruv_ @corl_conf @d_yuqing @pratyusha_PS @xiao_ted @mohito1905 @StefanieTellex @brian_ichter @_jessethomason_ Excited about this! By the way, is there an error in the OpenReview deadline? The website says Oct 28th AoE, but it seems like the deadline on OpenReview is out already :)