Dan Dangond

Software Engineer @Pulley / CS + Comparative Media Studies @MIT

[Dan Dangond @DanDangond]

@notmahi @LerrelPinto @JitendraMalikCV @berkeley_ai @AIatMeta Congrats Dr. Shafiullah!!

[Dan Dangond @DanDangond]

@asferrisicansee Sorry to inform you that the Japanese is wrong and effectively says drunm bass

[Dan Dangond @DanDangond]

@asferrisicansee They do sick tricks at skate parks look at them go

[Dan Dangond @DanDangond]

@asferrisicansee @demiurgently you need to stop dying on hills man

[Dan Dangond @DanDangond]

@cleavelandtao @itseieio Unfortunately, I think Queens is hundreds of boards away from the edge 😬

[Dan Dangond @DanDangond]

@cleavelandtao @itseieio Just found out about Rooklyn, but here's Queens

[Mahi Shafiullah 🏠🤖 @notmahi]

Robot Utility Models (RUMs) enable basic tasks – door opening, drawer opening, object reorientation, etc. – at ~90% accuracy without ANY finetuning (i.e. zero-shot) in unseen new environments.
Fully open source!!! models, data, code & hw.
We think this is super exciting, why?👇

1. Unlocks many practical home utility tasks that often involve these basic tasks as part of an action chain. “Go get me a fork” involves opening the kitchen door and then opening the cutlery drawer.
2. This works well **zero-shot in unseen and new** environments, which is practically a huge deal. Turn the robot on, and get going.
3. The recipe for building a new model is fairly generic, and we think with a bit more refinement this can be a general recipe to build many more Utility models.
More details and access 👇

[Dan Dangond @DanDangond]

@francoisfleuret I've only just now come across your generated culture work, having read the PDF you've linked on your website. I would assume more models would decrease the odds of this trick succeeding, is there a reason there are 3 models now instead of the 5 in Self-Generated Culture?

[Dan Dangond @DanDangond]

@TodePond Woah woah woah tldraw is available as a library?? How did I never check the about page before, that's amazing!

[Dan Dangond @DanDangond]

@gabitheleaf Truuuuuue

[Dan Dangond @DanDangond]

Y'all better hop on over to Puzzmo for today's daily crossword, written by yours truly! I had tons of fun making it and hopefully you'll enjoy it! It's short and sweet!

[Anthony Tešija @AntonTesh]

I make wacky local multiplayer experiences with midi controllers that are installed in spaces. This one has the crowd controlling visuals and parameters of the game using a midi controller while 4 players battle in a glitchy mess of audio reactive visuals!

#gamedev #unity

[Dan Dangond @DanDangond]

@elder_plinius @simonw prompt injection via manipulated image seems like something you'd find very interesting

[Anthony Tešija @AntonTesh]

I made a 4-? player chaotic local multiplayer battle experience built inside of an audio reactive visualizer. Four players battle while the crowd plays with a grid of 16 knobs and buttons that each affect visuals and parameters of the game.

#indiegames #gamedev #unity

[Dan Dangond @DanDangond]

@simonw Is there a way to use it with your llm tool atm or will there need to be an update first?

[Dan Dangond @DanDangond]

@asfarazicansee 🤔

[Dan Dangond @DanDangond]

@simonw I named the script `stt` and this makes it so I don't have to remember specific arguments (the int8 flag allows it to run on apple silicon, won't work otherwise), simply `stt file.mkv` and then let it run.

[Dan Dangond @DanDangond]

@simonw I can rec WhisperX, found it when looking for a solution with builtin diarization (speaker recognition), and it's generally *really* fast. I use it via this shell script: /opt/homebrew/Caskroom/miniconda/base/envs/whisperx/bin/whisperx --model large-v3 --compute_type int8 "$@"

[Dan Dangond @DanDangond]

@thelastnode @simonw This is exactly the kind of thing I was looking for, thanks!

[Dan Dangond @DanDangond]

@simonw Hey Simon, out of curiosity, how do you decide which quantized version of llama 3 to use? I noticed you suggested Q4 on your blog and was wondering what tradeoffs you've noticed if any between it and the versions on either side.