Billy Li

QuantitativeResearcher@twosigma; PhD @LTIatCMU; ex @BoschGlobal; Efficiency & Robustness of Deep Learning, Audio Analytics, Natural Language Processing.

[Billy Li @JunchengLi]

Question: How do we minimize the cognitive overload after heavily using agentic coding? Feels like I can handle single agent workflow very well, but the recent emerging capability of subagents makes it mandatory to play managment role, which is a taxing job itself.

[Billy Li @JunchengLi]

@cocohearts @cocohearts It was a fun experience! Thanks for organizing! Our blog contains more detailed write-ups and thought process and experiments. https://t.co/bfmuU0EN4u
Might be useful to you and the broader community.

[Billy Li @JunchengLi]

@abertsch72 @mechanicaldirk @soldni @kylelostat @HannaHajishirzi @gneubig Great work! @abertsch72 The QK norm takeaway was quite surprising.

[Billy Li @JunchengLi]

@karpathy quick report from parameter-golf writeup (essentially modified nano-gpt @ 10min/16MB):
unfortunately, autoresearch didn't work well. agents implemented & measured beautifully but couldn't drive research; framing & intuition still needed humans.
https://t.co/bfmuU0EN4u

[Haoze He @HaozeHe_Hector]

Location: Hall 3 + Hall 2B Poster #241 at #ICLR2025

Hi, we 'll present our #ICLR2025 work, SMT, as a poster Today April 24 at the 3pm -5:30pm(Singapore) session. It’s a joint work with @JunchengLi, Xuan Jiang, and @heathercmiller. Come to our poster at #241 TL;DR:!

[Billy Li @JunchengLi]

@minhnguyen is this still SoTA half a year later?

[interestinging X @interestingingX]

Ah, the latest on Neuralink's Blindsight getting the FDA Breakthrough tag? Well, it's like Elon Musk's brainchild, Neuralink, just got a gold star from the FDA for its Blindsight implant. This isn't just any old sticker; it's the "breakthrough device" designation, which is the FDA's way of saying, "Hey, this could be a game-changer, let's fast-track this!"

- What's Blindsight? Imagine a device that could potentially restore vision to those who've lost it, or even to those born blind. It's like giving someone a new set of eyes, but instead of going through the usual eye route, it goes straight to the brain's visual cortex.

- The FDA Breakthrough: This designation is for devices that promise to treat or diagnose life-threatening or irreversibly debilitating diseases or conditions. Essentially, the FDA is giving Neuralink a nod, saying, "This could be big, let's not dilly-dally with the red tape."

- Public Reaction: From the posts on X, there's a mix of awe and excitement. People are buzzing about the potential. Imagine being able to see for the first time or regaining your sight. It's like something out of a sci-fi movie, but it's happening, or at least, it's on its way.

- The Tech: While the specifics of how it works inside the brain are still under wraps (or rather, under the skull), we know it involves electrodes and some fancy neural decoding. Think of it as translating brain waves into visual information.

- Challenges Ahead: Despite the excitement, there's a reality check from some corners. High-resolution vision might still be a distant dream due to the complexities of how our brains process visual information. But hey, baby steps, right?

- Looking Forward: Neuralink isn't just stopping at vision. They're also working on helping paralyzed individuals control devices with their thoughts. So, while Blindsight is about seeing, Neuralink's broader goal is about making the brain and technology chat like old friends.

So, there you have it! Neuralink's Blindsight getting the FDA's breakthrough nod is like getting a VIP pass to skip some of the bureaucratic lines, aiming to bring vision to those in darkness, quite literally. It's a step towards making the future not just look bright but also see it.

[Billy Li @JunchengLi]

@zicokolter Congratulations 🎈

[Billy Li @JunchengLi]

@zicokolter Congratulations 🎈

[Billy Li @JunchengLi]

@srchvrs Leo you just speaks the truth, and the truth is not always flashy.🤣

[Billy Li @JunchengLi]

Not everyone needs to work on LLMs, my collaborator Jackson's cool work with Emma Alexander at Northwestern's Bio Vis lab was featured in a Veritasium video, at 29:20: What Jumping Spiders Teach Us About Color https://t.co/ushhH3DkOa via @YouTube

[Billy Li @JunchengLi]

As this debate is getting personal, I should stop wasting time.

[Yann LeCun @ylecun]

Oh your god.

[Billy Li @JunchengLi]

@Leishman Why are you afraid of spreading the truth tho?

[Billy Li @JunchengLi]

@honualx @kyutai_labs Rising trend for rising stars to rise against academia 📈

[Billy Li @JunchengLi]

@SamueleCornell ICASSP needs you more than you need it.😉

[Billy Li @JunchengLi]

@bmspell @PyTorch Question after digging into it:
@bmspell your implementation seem to have very sparse output VS. Torchaudio's version? Torchaudio has another @dpovey1 implementation of pitch detection, seems to only work for speech (sucks at bird sound), Comparatively https://t.co/1SNdQ7r0dn

[Billy Li @JunchengLi]

As schools are only teaching neural nets, lots of the good old techniques are left behind in librosa, opensmile, or praat (who uses Praat in windows...) Torchaudio probably never bother to reimplement these

[Brent M. Spell @bmspell]

An implementation of the Yin algorithm for pitch estimation in @PyTorch: https://t.co/JMNHe0jNoy

[Billy Li @JunchengLi]

@bmspell @PyTorch https://t.co/550WZ9zV4G This is one of the best tutorials I have seen on this. Deserves so much credit!

[Billy Li @JunchengLi]

There are two types of LLMs: those that talk the talk and those that walk the walk. LLM walk the walk sometimes talk the talk but most times they don't talk at all, cus they work… personal impression after using LLaMA, Alpaca, Dolly and of course you know what it is. #LLMs

[Billy Li @JunchengLi]

@HamedZamani @LTIatCMU The talk stood the test of fire alarm