William Fleshman

US Army & PhD student at Johns Hopkins University

[William Fleshman @willcfleshman]

Did you know that LoRA A matrices can be frozen at init w/o degrading performance? 🤯
We leverage this trick to construct an unsupervised routing procedure that achieves identical performance to the previous best with orders of magnitude fewer FLOPs and ~50% less GPU memory. 🧵

[William Fleshman @willcfleshman]

@investingidiocy Great stuff. I've been tinkering with copulas for doing something on the spectrum of fake->real data. Real correlation structure/fake marginals or real marginals (through ECDF) and fake dependence structure (tail dependence or correlation generally). Quite a nice framework.

[William Fleshman @willcfleshman]

@NandoDF I'm not affiliated with them, but I love this idea to address exactly that:
https://t.co/xoxOxRTDSt

[Nir Zicherman @NirZicherman]

AI is making you stupid. Today, we're introducing the all new Oboe, designed to make you smarter.

Think about the last 10 answers you got from an LLM. How many of them do you actually remember? Probably none, because LLMs are not good teachers.

But @oboelabs helps you learn the way humans are supposed to: through guided conversations, frequent checks for understanding, real-time adjustments, and multiple formats for all learning styles.

Here's everything we're introducing today:

[JHU Computer Science @JHUCompSci]

Congratulations, @willcfleshman!

[Benjamin Van Durme @ben_vandurme]

JHU mmBERT extended from 8k to 32k token length by vLLM Semantic Router Team. Cutting edge results on 1,800+ languages, now with longer context!
https://t.co/maN3bT1X17

[William Fleshman @willcfleshman]

@ChromeHODLs @hillery_dan That's definitely easier, just might not be optimal depending on your tax situation. Assuming you can almost capture both rates, swapping back and forth with T-bills would compound faster up to a 25% tax. Tax free accounts, if available, is the real way to go.

[William Fleshman @willcfleshman]

@ChromeHODLs @hillery_dan Opportunity cost. If you can capture the dividend by only tying up your capital for a couple of days then the rest of the month that capital can be making money elsewhere.

[William Fleshman @willcfleshman]

@EdwardRaffML Maybe it's you that has 0 recall and precision 🤯

[William Fleshman @willcfleshman]

@jackjingyuzhang @AmazonScience Congrats Jack!

[Benjamin Van Durme @ben_vandurme]

Summer '26 PhD research internships at Microsoft Copilot Tuning. Continual learning, complex reasoning and retrieval, nl2code, data efficient post-training.
https://t.co/HM4cKqEhgW

[William Fleshman @willcfleshman]

🚨Check out the paper with @ben_vandurme for more juicy details, like how we improve SpectR and SEQR by calibrating the adapter norms!
https://t.co/xicyvjVO0E

[William Fleshman @willcfleshman]

Did you know that LoRA A matrices can be frozen at init w/o degrading performance? 🤯
We leverage this trick to construct an unsupervised routing procedure that achieves identical performance to the previous best with orders of magnitude fewer FLOPs and ~50% less GPU memory. 🧵

[William Fleshman @willcfleshman]

SEQR provably routes to the same adapters as SpectR, yielding the same high level of task performance at a fraction of the cost 🤑. Like previous unsupervised approaches, SEQR is secure, with no risk of data leakage if LoRA B matrices are kept private!🔐

[Orion Weller @orionweller]

XLM-R has been SOTA for 6 years for multilingual encoders. That's an eternity in AI 🤯

Time for an upgrade. Introducing mmBERT: 2-4x faster than previous models ⚡ while even beating o3 and Gemini 2.5 Pro 🔥

+ open models & training data - try it now!

How did we do it? 🧵

[Marc Marone @ruyimarone]

3T tokens, ~1800 languages, 2 models - we’re releasing mmBERT, a modern multilingual encoder model!

[William Fleshman @willcfleshman]

@jxmnop Cool stuff, when we did RE-Adapt (https://t.co/pHUJmIDZIx) with llama we saw many of the base->instruct weight updates are approx. low rank but some layers were not. You could repeat your experiment with the llama instruct models to see how close to base you actually get.

[Benjamin Van Durme @ben_vandurme]

I am growing an R&D team around Copilot Tuning, a newly announced effort that supports adaptation at a customer-specific level.
Join us! https://t.co/kVocnuTrKN
We collaborate with a crack team of eng and scientists that support the product, also growing!
https://t.co/typyUXfQ8g

[William Fleshman @willcfleshman]

Obviously have to attack you as my main AAAI contact 🤣

[William Fleshman @willcfleshman]

Check out the paper w/@ben_vandurme now on arXiv:

https://t.co/UON3J2P3hN

[William Fleshman @willcfleshman]

SpectR was accepted at @COLM_conf!

Our follow-up work, LoRA-Augmented Generation (LAG), combines SpectR w/ a first pass filtering of adapters using Arrow routing. LAG is significantly more efficient, enabling SpectR like performance with much larger LoRA libraries!

[William Fleshman @willcfleshman]

🚨 Our latest paper is now on ArXiv! 👻
(w/ @ben_vandurme)

SpectR: Dynamically Composing LM Experts with Spectral Routing (1/4) 🧵