Alex Wang

Eng @ Uwaterloo | building and learning

[adam @selimaz_]

O1 VISA APPROVED LFGGG 🇺🇸🇺🇸🦅🦅

[Krish @krishgarg]

i just beat @GoogleDeepMind's turboquant

introducing Shard. 10x KV cache compression on Llama-3.1-8B. zero quality loss

- 10x @ 8K context, 11.2x @ 32K
- NIAH recall 1.000 across 4K-32K
- LongBench Δ ≈ 0 vs FP16

turboquant tops out at 4-6x at the same quality. we doubled it.

read more: https://t.co/PAV5WdAzN6

@kirrithan

[Alex Wang @AlexSomtingwang]

@krishgarg @GoogleDeepMind holy moly

[Ryan @ohryansbelt]

@karpathy this is like KD joining the 72-9 warriors

[nic @nicholaschen__]

the more internships i do, the more work i do, the more i learn, the more i realize how much i actually don’t know when it comes to software engineering

[Alex Wang @AlexSomtingwang]

@nicholaschen__ last 5% of a project always takes up 95% of the time

[Alex Wang @AlexSomtingwang]

@JaedonVisva @Replit Nah

[Alex Wang @AlexSomtingwang]

@GuiBibeau @UWaterloo Hi

[Alex Wang @AlexSomtingwang]

Back to making it out

[Alex Wang @AlexSomtingwang]

@JohannesTampere @imdonghakim This is tuff

[Alex Wang @AlexSomtingwang]

Finishing deadlines with jet lag has to be one of the worst experiences oat

[Alex Wang @AlexSomtingwang]

@utosrad Relevance, relevant and relevant retrieval

[Alex Wang @AlexSomtingwang]

@utosrad 10x engineer here

[Alex Wang @AlexSomtingwang]

@kabirj_25 @lunarfq hi

[Alex Wang @AlexSomtingwang]

@selimaz_ @jalen_cheng We missed you too bro

[Alex Wang @AlexSomtingwang]

@JayChopra_ ?

[Alex Wang @AlexSomtingwang]

@yasbehiri @vallodev Hi

[Alex Wang @AlexSomtingwang]

@selimaz_ @jalen_cheng @vallodev Interested!

[Alex Wang @AlexSomtingwang]

@yasbehiri @WaterlooENG @UWaterloo Ok on it

[Alex Wang @AlexSomtingwang]

@kabirj_25 @instagram Wonder who Indian lesbian is