Dev Patel

21 | Member of Technical Staff @BoardyAI | Previously Founding Engineer @ , AI @Fidelity | Agents, Voice, LLMs

[Dev Patel @_devp]

@akshay_pachaar 0.5 GB on a light weight model is completely fixated on fine tuning to your own needs, this is what we need in the open source!

[Dev Patel @_devp]

@RyanOlunix @SouravGRoy @boardyai 🫡

[Dev Patel @_devp]

@omooretweets @ElevenLabs @Techweek_ @0xaneri voice ai is the future

[Dev Patel @_devp]

@owengretzinger great minds *look* alike

[Dev Patel @_devp]

@andrewdsouza @owengretzinger 😭😭

[Dev Patel @_devp]

@owengretzinger toronto > sf

[Dev Patel @_devp]

@demian_ai it’s hard to convey this to most people but once people understand that when we hit the “collective” ceiling as to how capable llms can really be-that’s when everything downstream in the stack related to inference becomes more important.

waiting for that that inflection point

[Dev Patel @_devp]

@ElevenLabs cool!

[Dev Patel @_devp]

@owengretzinger 🫡
https://t.co/WTzdwqcWBv

[Dev Patel @_devp]

it took a waterloo cs student to find this one line that everyone else missed lol

[Dev Patel @_devp]

undoing positional encoding before compressing the K cache....simple idea that nobody was doing, unlocks 10x KV cache compression with zero accuracy loss

[Krish @krishgarg]

i just beat @GoogleDeepMind's turboquant

introducing Shard. 10x KV cache compression on Llama-3.1-8B. zero quality loss

- 10x @ 8K context, 11.2x @ 32K
- NIAH recall 1.000 across 4K-32K
- LongBench Δ ≈ 0 vs FP16

turboquant tops out at 4-6x at the same quality. we doubled it.

read more: https://t.co/PAV5WdAzN6

@kirrithan

[Dev Patel @_devp]

@babugi28 @boardyai know anyone from either of those that you can put in contact with Raj?

[Dev Patel @_devp]

@tejasthind4 waiting on the influencer videos with the meta glasses @shamsharoonn

[Dev Patel @_devp]

@linear @owengretzinger

[Dev Patel @_devp]

@BhosalePratim @neilzegh full duplex will be the new norm soon!

[Dev Patel @_devp]

@adeel_712 @ollama building in public 🙃

[owen @owengretzinger]

https://t.co/WM30qxQuYd

[Dev Patel @_devp]

@meggmcnulty @boardyai can you help Meg out? Do you know anyone that’s a good a fit?

[Dev Patel @_devp]

@JamesBondsama Amazing read! Say this a lot but you’re literally at a disadvantage if you’re not in Boardy’s network! He handles and works for you even when you’re not talking to him

[Dev Patel @_devp]

@kylejeong @X @browserbase @nikitabier @boardyai do you know anyone from X that could help Kyle?