Introducing SubQ - a major breakthrough in LLM intelligence.
It is the first model built on a fully sub-quadratic sparse-attention architecture (SSA),
And the first frontier model with a 12 million token context window which is:
- 52x faster than FlashAttention at 1MM tokens
- Less than 5% the cost of Opus
Transformer-based LLMs waste compute by processing every possible relationship between words (standard attention).
Only a small fraction actually matter.
@subquadratic finds and focuses only on the ones that do.
That's nearly 1,000x less compute and a new way for LLMs to scale.
The coolest orbital animation I've seen of Artemis 2
Just really shows you how far away they're flying today and also how precise they need to be to go to the moon
@Sr_Fonseca@MemoriasPez Teneis que hacer video sobre las implicaciones para la seguridad alimentaria mundial del bloqueo estrecho de Hormuz. La ficha de dominó que más asusta.
https://t.co/6dpFQv0FWd
@minchoi Terrible piece of advice. Guys, make peace with the fact that you cannot keep up with AI and just try to learn as much as you can about it without burning yourself out. Your mind is your tool. Keep it sharp but also healthy.
@jluiscava Ese titular es engañoso e injusto. Usaron su IA como herramienta (como Excel, como un software) y se han negado a que su IA se use para espionaje masivo de ciudadanos americanos y para armas sin control humano. Trump los ha puesto en la lista negra.
Hey @metabase I wanted to tell a colleague about your latest release but "explaining what is Metabase to someone" is now only available on Pro and Enterprise versions.
@GustavoBolsa Lo que necesita son listas abiertas y transparencia total y absoluta del gasto. División de poderes real y ajuste de los salarios de los gestores públicos para atraer a los mejores y más preparados en lugar de a los perros falderos de los partidos. Lo demás sale solo.
I've been using the Internet since 1996. Surprisingly, this is the very first time that I've read something like this at the end of an email from an automatic service. Why is this so rare to see?
Kudos to @instapaper
@MatthewBerman In my experience (mostly local 32b and 70b llms) if a project blueprint is not provided often they loop over incompatibilities between python dependencies for a long while. I guess context window is the main culprit here.
Let's normalise picking up spam calls on your birthday and thank them for remembering your day. Keep talking to them about how much this means to you until they hang up.
@kastiel_modra Nemali by ste používať neumývateľné akrylové farby na maľovanie papierových jabĺk pre malé deti. Je to nezodpovedné a hlúpe, zvlášť keď ich nie ste schopní dozorovať a ani o tom neupovedomíte rodičov! Máme zbytocne zničenú bundu za 60€.
The holy grail of retrogaming upscaling has been announced: Retrotink-4K - Upscaling ANY retro system to 4K 60fps (but prepare your wallet) https://t.co/EDQ0xPGmUm
Hey @whatgeekfans can you please explain your customer service team that a xbox controller is not a pro2 controller. Someone sent the wrong product and I'm tired of explaining them the obvious. Thanks.
@toyota_europe, bad #customerexperience. 1st year's check for my #COROLLA TS: Wless charging still doesn't work bc "newer phones don't work" (#samsung S22+) and the #hybrid system wasn't check at all bc "the softw. is under maintenance" I'll have to go back. My time is not free