eudalt hernandes

Computer science engineering student. I dabble in game development. Video games are my passion

[eudalt hernandes @peuhean]

@LittleLanternGS goty already

[Locomochi🚂✨ @LittleLanternGS]

HIT ME BABY ONE MORE TIME

[Radix @NombreFalso1231]

La vida adulta bajo el capitalismo es esto

[Moises @Mowgli420]

Jeje siempre llegan con este argumento jajajaja.

[Dutch Baneado @May0rDutch]

Nunca dudéis del perro.

[Smooth Dunk @SmoothDunk]

it was a Roman Salute!

[雉粕喵 @regice_kijinyan]

┏━┛┃
┗━┓┃ ┏━━┓┏━━┓┏┓┏┓
┏━┛┃ ┃┏┓┃┗━┓┃┃┃┃┃
┗━━┛ ┃┃┃┃┏━┛┃┃┗┛┃
┏━━┓ ┃┃┃┃┃┏━┛┗━┓┃
┗━┓┃ ┃┗┛┃┃┗━┓ ┃┃
┏━┛┃ ┗━━┛┗━━┛ ┗┛
┃┏━┛

[Blake ™ @NeilNevins]

surprised they’ve never made the stoner Christmas movie where the wrong cookies get left out for Santa and the friend group who were planning on getting baked have to deliver the presents in his stead

[Lisan al Gaib @scaling01]

META JUST KILLED TOKENIZATION !!!

A few hours ago they released "Byte Latent Transformer". A tokenizer free architecture that dynamically encodes Bytes into Patches and achieves better inference efficiency and robustness!

(I was just talking about how we need dynamic tokenization that is learned during training 🥲
It's like fucking christmas!)

I don't want to talk too much about the architecture.
But here's a nice visualization from their paper.

Let's look at benchmarks instead :)

"BLT models can match the performance of tokenization-based models like Llama 3 at scales up to 8B and 4T bytes, and can trade minor losses in evaluation metrics for up to 50% reductions in inference flops!"

This is basically a perplexity vs training flops chart - scaling laws with compute. BPB is a tokenizer independent version of perplexity.

BLT is on par or better than LLama 3 BPE!

Most importantly they scale this approach to train Llama-3 8B model on 1T tokens which beats the standard Llama-3 architecture with BPE tokenizer!

[katie @katefeetie]

is the left “obsessed” with gender, sexuality, race, etc, or are they just constantly having to defend people in marginalized groups against a right wing that’s ACTUALLY obsessed with gender, sexuality, race, etc

[caòtica @eva_elies11]

Pregunta seriossisima, que collons significa ser una persona ADULTA?!?!

[eudalt hernandes @peuhean]

@bluewmist This is absolute bullsh*t

[BRONCA @BroncaDIY]

Estamos muy contentes de presentar nuestro primer poemario a cargo de Larry: poesía poliédrica, íntima y cruda. El viernes 25 presentación en Bronca y lanzamiento en la web. ¡Nos vemos allí!