NEW FOOD PANTRY: Stop & Shop donated over $12,000 and a refrigerator to the Shinnecock Indian Nation for a brand-new, in-school food pantry for children in need.
https://t.co/8z4QPuehZY
@Culture_Crit Historically, color has been a powerful symbol of identity.
Vibrant architecture showcased regional pride, while colorful art expressed unique cultural narratives.
Globalization is eroding these distinctions.
META JUST KILLED TOKENIZATION !!!
A few hours ago they released "Byte Latent Transformer". A tokenizer free architecture that dynamically encodes Bytes into Patches and achieves better inference efficiency and robustness!
(I was just talking about how we need dynamic tokenization that is learned during training 🥲
It's like fucking christmas!)
I don't want to talk too much about the architecture.
But here's a nice visualization from their paper.
Let's look at benchmarks instead :)
"BLT models can match the performance of tokenization-based models like Llama 3 at scales up to 8B and 4T bytes, and can trade minor losses in evaluation metrics for up to 50% reductions in inference flops!"
This is basically a perplexity vs training flops chart - scaling laws with compute. BPB is a tokenizer independent version of perplexity.
BLT is on par or better than LLama 3 BPE!
Most importantly they scale this approach to train Llama-3 8B model on 1T tokens which beats the standard Llama-3 architecture with BPE tokenizer!
You can borrow strength from the future.
Close your eyes.
See yourself taking all the necessary steps required for you to become who it is you wish to be. See it all working out. Flawless action. One after another. Day after day. See the momentum stacking and compounding.
Connect with that future version of yourself. See who it is who you would become if you embraced your potential fully and fearlessly charged toward it with everything you’ve got. Feel their strength. Feel their power. Feel how incredible, how electric—it feels to be in those shoes.
And bring those feelings back with you to the present moment.
@unpopularcheer@ScheibeIsabella Thats not always legal in the college nca score divisions there are rules about what can be watered down until your routine is not legal in your level