marmot_angora.d

Failed to modify the bio '/us/cascadia/or/pdx/cloud/mm' ERROR: properties '/love/greatblackmusic' and '/go/camping' referred to by '/must/getmoney' are invalid

[marmot_angora.d @matdmorgan]

Stop shopping at @MudBay stores, the treatment store workers are currently receiving from inept mgmt who have tanked company finances w terrible decisions is inexcusable.

[marmot_angora.d @matdmorgan]

Brutal. Send Jungle, stat.

[SHERELLE 🌐 @iamsherelle]

Pls RT 😭🙏🏿

I have been mugged in Brussels.

And I have lost everything.

All music + production bits are gone now 🥺

Music friends ONLY. You know who you are...

Please send me music because I have NOTHING.

Send to promos[at]https://t.co/qrmwXKBuKQ

Much appreciated x

[marmot_angora.d @matdmorgan]

@RLStollar @C_Stroop Oh man I too got the Spoons. Mom got extra mad when one broke while hitting me, my fault I suppose. As an adult with many wooden utensils I marvel that she managed to break them.

[John Higgs @johnhiggs]

OUT TODAY! The new hardback 10th anniversary edition of THE KLF, complete with new author's commentary - and @wnbooks have a couple of copies to giveaway, just RT to enter. #KLF

[marmot_angora.d @matdmorgan]

Black Mirror real-time

[Cameron R. Wolfe, Ph.D. @cwolferesearch]

Recent research on language models has aimed to increase the maximum allowable context length of the underlying model. But, how can we enable an LLM to handle longer inputs? One way is through the use of ALiBi…

Vanilla position embeddings. Decoder-only transformer architectures create an input sequence of tokens by first tokenizing the raw text and looking up the embedding (each token in the tokenizer’s vocabulary has a unique embedding) for each token. Then, we add a positional embedding to each token embedding, which injects positional info into the embedding of each token in the sequence.

Why is this necessary? We should recall that the self-attention operation is agnostic to the position of a token in a sequence! The only way to consider the position of each token when computing self-attention is to inject such information into each token’s embedding or into the attention computation itself.

ALiBi > position embeddings. Attention with Linear Biases (ALiBi) gets rid of positional embeddings altogether. Instead, positional information is injected into the transformer as part of the self-attention operation via adding a penalty to the key-query attention score. In particular, we should recall that self-attention computes an attention score between each pair of tokens within a sequence. ALiBi operates by adding a static, non-learned bias to this score that is proportional to the distance between the pair of tokens.

The result. Such an approach is impactful because it depends on the pairwise distance between tokens rather than the absolute positions of tokens within a sequence. This quantity is less dependent upon the length of the underlying sequence and allows ALiBi to generalize much better to sequences that are longer than those seen during training. For example, MPT-7B (which uses ALiBi) can be fine-tuned on sequences as long as 64K and reasonably extrapolate to much longer sequences of 84K tokens.

[marmot_angora.d @matdmorgan]

Every business owner that cares about equal rights now has a near-obligation to refuse service to anyone deemed an evangelical xtian. Cross jewelry, Jesus bumper stickers, open prayer in restaurants before meals etc should become broadly unwelcome.

[Earthjustice @Earthjustice]

Today’s decision gives businesses a license to discriminate. It's an attack on LGBTQ people, and we join our partners in condemning this decision. The LGBTQ community deserves to live openly, authentically, and without fear.

[marmot_angora.d @matdmorgan]

@GoodLuckUNeedIt @jvegapederson That meeting was an enraging circle jerk, was screaming at my phone through much of it.

[marmot_angora.d @matdmorgan]

@GoodLuckUNeedIt @jvegapederson @SMeieran @BrimJulia @RepJayapal @blairgbest Agreed & thx for posting the vid

[marmot_angora.d @matdmorgan]

@diane_pagen @GoodLuckUNeedIt @TheDemocrats Uh… this is a lie. He tried, missed the part where he failed.

https://t.co/48Lj7i1Eku

[Kamil Galeev @kamilkazani]

Where is Russia going?

Prigozhin's mutiny looks shady. And that is fine. Many coup stories sound shady even in retrospective, as they often included some elements of 4D chess by the political leadership. Still, their consequences were real.

So let's talk of the consequnces🧵

[southpaw @nycsouthpaw]

I think it’s fair to say that Singer’s main business, at least in the debt world, is/was to have Elliott buy up obligations viewed by consensus as nearly worthless, given the state of the governing law, and then changing the law to achieve much better returns.

[Jennifer Berry Hawes @JenBerryHawes]

A graduate history student at @CofC has discovered what appears to be the largest known slave auction in U.S. history.

When Lauren Davila spotted the 1835 ad to sell 600 enslaved people in Charleston, SC, she thought it might be a typo.

It would set a grim new record, by far.

[regular steve albini @electricalWSOP]

Thread:
I work in an arcane field where the job requires specific technical knowledge, built on a ladder of understanding and breakthroughs going back over 100 years. It's not immunology but it's not nothing.

[John Oliver @iamjohnoliver]

Dear Reddit, excellent work. Attn: r/pics — have at it...

[marmot_angora.d @matdmorgan]

@FatihTheAce @GergelyOrosz It really never was? ‘Cloud Domains’ still exists as a GCP product…crystal clear and reassuring right?

[marmot_angora.d @matdmorgan]

@CConnTtr @StanleyRoberts ‘Easy street camping’…’no worries’?
Reductive cruelty helps no one, try empathy.

[marmot_angora.d @matdmorgan]

This is such horseshit copaganda - PPB does nothing, gives no tickets, urges no treatment anywhere downtown. Take their $$ for services. https://t.co/bhgHUs1wtx

[Dr Thomas Smith 🔥🌏 @DrTELS]

Things began to look very unusual two months ago.
Today the charts need no commentary, they speak for themselves.
This is the Atlantic.
https://t.co/P26XnJmKj6