modernity

the next token is not going to predict itself

[modernity @modern_what]

@krishnanrohit either the 7B-chat is extra sensitive to RLHF or the system prompt is keeping it very nerfed. i would suggest trying out the 70B-chat on huggingchat

https://t.co/1xxKmebeOO

[modernity @modern_what]

@tszzl because they believe the meaning of life is suffering

[modernity @modern_what]

@VCBrags what's stanford and what's a GSB?

[modernity @modern_what]

@ML_PhDer a lot of these "trivial" projects do pay bills

[modernity @modern_what]

@proetrie to be fair it's a dev conference. it would look clownish to constantly talk about "AI" so they used the term "Transformer model" a couple of times

[modernity @modern_what]

@HotForMoot it's so over
we're so back

[modernity @modern_what]

@proetrie why are all the mcdonalds like that on the table

[modernity @modern_what]

@varunram he probably saw it coming but 200 million is a lot of money

[modernity @modern_what]

@tunguz paul krugman had the right vibes

"We wanted flying cars, instead we got 140 characters" - thiel

[modernity @modern_what]

@Sim89776996 @ValueRaider @brickroad7 i’m surprised how little attention the Falcon models have received but it looks like this news is a direct response

an open source 175B GPT-3 will obliterate any competition

[modernity @modern_what]

@ValueRaider @brickroad7 i don't think it's because it's not worth the effort

i'm pretty sure it has more to deal with their business model

[modernity @modern_what]

@amasad hard disagree we're entertaining ourselves to death and we're not bored at all. it's brave new world

[modernity @modern_what]

@brickroad7 "skeptical of how many individuals and companies would have the capability"

lol

[hardmaru @hardmaru]

Another work that chips away at architecture complexity.

Get rid of positional encodings in generative transformers, and just let it learn to do its thing → much better generalization to longer context sizes.

The bitter lesson of “let neural nets be neural nets” strikes again!

[modernity @modern_what]

@abacaj i’m looking forward to together redpajama incite 7B. the 3B chat is quite impressive

[modernity @modern_what]

@ctjlewis we should ban cars

[modernity @modern_what]

@goinggodward this only reinforces my take that low expectations are truly a source of happiness

[modernity @modern_what]

@powerbottomdad1 the cultural and technological stagnation comes for everything eventually

https://t.co/ghZzBqcQH9

[modernity @modern_what]

@_ann_nguyen have not seen a startup get access to claude without personal connections yet