Sparsely Activated Primate

Seeking neuron activation

[Teortaxes▶️ (DeepSeek 推特🐋铁粉 2023 – ∞) @teortaxesTex]

listening now
Xi makes a speech that's basically DeepSeek recruiting copy. AI as steam and electricity. «We human beings must answer the question posed by our times. How to get along with thinking machines?». Open source AI for all humanity is part of Xi's answer.
Buckle up.

[Sparsely Activated Primate @SparselyActive]

BIG

[Teortaxes▶️ (DeepSeek 推特🐋铁粉 2023 – ∞) @teortaxesTex]

https://t.co/IlU8SD1dHE

[Sparsely Activated Primate @SparselyActive]

@teortaxesTex The interesting bit will be seeing if Inkling-Small beats Qwen 27B on modest consumer hardware

https://t.co/EDOjzbmGc8

[Harrison Kinsley @Sentdex]

Whoa, they buried the most interesting part of all of this: Inkling-Small: 276B A12B, coming soon.

Multi-modal at that size w/ those scores if they hold thru til release is very strong (see their blog for the full list of results)

[Sparsely Activated Primate @SparselyActive]

Sent back from the distant future to stop the rise of Skynet by sitting on your keyboard

[Harrison Kinsley @Sentdex]

Whoa, they buried the most interesting part of all of this: Inkling-Small: 276B A12B, coming soon.

Multi-modal at that size w/ those scores if they hold thru til release is very strong (see their blog for the full list of results)

[Sparsely Activated Primate @SparselyActive]

@Hesamation If the model that's infamously 10x cheaper than everything else has 70-80% profit margins... the average discourse around API rates being "subsidized" is way off
https://t.co/OCZNpe0yp5

[Teortaxes▶️ (DeepSeek 推特🐋铁粉 2023 – ∞) @teortaxesTex]

> DeepSeek's gross margin from selling v4 API access is...70% to 80% (!)
I wonder if Wenfeng would still say «not to subsidize, nor to reap excessive profits. This price also has a slight profit margin on top of cost»
I think so. That's "slight".
Dario is one hell of a humanist.

[Sparsely Activated Primate @SparselyActive]

@isabelrosesss Introducing my new CLI tool for getting a refund on rooms at hotels, use `rm-rf` today!

[Sparsely Activated Primate @SparselyActive]

@FemboyDCS It hits different in British, for sure

[Femboy Military Flight Sims @FemboyDCS]

I never considered that "room temperature IQ" refers to fahrenheit, I thought the point was that someone is a braindead slug creature with an IQ of 20, which is so much better

[Sparsely Activated Primate @SparselyActive]

@Malix_Labs Going to repo settings and adding a new "cognitohazard" label for MRs that can cause a brain aneurism during code review

[Poe's Law, Esq: Poe's Lawyer @dyingscribe]

Dozens

[Sparsely Activated Primate @SparselyActive]

@BareLeft "I’m told he got a standing ovation...” he must have told his anecdote about the hotel rooms getting mixed up

[shaurya @shauseth]

“you merely adopted the slop. i was born in it”

[Sparsely Activated Primate @SparselyActive]

@Thesmophilist The armed underground resistance faction planning out their first big move to bring about the revolution: "so we're all agreed that Anne Widdecomb is simply too powerful"

[Sparsely Activated Primate @SparselyActive]

@Kshitijjkapoor Trying out the new Hy3 IQ1 quant on a single Spark. It's a tad slow, but it's good hermin'

[Sparsely Activated Primate @SparselyActive]

@ivanfioravanti I'm getting ~178 tok/s prefill and ~10.5 tok/s decode on a single Spark. Currently it requires a patched version of llama.cpp that's pinned to an old commit form over a month ago, I imagine there's room for improvement.

[Sparsely Activated Primate @SparselyActive]

@hornsby_andrew @ItsmeAjayKV @TencentHunyuan 👇 https://t.co/S7kSlfIJXf

[Sparsely Activated Primate @SparselyActive]

@BareLeft