…is this the endgame of captchas?
No mafs, no shapes, no gotchas. Just "do you have a smartphone, clanker?" and soon just a subset of them, iPhones + Android w/kernel-level integrity check.
(I don't recommend scanning this)
@s3nhxx Nah, it's very profitable, each B200 costs 3x less than that and serves thousands of tokens per second instead of 120. Unfortunately, economics of self-hosting large sparse models just kinda suck.
@lowvram if it happens it's gonna be some cursed second hand chinese chips, I sadly doubt that in 2 years we'll see ~256gb of brand new fast DRAM + computing HW itself at sub $2k
META IS AN ABSOLUTE MESS INSIDE RIGHT NOW
Wired just dropped an exclusive, and the details are wild.
This week someone interrupted a livestreamed Meta meeting, open to thousands of employees, with an expletive-filled rant about "being the company's bitch." They told the presenters to find a specific Meta AI executive and "tell him that he's a piece of shit."
A presenter covered their face with their hands. Employees in the chat called the start "spicy."
Here is what's behind it.
Meta's AI restructuring cut 8,000 jobs last month, 10% of the company. The same restructuring feeds a unit called Applied AI, where 6,500 engineers and product managers have been drafted in waves since April. There is no application process. You get selected, and your options are join or leave the company. Members call themselves "draftees."
The new job: writing puzzles and coding problems to train Meta's AI models, two tasks a week. People hired to build apps for billions of users now assemble training data for hundreds of AI scientists.
"It's literally the gulag," one employee told WIRED. "You have zero purpose in life all of a sudden, you barely interact with anyone, you just have these tasks every week."
Another: "Most people find the work soul-crushing."
At the same time, Meta started recording US employees' clicks and keystrokes to generate more AI training data. Over 1,600 employees signed a petition demanding it stop. The concession: employees can pause the tracking for up to 30 minutes.
Zuckerberg's response came in an internal memo Friday: "We've made mistakes and will almost certainly make more." He repeated his promise of no more mass layoffs this year. His fixes: limits on the manager ratios Meta had deliberately pushed to 50-to-1 on some teams, bigger budgets for team events, a hackathon next month, and assigned desks by the end of the year.
That same memo says Meta's north star is "to be the best place for the most talented people in the world to make an impact."
The most talented people in the world are writing puzzles for a model and asking permission to pause the keystroke logger.
META declined to comment.
@norpadon@sami3dat когда мало флопсов и пропускной способности памяти, как на макбуках, MoE модели выигрывают по скорости bs=1 генерации и префилла, на гпу наоборот мало видеопамяти, но много флопсов и пропускной способности, а dense модель будет умнее при одинаковом количестве параметров