large language mofongo

hardware / low level / local inference / 我們不一樣 / 🇵🇷

[large language mofongo @vieratech]

Remember kids, it's not impostor syndrome if you actually suck.

[large language mofongo @vieratech]

i can't believe anthropic made this game

[Fable @fable]

Step into Albion and discover what it means to live an extraordinary life.

Build relationships, shape your reputation, and influence the people around you in a world that evolves with every choice you make.

Watch our gameplay demo for a closer look at life in Albion: https://t.co/rGJPjdmLkO

#Fable #FableTheGame

[large language mofongo @vieratech]

I don’t wanna be a hater but this is exactly what it feels like

[Kasra Khadem @Kaz_Khadem]

SF VCs: I visited NYC and nobody was using agentic AI systems to optimize complex business workflows

NYC VCs: I visited SF and almost killed myself

[large language mofongo @vieratech]

@splinedrive how did you make these diagrams mr. asic

[large language mofongo @vieratech]

I guess attention really is all you need

[Kimi.ai @Kimi_Moonshot]

Introducing 𝑨𝒕𝒕𝒆𝒏𝒕𝒊𝒐𝒏 𝑹𝒆𝒔𝒊𝒅𝒖𝒂𝒍𝒔: Rethinking depth-wise aggregation.

Residual connections have long relied on fixed, uniform accumulation. Inspired by the duality of time and depth, we introduce Attention Residuals, replacing standard depth-wise recurrence with learned, input-dependent attention over preceding layers.

🔹 Enables networks to selectively retrieve past representations, naturally mitigating dilution and hidden-state growth.
🔹 Introduces Block AttnRes, partitioning layers into compressed blocks to make cross-layer attention practical at scale.
🔹 Serves as an efficient drop-in replacement, demonstrating a 1.25x compute advantage with negligible (<2%) inference latency overhead.
🔹 Validated on the Kimi Linear architecture (48B total, 3B activated parameters), delivering consistent downstream performance gains.

🔗Full report:
https://t.co/u3EHICG05h

[large language mofongo @vieratech]

I can't believe I've become a verilog bro

[large language mofongo @vieratech]

@bubbleboi &gt;"junior SWEs get replaced with 7B 4-bit quantized parameter models"

lmao dude chill

[large language mofongo @vieratech]

If the gov is concerned about AI companies telling them what they can/cannot do with an LLM, maybe they should own the weights and run it on their own hardware.

Maybe everyone should do that.

[Secretary of War Pete Hegseth @SecWar]

This week, Anthropic delivered a master class in arrogance and betrayal as well as a textbook case of how not to do business with the United States Government or the Pentagon.

Our position has never wavered and will never waver: the Department of War must have full, unrestricted access to Anthropic’s models for every LAWFUL purpose in defense of the Republic.

Instead, @AnthropicAI and its CEO @DarioAmodei, have chosen duplicity. Cloaked in the sanctimonious rhetoric of “effective altruism,” they have attempted to strong-arm the United States military into submission - a cowardly act of corporate virtue-signaling that places Silicon Valley ideology above American lives.

The Terms of Service of Anthropic’s defective altruism will never outweigh the safety, the readiness, or the lives of American troops on the battlefield.

Their true objective is unmistakable: to seize veto power over the operational decisions of the United States military. That is unacceptable.

As President Trump stated on Truth Social, the Commander-in-Chief and the American people alone will determine the destiny of our armed forces, not unelected tech executives.

Anthropic’s stance is fundamentally incompatible with American principles. Their relationship with the United States Armed Forces and the Federal Government has therefore been permanently altered.

In conjunction with the President's directive for the Federal Government to cease all use of Anthropic's technology, I am directing the Department of War to designate Anthropic a Supply-Chain Risk to National Security. Effective immediately, no contractor, supplier, or partner that does business with the United States military may conduct any commercial activity with Anthropic. Anthropic will continue to provide the Department of War its services for a period of no more than six months to allow for a seamless transition to a better and more patriotic service.

America’s warfighters will never be held hostage by the ideological whims of Big Tech. This decision is final.

[large language mofongo @vieratech]

@xennygrimmato_ Do you know anyone working on this?

[large language mofongo @vieratech]

Distillation is good actually.

[Anthropic @AnthropicAI]

We’ve identified industrial-scale distillation attacks on our models by DeepSeek, Moonshot AI, and MiniMax.

These labs created over 24,000 fraudulent accounts and generated over 16 million exchanges with Claude, extracting its capabilities to train and improve their own models.

[large language mofongo @vieratech]

I live in SF now. DM to hang out.

[large language mofongo @vieratech]

No quiero que hagan contigo lo que le pasó a Hawái.

[large language mofongo @vieratech]

The future of inference must be local.

[Asad Khaliq @asadkhaliq]

(essay) Life At The Edge

"Local AI" today is mostly about giving models OS-level access so that more files and context can be transferred to the cloud for inference. But intelligence is about to diffuse to the edge just as computing did in the 80s and 90s

Some thoughts on rent vs own for inference, Apple events becoming great again, God models, and the coming dance of edge and cloud

[Amtrak @Amtrak]

THE UNBRIDLED GREATNESS OF TRAINS WILL ENDURE FOR A MILLION YEARS

[large language mofongo @vieratech]

How do we get the design -&gt; fab loop even cheaper and (especially) faster?

PCBs used to cost $1000s + took like a month to fab. Now they're dirt cheap + fast. Can we do the same thing for ASICs?

Especially for older process nodes. TT uses @SkyWaterFoundry 130nm.

[large language mofongo @vieratech]

Verilog -&gt; GDS end-to-end tooling for free??

Thank you @tinytapeout, when I grow up I wanna be an ASIC engineer.

[large language mofongo @vieratech]

DO NOT GIVE LLMS FULL ACCESS TO YOUR EMAILS

[large language mofongo @vieratech]

Unpopular opinion? Email is the most important account in most peoples lives. More than your bank account, facebook, twitter, instagram, etc.

You can reset any other account with your email. It's the keys to the kingdom

Lock that shit down

[large language mofongo @vieratech]

You gotta hand it to the german gestapo, at least they didn't wear masks.

[Nous Research @NousResearch]

Open source must win.

[large language mofongo @vieratech]

Which way, American?

[large language mofongo @vieratech]

@mitsuhiko Zed