Liam Coffey

CEO/Chief Architect @theArchality: solving the AI memory wall.
30+yrs systems & silicon.
Fmr HW Security Lead, AMD.
Weight-resident inference. DRAM-free. BMAC.

[Liam Coffey @liamjcoff]

We have been quietly building something that attacks one of AI’s biggest unsolved problems: the memory wall.

Constantly moving massive model weights between memory and compute is the real driver of high inference cost and power consumption. We think there is a better way.

🧵 1/8

[Liam Coffey @liamjcoff]

@HotAisle lol

[Liam Coffey @liamjcoff]

@wmf One might say he reversed engineered because of a lack of docs. He’s always complained about not having docs. And I agree with him. It’s awful.

[Liam Coffey @liamjcoff]

@RobertDaleSmith It was wonderful space-sim side controller for thrusters.

[Liam Coffey @liamjcoff]

Coheristics is a good term for reasoning by way of machine. That leaves reasoning, judgement and choice (for the moment) to humans.
Intelligence, well, that’s where it gets a bit fuzzy. Inspiration comes in many forms.
Design is a wide ranging thing.
I design hardware, there are many choices and inspirations that come from AI EDA, but I judge, reason, and ultimately make the choice. I do not see that going away soon.

Entrenched engineering needs to stop though; it’s now cheaper to walk back up the decision tree and explore ideas that whole industries have built decades of success on. We’re truly at a time where decades old incumbents can get challenged.

[Liam Coffey @liamjcoff]

@irinatoxi The circuit side Autodesk MCP needs way more work I’m afraid to say. The KiCad rewrites with MCP have become measurably better than many of the more feature rich packages.

[Liam Coffey @liamjcoff]

@joshelman Great event. Fantastic presentation, great questions. Thanks for the invite, getting out of build mode to get in to a community for a bit was great.

[Synopsys @Synopsys]

🚨 Synopsys has demonstrated the world's first 3D PCIe 6.0 test chip, validating 64 GT/s PCIe connectivity in a stacked-die architecture. A major step toward enabling high-performance connectivity for the multi-die era. Read the blog to learn more: https://t.co/Xdcko7Im4E

[Liam Coffey @liamjcoff]

@dhh Ditto, but, I don’t think people comprehend how hell-bent I am at eliminating the ‘Random Access’ part of Memory for matrix multiplication.

[Liam Coffey @liamjcoff]

For anti-cheat to operate you’re going to need an immutable and measurable kernel and modules when the game is resident. Will be interesting solution to see.

I have a many decade of designing hardware-based anti cheat and anti-tamper for critical computing usually with the goal of not having peripheral/OS as the weak layer. It’s a bigger ask than most people think.

[Liam Coffey @liamjcoff]

@joshelman See you there (zoom), thanks Josh.

[Liam Coffey @liamjcoff]

@HotAisle Continue with Adblock.

[Liam Coffey @liamjcoff]

@will_whang Imx585 too and it’s new stock.

[Liam Coffey @liamjcoff]

@aaronburnett Look at it this way, we're somewhere 10¹² - 10¹⁴ : 1 earth to space hours worth of tool use/engineering.

Do you know what happens to the economy when the consequent flips to 2?

[Liam Coffey @liamjcoff]

@debreuil @copperkitapp 100%, the Cubiko even has a stylus holder and a laser cartridge. It's double the price, but less the faff. Firmware is horrible though, like always.

[Liam Coffey @liamjcoff]

I agree with George on many areas in this.
It also makes fund raising harder in the future for other companies doing similar or adjacent things. When you interface with some of the VC's they tell you stories.
There's lots we want to say about what we're doing; but receipts first.
Also our CMO is none other than @KyleBennett (HardOCP) and he would not have it any other way, all of our founders have got a 30+ year reputation to uphold.

[Liam Coffey @liamjcoff]

@emh203 Yeah they exist, doesn’t need two though. I use them everywhere in my builds. These cyclop ones are better because they stop droop on the long edge of the connector.

[Liam Coffey @liamjcoff]

@thsottiaux Better core camera and microphone support for physical hardware validation of firmware. It’s amazing right now. But device support through OS could be better.

[Liam Coffey @liamjcoff]

@Beth_Kindig Are they laying the groundwork for: 'Was a chip company, now a neo-cloud'. Like Groq?

[Liam Coffey @liamjcoff]

@venturetwins @omooretweets I didn't even know sepsis was coming from a problem that didn't even announce itself. Got lucky it showed up on a medical - post deployment. Good catch! Speedy Recovery.