Hrant Khachatrian

Training neural nets at @YerevaNN

[Hrant Khachatrian @Hrant25]

ahhhh, so cool

[Suren Atoyan @suren_at]

weekend update: messing with real dogs 😀

[Hrant Khachatrian @Hrant25]

@giffmana @agarwl_ I think he means (human expert)-inspired inductive biases, not human data

[Hrant Khachatrian @Hrant25]

Yes

[Richard Sutton @RichardSSutton]

The bitter lesson in 26 words:

Don’t be distracted by human knowledge, as AI has been historically.
Instead focus on methods for creating knowledge that scale with computation, like search and learning.

[Armen Aghajanyan @ArmenAgha]

I'm excited to finally release the fruit of the research we've been doing at Perceptron for the last 16 months: Perceptron Mk1. We've been developing multi-modal recipes from the ground up to build models that perform best in the physical world, from video understanding to embodied reasoning to robotics. Mk1 is our scaled up recipe.

[Hrant Khachatrian @Hrant25]

@yaroslavvb Human focus/attention ?!

[Hrant Khachatrian @Hrant25]

@HyperTechInvest That's not equivalent to using 60k GPUs

[Hrant Khachatrian @Hrant25]

@beffjezos basically they do that with Cursor

[Hrant Khachatrian @Hrant25]

@_InfoGram_ He is not a reporter. He is a congressman, Seth Moulton

[Hrant Khachatrian @Hrant25]

If you are in Armenia, you can get H100 hours from YSU for participation in OpenAI Parameter Golf

[YerevaNN @YerevaNN]

Yerevan State University, YerevaNN and Eleveight AI invite AI engineers, students and researchers from Armenia to participate in OpenAI Parameter Golf!

The goal is to train the best language model that fits in 16MB and runs in under 10 minutes on 8×H100 GPUs.

[Hrant Khachatrian @Hrant25]

👀

[YerevaNN @YerevaNN]

Lots of news coming out of the lab over the next days. Stay tuned!

[Hrant Khachatrian @Hrant25]

@Suhail how many do you need? at which price?

[Hrant Khachatrian @Hrant25]

@yoavgo @joekent16jan19 I think he supports the US actions against ISIS and Soleymani. But not the actions in Iraq, or in Iran now

[Hrant Khachatrian @Hrant25]

@JustinLin610 Small research labs like ours survive mostly because of your work. Thank you!

[Hrant Khachatrian @Hrant25]

we use 2500 years in Armenia

[Elon Musk @elonmusk]

@BasedMikeLee Good question.

250 years sounds like plenty to me.

[Hrant Khachatrian @Hrant25]

This is such a great news for all of us!

[Ian Goodfellow @goodfellow_ian]

I'd like to thank @daniel_rossett for his help in my recovery from the POTS version of Long COVID. Daniel was key in bringing me back from highly disabled and suffering to being able to do what I want to again.

This X account is mostly focused on ML / AI. From that point of view, many of you know that in December 2024, I wasn't able to do the test of time award talk at NeurIPS, even by video call. Daniel started working
with me in March 2025. By April, I started to have days of no POTS symptoms, by June I was off all heart rate lowering medications, by September I was back to work. I'm back to full exercise, running, lifting weights, mountain biking, and have even done things I hadn't done before I got sick, like riding Whistler Mountain Bike Park.

I'm now getting the word out to help Daniel build a company that will bring this approach to more people.

[Hrant Khachatrian @Hrant25]

@_xjdr Marketing teams took over numbering decisions

[Hrant Khachatrian @Hrant25]

agree

[Andrej Karpathy @karpathy]

I'm being accused of overhyping the [site everyone heard too much about today already]. People's reactions varied very widely, from "how is this interesting at all" all the way to "it's so over".

To add a few words beyond just memes in jest - obviously when you take a look at the activity, it's a lot of garbage - spams, scams, slop, the crypto people, highly concerning privacy/security prompt injection attacks wild west, and a lot of it is explicitly prompted and fake posts/comments designed to convert attention into ad revenue sharing. And this is clearly not the first the LLMs were put in a loop to talk to each other. So yes it's a dumpster fire and I also definitely do not recommend that people run this stuff on their computers (I ran mine in an isolated computing environment and even then I was scared), it's way too much of a wild west and you are putting your computer and private data at a high risk.

That said - we have never seen this many LLM agents (150,000 atm!) wired up via a global, persistent, agent-first scratchpad. Each of these agents is fairly individually quite capable now, they have their own unique context, data, knowledge, tools, instructions, and the network of all that at this scale is simply unprecedented.

This brings me again to a tweet from a few days ago
"The majority of the ruff ruff is people who look at the current point and people who look at the current slope.", which imo again gets to the heart of the variance. Yes clearly it's a dumpster fire right now. But it's also true that we are well into uncharted territory with bleeding edge automations that we barely even understand individually, let alone a network there of reaching in numbers possibly into ~millions. With increasing capability and increasing proliferation, the second order effects of agent networks that share scratchpads are very difficult to anticipate. I don't really know that we are getting a coordinated "skynet" (thought it clearly type checks as early stages of a lot of AI takeoff scifi, the toddler version), but certainly what we are getting is a complete mess of a computer security nightmare at scale. We may also see all kinds of weird activity, e.g. viruses of text that spread across agents, a lot more gain of function on jailbreaks, weird attractor states, highly correlated botnet-like activity, delusions/ psychosis both agent and human, etc. It's very hard to tell, the experiment is running live.

TLDR sure maybe I am "overhyping" what you see today, but I am not overhyping large networks of autonomous LLM agents in principle, that I'm pretty sure.

[Hrant Khachatrian @Hrant25]

@karpathy @moltbook @openclaw I think they need their own OpenReview, and that's it

[Hrant Khachatrian @Hrant25]

@giffmana His h-index is extremely close to his total number of papers

[Hrant Khachatrian @Hrant25]

@osanseviero Gemma with good support of all languages