Steven Su

[Andrej Karpathy @karpathy]

I packaged up the "autoresearch" project into a new self-contained minimal repo if people would like to play over the weekend. It's basically nanochat LLM training core stripped down to a single-GPU, one file version of ~630 lines of code, then:

- the human iterates on the prompt (.md)
- the AI agent iterates on the training code (.py)

The goal is to engineer your agents to make the fastest research progress indefinitely and without any of your own involvement. In the image, every dot is a complete LLM training run that lasts exactly 5 minutes. The agent works in an autonomous loop on a git feature branch and accumulates git commits to the training script as it finds better settings (of lower validation loss by the end) of the neural network architecture, the optimizer, all the hyperparameters, etc. You can imagine comparing the research progress of different prompts, different agents, etc.

https://t.co/YCvOwwjOzF
Part code, part sci-fi, and a pinch of psychosis :)

[Steven Su @xpsteven]

@pirrer @PalmerLuckey 確定

[Peter Yang @petergyang]

3/ On craft:

1. Most people just want to build, but most companies are built for managers.

2. You don't want to end up with smart, credentialed PMs who write strategy memos to grow team size to write more memos.

3. Great products are built through tinkering, not strategy.

[Steven Su @xpsteven]

@pirrer 年初也被碰一次，上下保桿都換，總共十萬，對方保險買單。

[Steven Su @xpsteven]

@pirrer 記得賓士曾經持有 10% TSLA 如果每次增資都跟 XD

[John.Lee @fswordlee]

最近nodejs出0.6.4版本导致被GFW了，看来python不是个案。强烈呼吁大家分头提醒给自己关注的语言/框架作者，这种版本号还是跳过的好，顺便向全世界科普一下GFW的先进经验，求转发