A software magician, working on tech projects from the abyss. Freelance philosopher, arguing about thing I don't understand with people who don't care.
@whitequark I know a person that works at pet food manufacturing, and from what he told me the pet cat/dog might be healthier than human food because there is no sugar. They regularly test their food by eating it, he told me it tastes bland, so it should be good If you add some salt to it.
Controversial bet: JS/TS will win over python in the LLM space.
Not for orchestrating models, but for application building. Quick reasons:
1. Easier packaging and delivery
2. LLM infra+orchestration will stabilize. Once you can run models efficiently with guided generation, you want something to take care of it for you. Very rarely are pieces of infra (dbs, caches, OSes) written in the same language as applications. Good chance this will stay Python.
3. Text is easy to move around, and the characteristics of LLM work - streaming, backpressure, etc is better supported by the web.
4. Visual polish and UX is not even of comparable quality for things like interfaces, interactivity, animations, charts.
5. Typescript is a far better language (terse and with complex type support, while being included well in pretraining corpus) than python/JSONSchema for guiding LLMs.
6. Users and distribution. Most of the world lives on the web, and client-side python is still a massive pain. WebGPU and wasm will likely win here.
In two years the most commonly used application libraries for AI work will be built for the web.
Here's why I might be wrong:
1. Python is an amazing language for newcomers (used it for years, still use it), and it's very, VERY powerful for building and operating AIs at a core level. The newest innovations will show up here, simply because the people inventing them use Python.
2. Easier connectivity to C and baremetal make it more efficient for a lot of things, but Node and the JS ecosystem is catching up.
3. Today Python wins in the AI space for momentum and velocity - there's a good chance that continues.
4. Client-side applications. If the trend of Electron apps reverses, or Apple refuses to open the NPU to the browser, local will be the only place you can get true safe high performance. I still doubt it will be Python, but it likely won't be JS/TS.