This is the doom I predicted a few days ago, coming for Photoshop. A clean-room open-source reimplementation.
No prizes for guessing that they decompiled Photoshop to source code, processed that to some kind of non-code specification language, then fed the spec to an LLM with an instruction to generate Rust.
Adobe just got nuked. And closed source is dead, dead, dead.
https://t.co/0sxtGNaPtq
We ran @thinkymachines’ Inkling 975B across eleven Intel Core Ultra PCs using @withcascadia.
Peak aggregate throughput: 60.29 tok/s at 88 concurrent streams. Single stream clocked 5-10 tok/s.
Almost a trillion parameters on consumer hardware :)
Cascadia is now serving Inkling (975B) from @thinkymachines across eleven Intel Core Ultra PCs, in a deployment with @IntelBusiness.
Quantized, Inkling sits at ~475GB in size, which we split into shards and distributed across the eleven machines. Each one runs a custom MoE engine built on top of OpenVINO.
Peak aggregate throughput reaches 60.29 tok/s at 88 concurrent streams.
I'm starting to think AI won't make you a generalist, but will make you more of a specialist
You can use AI to do all of the busywork surrounding your domain, and focus everything on your own specialization
People blame technology for many problems, when in reality the problems are created by humans.
Greed, lack of empathy, etc. These are the things that make software (among other things) worse