Let me tell you a secret: with a sunlight collection device, a fiber-optic cable can channel sunlight into your nasal cavity, and the effect will be much better. Of course, it also works if you point your nasal cavity directly at the sun. Going a step further, if you know a secret of the Maya, you will master the most valuable secret.
@aimalysheva The principle behind is that depth unfolds the underlying manifold. Latent manipulation can be performed in the intrinsic space of the manifold. Please read:
Rank Diminishing in Deep Neural Networks
I spent the last six months trying to deconstruct Taalas's patents. We think it can be better: 100x fewer memfetches than their bitROM, better software by better quantization than their hardware team could.
So we wrote a compiler that:
> takes a huggingface checkpoint,
> quantizes the model
> descends the weights down metal layers to RTL and GDS, do your DRC, Yosys, PEX, make the electrical waveform execute a mat-vec from your huggingface checkpoint (thanks Cambricon tech papers)
in ~7000 lines of human-readable code.
we're looking for someone with contacts with a foundry/access to 7nm PDKs or contacts at a cheap EuroPTW shuttle? I'm broke and unemployed.
@itsclivetime this is what i think is the future of perplexity per picojoule. @zerohedge@zephyr_z9 you guys wanna see 40,000 tokens/sec?
@ccatalini Great article. There is another dimension: if we leverage blockchain to monetize the value of influence, it will open up completely new space for knowledge sharing, including open-source AI.
Christian @ccatalini 这篇文章非常棒。文章认为,开放权重与封闭权重之争聚焦错误边际:开放权重不会降低AI投资总量,只会改变创新方向——即构建什么、由谁构建以及谁捕获回报。历史证据(如专利与博览会研究)表明,强知识产权或开放性仅影响创新分配而非水平,在累积性强的领域如AI,开放更能促进广泛实验与后续进步。模型权重类似非竞争、非排他的知识,蒸馏属合法实践,价值最终流向控制互补资产(数据、分发、隐性知识)者。安全风险因领域而异:开放可能增强分布式防御与系统韧性,而非必然更危险。总体而言,开放权重支持分散智能的探索与适应,符合知识分散的本质,监管捕获难以逆转这一经济逻辑。
Frontier labs argue distillation threatens R&D and US national security. Open-weights proponents counter that diffusion is essential to competition and innovation.
Both believe theirs is the only safe path.
Luckily, the economics is loyal to neither. https://t.co/jFnLjqz5DR