“Once the edge absorbs high-volume, context-heavy, privacy-sensitive work, the cloud stops being the default destination for every token and becomes a premium layer used deliberately.”
https://t.co/rNvL1mUA2M
The efficient frontier becomes efficiency-meets-frontier-models.
#RAMP
What happens after the laptop pays for itself?
“The case for local AI is not that it replaces the cloud. [Rather], it changes the enterprise's negotiating position with the cloud.”
TPO becomes the new weighted measure.
Tokens per outcome, viz. [analysis/insight/judgment/action]
@WillManidis Reading this, I'm reminded of Marshall Ney's remarkable rearguard action in Napoleon's 1812 Moscow retreat.
We learned catapulting to an end game req's rearguard strategy.
“Soldiers, when I give the command to fire, fire straight at my heart. Wait for the order."
- Marshall Ney
@_clarktang The skepticism re ODI (on-device inference) reminds me of when AAPL released the MBA. No one believed a laptop could be slimmed down that much. INTC’s innovation took a very different approach. My point is that spending time thinking it’s impossible makes it so.
Not ODI but MDI.
@uninsightful@Alfred_Lin led the $127m Series C round in Mar 2016. Rumor has it he invested ~$100m @ ~$600m pre.
Stepped up when the VC mkt stopped believing in the DASH team & opportunity. For those @ home, $10b+ in gross receipts assuming hold till ATH.
So yes, my fave VC is doing it again.
@raizamrtn I'd argue in addition, and thus a promise fulfilled, that it's a two-sided zero-cognitive-load experience.
B side: How do I know what I don't know to ask? https://t.co/sqAikMP3ja
@Carnage4Life@ID_AA_Carmack AI platforms @ utility scale offer the promise of being able to guide/answer these questions:
How do I know what I don't know to ask?
What do I need to know, & in what priority, to make the best decision?
How much 'AI,' w/ the emphasis on I, will be needed to serve up rote info?
https://t.co/aXCSr5Noji
Tough year.
Grateful to all for the support.
Pls extend support (earmarked for GBM) to the NBTS / Brain Tumor Investment Fund https://t.co/xQpjC65vKb, Yemaachi Biotech https://t.co/dQKGOoxvw6 & Glioblastoma Research Organization https://t.co/8n5HLqYnno