Type a question. Get a real answer from any blockchain in the world.
No technical knowledge needed. No setup. Nothing to learn.
Team Portugal spent 4 weeks building this on Pocket Network. It is live right now and anyone can use it.
https://t.co/0urjzSTEnJ 🛠️
"we want a ZK way to make (paid) calls to remote LLMs. But if we have this, then it's just as useful for solving another problem: private RPC reads in Ethereum."
I hope this feature can be implemented on $POKT @POKTnetwork@thepoktopus
Updates since then:
* Deepseek v4 is out. There *is* a 2-bit quant that can run within 90 GB ( https://t.co/yM1HMZXkXn ), and it works, however it's only fast on Apple hardware (I've head ~35 tok/s). On AMD, it's ~7 tok/s. IMO actually taking the effort to properly support more than one hardware manufacturer is a great example of the difference between mere "decentralized AI" and genuine "CROPS AI". I hope we can become better at this.
* https://t.co/CFYF1smBH3 also has alpha telegram support now. However, the path to adding your account is quite janky
* https://t.co/za4h233eYz looks promising as a way to run "dense" models (eg. Qwen 27B) more efficiently. It's janky, but on my 5090 laptop it seems to be ~2x more tok/s than llama.cpp
* VoxTerm (local AI recording, no third-party servers) continues to be developed https://t.co/GSdKzkD9Ql
And there's a lot more projects coming on the horizon.
One other thing that has been on my mind is that there's actually a lot of intersection between "CROPS ethereum access layer" and "CROPS AI". For example, we want a ZK way to make (paid) calls to remote LLMs. But if we have this, then it's just as useful for solving another problem: private RPC reads in Ethereum.
Another example: application-specific finetuned LLMs. Leanstral ( https://t.co/ilfww8ekJu ; I get ~38 tok/s on AMD) fits into < 70 GB, but can hold its own against 1T models on writing Lean code. Things like this are a huge boon for writing more secure code ( https://t.co/6YPWgVSzCg ). We should have models finetuned for Ethereum-related use cases as well.
hey @POKTnetwork I advise you to accelerate the AI specific part of the roadmap and fully focus on AI agents being able to access multiple chains at once. You’re uniquely positioned for that.
Ow and lower inflation.
$POKT
Unstoppable data = unstoppable DeFi 🤝
POKT/ETH is live on PancakeSwap @arbitrum. Add liquidity and earn from the infrastructure powering the open web with @POKTnetwork.
Start pocketing → https://t.co/07HQd1rKYu
It has been more than half a year since I made the statement. The procedure has been quite slow but I still believe that it will be listed on some big CEX (in the form of perpetual) in order to let the MM make profit.