Inference Exchange

Run inference on a decentralized network in an open market of trusted users.
OCIP · Open Source · Building in Public

[Jared Yu 启正 @jaredyu999]

https://t.co/aE8llLHLYo

Hi all, sharing this Reddit thread on some research I’m doing into confidential computing for the purpose of local LLM inference with consumer hardware (e.g. Apple Silicon, Nvidia GPUs). Looking to learn security best practices from the community.