Top Tweets for #Inference

Cost effectiveness of AI is becoming a hot topic. As AI adoption accelerates, the focus is increasingly shifting from simply building more powerful models to maximizing the value generated by every dollar spent. Not every task requires the most expensive or advanced AI model. In fact, the global AI inference software market is projected to grow from $21.1 billion in 2026 to $80.9 billion by 2033, representing +283% growth. As companies deploy AI at scale, reducing costs without sacrificing performance will be increasingly important. The next phase of AI is about efficiency, not just computing power.

Apple is working on a new app called Harbor Harbor turns your Mac into a private AI inference server. Run open-weight models locally on Apple silicon—your data never leaves your hardware, and nothing reaches the cloud. Connect multiple Mac computers over Thunderbolt 5 to pool unified memory, enabling large models and higher concurrency that a single computer can handle alone. Set up in minutes, not hours Harbor automatically detects your devices over Thunderbolt 5 to form a cluster. Plug in, start, and you’re running—no manual configuration, no command line, no infrastructure expertise required. Download and run models directly Browse, download, and load open-weight models from within the app. Harbor handles model management so you can focus on the work, not the setup. Cluster for scale Connect two or more Thunderbolt 5-capable Mac computers and Harbor pools their unified memory into a single inference resource. Run models that exceed any single computer’s capacity, or serve more concurrent requests across your cluster. Harbor is currently in a private preview under the Claris brand.