1/6 Exciting new results from @IBMResearch demonstrate that for a 3-billion parameter LLM, a compact 2U research prototype system using the IBM AIU NorthPole inference chip delivers an astounding 28,356 tokens/sec of system throughput and sub-1ms/token (per-user) latency.
IBM researchers unveil a "brain-inspired" NorthPole chip prototype that removes the need to frequently access external memory and consumes vastly less power (@dcastelvecchi / Nature)
https://t.co/Aoory8bRW4
📫 Subscribe: https://t.co/OyWeKSRpIM
https://t.co/8FDoqm8q1L
IBM's new AI chip, NorthPole, is a groundbreaking processor inspired by the human brain.
It excels in tasks like image recognition, surpassing other AI chips in speed and energy efficiency.
(Image credit: @rowancheung)
Microchip breakthrough may reshape the future of AI | IBM’s new NorthPole may enable smarter, more efficient, network-independent devices that may even help the U.S. win the microchip war against China. https://t.co/eqkqFtUcE8 by @deftechpat
IBM's brain-inspired chip, NorthPole, could be the fastest at running AI yet - and it is 25 times more energy efficient than commercial chips too https://t.co/c0K7kLo7BY
Publishing this week in @ScienceMagazine, IBM Research's newest prototype AI chip, NorthPole, could help us move toward more energy-efficient AI. Learn more: https://t.co/qyKIUGg5ld
In Science, researchers present NorthPole—a brain-inspired chip architecture that blends computation with memory to process data efficiently at low-energy costs.
Learn more: https://t.co/hw1qUm2SYS
10/10 New in @ScienceMagazine, a perspective on NorthPole by Prof. Subramanian S. Iyer and Vwani P. Roychowdhury. https://t.co/dWblGBcy9Y
#ScienceResearch#ai
9/10 For a 20-min video of a talk on NorthPole at @hotchipsorg see (paywall): https://t.co/JTMtDCkg73
Slides are available at @IEEEorg see (paywall): https://t.co/8a6aJMnQOV
#ai