Building fair, useful, industry-standard benchmarks for ML training and inference performance of hardware, software, and services from TinyML to supercomputers
We've just released @MLPerf Mobile version 5.0.2 on the Google Play Store and GitHub. This version adds support for devices based on the Samsung Exynos 2500 SoC.
https://t.co/715ENpUz6w
@MLCommons & @AVCConsortium announce @MLPerf Automotive v0.5 benchmark results—a major step for transparent, reproducible automotive AI performance data. https://t.co/Bt89S9JgCG
On a personal level, I loved seeing .@MLPerf being mentioned so much! I can’t wait to see more submissions from across the industry as we push for the next 1000x in machine learning performance.
@MLCommons@MLPerf The Perf Storage Benchmark Suite will be a critical resource in improving machine learning and we’re honored to have participated alongside these industry leaders and academic organizations!
Inference keeps getting faster ... and more demanding. @MLCommons
MLPerf Inference 3.1 adds large language model benchmarks for inference https://t.co/YMWwHZKrij via @VentureBeat
"“We’re evolving the benchmark suite to reflect what’s going on,” @TheKanter said.
@MLCommons, we just released! New @MLPerf Inference and Storage results. Record participation in MLPerf Inference v3.1 and first-time MLPerf Storage v0.5 results highlight the growing importance of GenAI and storage. See all the results and learn more https://t.co/7eycrrmOdw
AI semiconductor company @Syntiantcorp announced its Syntiant Core 2™ programmable #deeplearning#architecture ranked as utilizing the lowest power #energy across three categories in @MLCommons@MLPerf Tiny v1.1 benchmark suite. Read more about energy performance below:
If you are at the @databricks Data+AI Summit this week be sure to check out @MLCommons Exec Director @TheKanter's session - Advancing ML Through Benchmarks & Data, Thursday, June 29 at 2:30pm
https://t.co/k4ge9Bpyic
Calling all ISC attendees, stop by the @MLPerf roundtable 5/24 at 9am, Hall E - 2nd floor, to learn more about the MLPerf HPC benchmark suite V3.0 from the experts who created it. #mlcommons#MachineLearning#ISC23
.@MLPerf inference results are out! Two startups took on @nvidia and won (albeit for perf/Watt, and only in certain specific scenarios): Taiwan's Neuchips and Silicon Valley's SiMa. @Qualcomm also has some perf/Watt wins against H100 this time.
#mlperf#ai
https://t.co/ZqFdOPKjlC
New @MLPerf inference results from us at @neuralmagic are now up! We show 1,000x performance improvements and 92% reduction in energy consumption. Dive into the blog to learn more: https://t.co/IzJ3IiwfgG
#mlops#mlperf#ml