MLCommons is a consortium of industry and academic researchers, engineers, and practitioners working to build trusted, safe, and efficient AI. We believe this requires better systems for measurement and accountability, and that better measurement will help to improve the accuracy, safety, speed, and efficiency of AI technologies. Since 2018, we have been creating performance benchmarks for Artificial Intelligence (AI) systems. One of our most recognized efforts is MLPerf [2], which has helped drive an almost 50x improvement in system speed 4.