LLMs are driving the frontiers in computer performance today. This talk explores the MLPerf LLM benchmark landscape, the unique challenges of building LLM benchmarks for training and inference, and the challenges for submitters.

David Kanter
David co-founded and is the Head of MLPerf for MLCommons, the world leader in building benchmarks for AI. MLCommons is an open engineering consortium with a mission to make AI better for everyone through benchmarks and data. The foundation for MLCommons began with the MLPerf benchmarks in 2018, which rapidly scaled as a set of industry metrics to measure machine learning performance and promote transparency of machine learning techniques. In collaboration with its 125+ members, global technology providers, academics, and researchers, MLCommons is focused on collaborative engineering work that builds tools for the entire AI industry through benchmarks and metrics, public datasets, and measurements for AI Safety. Our software projects are generally available under the Apache 2.0 license and our datasets generally use CC-BY 4.0.

Melissa Harup
Billions of people around the world rely on access to information through websites and mobile applications. We are building for a privacy-first future, one where people have transparency in their ability to keep their online information private, and at the same time ensuring we maintain the integrity of a free and open internet. This requires a very close collaboration between Governments, Industries and Digital Ecosystems.
The IMDA x Google: PETs x Privacy Sandbox initiative; we are helping companies migrate to this privacy-first world, by providing the education and tooling necessary to become privacy-ready. In this session we will provide the audience with an overview of this strategic programme, discuss key updates, and share recommended actions to help prepare for a privacy-first future.

Ms Lee Chein Inn

Kunal Guha

Yinghui Tng
Digital transformation is essential for government agencies to stay competitive and deliver better services to citizens. But with the increasing amount of data being collected, proper attention to data privacy concerns is crucial to maintain the trust of stakeholders. This talk will explore the challenges and opportunities for promulgating PETs in the public sector, and the role of PETs can fit into organisations’ data engineering strategy. In particular, it will touch on some of the lessons learned in developing a Central Privacy Toolkit, as part of a wider ecosystem of data engineering tools that allow public sector officers to collaborate, share and exploit data while striking the right balance between data-driven innovation and privacy protection.

Dr Yap Ghim Eng
