AI Energy Score
Summary
An initiative to establish standardized energy efficiency ratings for AI model inference across 10 common tasks using NVIDIA H100 GPUs.
Key quotes
The goal of AI Energy Score is to establish a standardized approach for evaluating the energy efficiency of AI model inference.
The star ratings represent the relative energy efficiency of an AI model for a specific task... on a particular leaderboard.
The project provides a relative 1-5 star scoring system based on GPU watt-hour consumption. It includes a public leaderboard and guidelines for enterprises to integrate energy efficiency into procurement processes.