How much energy consumption is involved in Chat GPT responses being generated?
Summary
A community discussion estimating the energy consumption per ChatGPT query, comparing it to traditional search engines and citing various research papers and model approximations.
Key quotes
Google Search request 0.0003 kWh = 0,3Wh, thus a search request by Google uses 1000x less
OpenAI's ChatGPT needs about 564 MWh every day just for this.
The page contains a series of user-contributed estimations and debates regarding the electrical cost of LLM inference. Contributors discuss the difficulty of obtaining official data from OpenAI and attempt to derive figures from GPU specifications and academic papers.