How a lot electrical energy does ChatGPT use to reply one query?
This text presents a variety inside which the electrical energy consumption per question of ChatGPT might fall and compares it to the measured vitality consumption of two different massive language fashions (LLMs).
That is an fascinating endeavor for 2 causes:
To begin with, if organizations know the way a lot electrical energy ChatGPT requires to reply one query, they’ll approximate the carbon footprint related to their use of ChatGPT or related providers equivalent to OpenAI’s LLM APIs.
For greater than 50,000 European companies, this may occasionally quickly turn out to be extremely related, as the approaching Company Social Duty Directive (CSRD) will doubtless drive them to reveal scope 3 emissions of their administration experiences [1]. I count on utilization of providers like ChatGPT to fall underneath scope 3 as a result of cloud compute is taken into account to be scope 3 [2]. I hope this text can present inspiration for estimate your group’s scope 3 emissions from ChatGPT and related providers.
Another excuse why it’s fascinating to look into ChatGPT’s vitality use per question is that it’ll allow people to provide you with their very own estimates of ChatGPT’s complete electrical energy consumption or carbon footprint. As such, I hope this weblog submit will encourage others to publish related work.
Within the the rest of this text, the phrases “question” and “request” can be used interchangeably.
On this part, I’ll current the methodology used to supply estimates of ChatGPT’s electrical energy consumption per question. The estimates depend on two completely different strategies:
- One through which we estimate the entire vitality consumption of the {hardware} ChatGPT presumably is working on and divide by the assumed variety of each day queries
- One through which we use the reported…
