ChatGPT Query (Single Response)

Large language models have large power bills/Computing

A single ChatGPT query uses roughly 10 times the energy of a Google search, at about 3 watt-hours per response. Running GPT-4 class models at scale requires enormous GPU clusters drawing megawatts of power. As AI usage grows, the energy footprint of language models has become a significant topic in sustainable computing.