Training large models like an LLM (text generation) or a stable diffusion model (image generation) consumes a lot of energy and using these models isn’t cheap either. It’s bad for the climate in the same way cryptocurrency is.
+1, it is much worse than even proof-of-work crypto though. I think AI is the bigger enemy, since at least in crypto, there are ways of developing and using it that aren’t as bad (or even at all) for the climate.
Using it, not all that energy intensive (one llm use is roughly the same as 3 pre-ai-bullshit google searches iirc). Training it, very energy intensive.
Yes it would but we haven’t even replaced all our previous needs with renewables so it aint helping.
According to this article, this is not considered true anymore:
As conversations with experts and AI companies made clear, inference, not training, represents an increasing majority of AI’s energy demands and will continue to do so in the near future. It’s now estimated that 80–90% of computing power for AI is used for inference.
I think there’s a reason why OpenAI, Microsoft, Google and Facebook hold the energy consumption and water usage numbers so close to their chest.
According to numbers floating around online, thiat would mean one llama query is around as expensive as 10 google searches. And it’s likely that those costs will increase further.
It still seems like the biggest factor here is the scale of adaptation. Unfortunately the total energy costs of AI might even scale exponentially since the more complex the queries get, the better the responses will likely be. And that will further drive adaptation.
This pace is so clearly unsustainable it’s horrifying, and while it was obvious to some degree, it seems it’s worse than I thought.
America produced 4,000TWH of electricity a year. This report says “22% of household consumption in 2028”, which if I commit the faux pass of mixing data it gets me 7% of US power consumption.
7% is a fucking lot though?? That’s an immense amount of power going towards slop instead of making our lives better or growing the economy or actually being productive.
It’s like we just decided to start burning our limited reserves of natural gas for fun.
deleted by creator
Training large models like an LLM (text generation) or a stable diffusion model (image generation) consumes a lot of energy and using these models isn’t cheap either. It’s bad for the climate in the same way cryptocurrency is.
+1, it is much worse than even proof-of-work crypto though. I think AI is the bigger enemy, since at least in crypto, there are ways of developing and using it that aren’t as bad (or even at all) for the climate.
while proof of stake is better, I still think everything crypto is a big capitalist waste of energy
AI is quite energy intensive
How energy intensive?
Like, compared to random cat videos on youtube n all?
And would the addition of renewable energy be able to handle it?
Using it, not all that energy intensive (one llm use is roughly the same as 3 pre-ai-bullshit google searches iirc). Training it, very energy intensive.
Yes it would but we haven’t even replaced all our previous needs with renewables so it aint helping.
According to this article, this is not considered true anymore:
I think there’s a reason why OpenAI, Microsoft, Google and Facebook hold the energy consumption and water usage numbers so close to their chest.
Oh damn. Very good article btw.
According to numbers floating around online, thiat would mean one llama query is around as expensive as 10 google searches. And it’s likely that those costs will increase further.
It still seems like the biggest factor here is the scale of adaptation. Unfortunately the total energy costs of AI might even scale exponentially since the more complex the queries get, the better the responses will likely be. And that will further drive adaptation.
This pace is so clearly unsustainable it’s horrifying, and while it was obvious to some degree, it seems it’s worse than I thought.
deleted by creator
7% is a fucking lot though?? That’s an immense amount of power going towards slop instead of making our lives better or growing the economy or actually being productive.
It’s like we just decided to start burning our limited reserves of natural gas for fun.
deleted by creator
The situation is already apocalyptic. Making it even worse just means we all die even faster.
Adjust your goddamn tone, when speaking with humans. You’re not prompting a so-called “AI”.
deleted by creator