141
submitted 1 week ago by [email protected] to c/[email protected]

AI’s voracious need for computing power is threatening to overwhelm energy sources, requiring the industry to change its approach to the technology, according to Arm Holdings Plc Chief Executive Officer Rene Haas.

top 50 comments
sorted by: hot top controversial new old
[-] [email protected] 43 points 1 week ago

I wonder if they made an error as simple as this in their projections. There’s no guarantee that AI interest continues to grow.

[-] [email protected] 31 points 1 week ago

I can't think of a single thing AI does that is worth the amount of energy consumption.

[-] [email protected] 4 points 1 week ago

The only really useful AI thing is the denoiser in Adobe Lightroom. I can shoot pictures in pitch black darkness with the highest ISO settings. Obviously it is a grainy mess. The denoiser manages to clean that up while retaining all of the details. It's really fucking great!

Anything else is just novelty bullshit.

[-] [email protected] 2 points 1 week ago

Sounds useful, but not at all worth the amount of energy being used to produce AI. You could just use that energy to feed/house people who could do the labor of denoising.

[-] [email protected] 3 points 1 week ago

I know what you mean, but it's not really possible to manually denoise a picture the way the AI denoiser does. Let alone within 10 seconds. Plus, it's more of a niche usage. I don't think it consumes all that much energy.

Generating shitty images, creating deepfakes, prompting all kinds of bullshit... now that is a waste of energy as it really just makes the world worse. AI generated articles are popping up all over the internet. They aren't even reviewed anymore. Enshittification of the internet took some gigantic strides since the AI boom.

[-] [email protected] 2 points 1 week ago

Do you know if the model is running locally or some cloud shit? If locally, the actual energy usage may be modest.

Energy spent training the model initially may have been prohibitive, though.

[-] [email protected] 1 points 1 week ago

Good question, I'll look it up!

[-] [email protected] 1 points 1 week ago

I can’t think of a single thing AI does

[-] [email protected] 7 points 1 week ago* (last edited 1 week ago)

Come on that's not fair, it's very good* at drawing album covers and video game assets, which gives more time to artists to go work for Starbucks or Amazon instead of doing something they actually enjoy.

* passable actually, but much cheaper.

[-] [email protected] 4 points 1 week ago

I'm not in the industry per se, but I wouldn't hire an AI to do art for my games or album covers.

[-] [email protected] 5 points 1 week ago
[-] [email protected] 2 points 1 week ago

I'm glad to know AI can't think of a single thing AI does, although if it thought otherwise I still wouldn't care.

[-] [email protected] 2 points 1 week ago

Correction, AI in the LLM/Diffusion sense is a decent tutor for cheap. Can cobble together rough temp art, and if used by an actually capable artist, make cool stuff.

Anything else and it's a garbage firehose, it's the undisputed king of mediocrity. Which, given the standards of SPAM and the modern web, is exactly what it's being used for.

What a shame.

[-] [email protected] 3 points 1 week ago

Anything you learn from AI has a margin of error that could ruin you.

[-] [email protected] 4 points 1 week ago

And we're rapidly liquidating the reserves of useful information in order to feed this beast.

Google results are declining as websites like Stack Exchange and Reddit crap out, Wikipedia pages are filling up with misinformation, news articles are increasingly full of nonsense and procedural generated fluff.

Its not just garbage on its face. Its a cancer that's spreading through the rest of our internet archives, blotting out the good and bloating front pages with bad data.

[-] [email protected] 5 points 1 week ago

It also gets worse every generation as it recursively feeds on the bad data.

[-] [email protected] -3 points 1 week ago

Still saves a ton of time from learning from either somewhat related tutorials. Garbage courses. Or digging through the modern spam infested web.

It's a decent tutor, never said that it's perfect. I will not hesitate that using it as an assistant has bumped up my productivity and learning by roughly 50% when it comes to programming.

Of course, it has it's myriad problems, specially in bleeding edge fields like AI development with libraries iterating sometimes nightly. As well as it's trend to not exactly teach, but instead answer your specific question. So you still need to have some initiative and still rely on a few human resources.


HOWEVER, I do agree that blindly copy pasting code from an AI is a TERRIBLE idea. And all the buzz about AI developers seems like a disaster waiting to happen (and it certainly will!).

load more comments (4 replies)
[-] [email protected] 25 points 1 week ago

Sounds like some sensationalized bullshit. They don't give a single number or meaningful statement and they are paywalled.

[-] [email protected] 20 points 1 week ago

I don't disagree that they should back up their claim, but it does intuitively make sense. AI - GPT LLMs in particular - are typically designed to push the limits of what modern hardware can provide - essentially eating whatever power you can throw at it.

Pair this with a huge AI boom and corporate hype cycle, and it wouldn't surprise me if it was consuming an incredible amount of power. It's reminiscent of Bitcoin, from a resource perspective.

load more comments (8 replies)
[-] [email protected] 19 points 1 week ago

I wonder why countries let them.

Using up more electric power than there's available is NOT a simple matter of demand and supply.

If they actually pull too much from the grid, they are going to cause damage to others, and maybe even to the grid itself.

[-] [email protected] 1 points 1 week ago

Because they're not actually pulling too much from the grid to cause damage to others or even the grid itself.

Any musings about curtailing AI due to power consumption is just bullshit for clicks. We'll improve efficiency and increase productivity, but we won't reduce usage.

[-] [email protected] 1 points 1 week ago* (last edited 1 week ago)

Improving the models doesn't seem to work: https://arxiv.org/abs/2404.04125?

We comprehensively investigate this question across 34 models and five standard pretraining datasets (CC-3M, CC-12M, YFCC-15M, LAION-400M, LAION-Aesthetics), generating over 300GB of data artifacts. We consistently find that, far from exhibiting "zero-shot" generalization, multimodal models require exponentially more data to achieve linear improvements in downstream "zero-shot" performance, following a sample inefficient log-linear scaling trend.

It's taking exponentially more data to get better results, and therefore, exponentially more energy. Even if something like analog training chips reduce energy usage ten fold, the exponential curve will just catch up again, and very quickly with results only marginally improved. Not only that, but you have to gather that much more data, and while the Internet is a vast datastore, the AI models have already absorbed much of it.

The implication is that the models are about as good as they will be without more fundamental breakthroughs. The thing about breakthroughs like that is that they could happen tomorrow, they could happen in 10 years, they could happen in 1000 years, or they could happen never.

Fermat's Last Theorem remained an open problem for 358 years. Squaring the Circle remained open for over 2000 years. The Riemann Hypothesis has remained unsolved after more than 150 years. These things sometimes sit there for a long, long time, and not for lack of smart people trying to solve them.

[-] [email protected] 18 points 1 week ago

Yeah, don't AI everything, please.

[-] [email protected] 13 points 1 week ago

Soon they'll need to make Duracells out of humans

[-] [email protected] 11 points 1 week ago

main use cases: government surveillance and chatbot girl friends

[-] [email protected] 10 points 1 week ago

They finally reached crypto miner level awareness.

[-] [email protected] 8 points 1 week ago

Weird metric, but ok.

[-] [email protected] 4 points 1 week ago

It won't be needed because nobody will have a job to pay for it. I forsee kurt vonnegut's book "Player Piano" on steroids.

[-] [email protected] 2 points 1 week ago

This focus on individual applications shifts blame onto consumers, when we should be demanding that energy prices include the external cost of production. It's like guilt tripping over the "carbon footprint" (invented by big oil) of your car.

[-] [email protected] 0 points 1 week ago

Take that, India! 😎

load more comments
view more: next ›
this post was submitted on 06 May 2024
141 points (89.4% liked)

Technology

54242 readers
4434 users here now

This is a most excellent place for technology news and articles.


Our Rules


  1. Follow the lemmy.world rules.
  2. Only tech related content.
  3. Be excellent to each another!
  4. Mod approved content bots can post up to 10 articles per day.
  5. Threads asking for personal tech support may be deleted.
  6. Politics threads may be removed.
  7. No memes allowed as posts, OK to post as comments.
  8. Only approved bots from the list below, to ask if your bot can be added please contact us.
  9. Check for duplicates before posting, duplicates may be removed

Approved Bots


founded 11 months ago
MODERATORS