this post was submitted on 06 Sep 2024
8 points (83.3% liked)

Hardware

618 readers
146 users here now

All things related to technology hardware, with a focus on computing hardware.


Rules (Click to Expand):

  1. Follow the Lemmy.world Rules - https://mastodon.world/about

  2. Be kind. No bullying, harassment, racism, sexism etc. against other users.

  3. No Spam, illegal content, or NSFW content.

  4. Please stay on topic, adjacent topics (e.g. software) are fine if they are strongly relevant to technology hardware. Another example would be business news for hardware-focused companies.

  5. Please try and post original sources when possible (as opposed to summaries).

  6. If posting an archived version of the article, please include a URL link to the original article in the body of the post.


Some other hardware communities across Lemmy:

Icon by "icon lauk" under CC BY 3.0

founded 1 year ago
MODERATORS
 

Datacenters are the lifeline for its $30B ML-fueled boom

top 4 comments
sorted by: hot top controversial new old
[–] [email protected] 3 points 1 month ago (1 children)

With bleeding-edge GPUs commanding as much as a car these days — $30,000 to $40,000 a piece in the case of Nvidia's upcoming Blackwell chips — many datacenter operators have taken to using them as collateral to secure the massive loans.

That shouldn't be too much of a problem, according to our sibling site The Next Platform, which found that an investment of $1.5 billion to build, deploy, and network a cluster of roughly 16,000 H100s today would generate roughly $5.27 billion in revenues within four years.

This very much looks like a bubble. What's the return going to be like on that $5.27 B in spend over four years?

[–] [email protected] 3 points 1 month ago* (last edited 1 month ago) (1 children)

This very much looks like a bubble.

In my opinion: NVIDIA is a complete bubble from market valuation to product pricing, and I can't wait for it to burst.

What's the return going to be like on that $5.27 B in spend over four years?

I think you have the figures wrong, the investment is said to be around $1.5 billion dollars and $5.27 billion dollars is the expected return over the course of four years. If operators can get returns like that, they could break even in less than two years and profit for the remaining two years.

Question is, does the bubble burst before they could profit or what if their(datacenter operators) customers don't want to pay those prices to rent these GPU(s)? Former seems more likely to me, latter doesn't seem possible seeing the craze to put AI in everything.

[–] [email protected] 3 points 1 month ago (1 children)

I think you have the figures wrong, the investment in said to be around $1.5 billion dollars and $5.27 billion dollars is the expected return over the course of four years. If operators can get returns like that, they could break even is less than two years and profit for the remaining two years.

I was referring to the end users of this service (the clients of the cloud data centre). If they spend $5.27 B on access to cloud GPUs, what is their return on this $5.27 B spend?

[–] [email protected] 2 points 1 month ago

Good question. To be honest, I don't understand how these companies are going to be profitable and how much end users (most likely us) will be paying for the services provided using this technology.