I’m rather curious to see how the EU’s privacy laws are going to handle this.
(Original article is from Fortune, but Yahoo Finance doesn’t have a paywall)
I’m rather curious to see how the EU’s privacy laws are going to handle this.
(Original article is from Fortune, but Yahoo Finance doesn’t have a paywall)
What makes up the cost? Buying CPU cycles and storage? Just curious.
The GPU cluster. The H100 GPUs are about $40,000 each and you need many.
Interesting. Thanks.
Outside of the costs of hardware, its just power. Running these sorts of computations is getting more efficient, but the sheer amount of computation means that its gonna take a lot of electricity to run.
GPU cycles probably, but yeah. That makes up the bulk of the cost. The price of data is assuredly increasing as well, but that’s slightly beside the issue.
All of it. At that scale, you’re paying for data access, network communication, layers of storage… Basically every single step of computation becomes a meaningful cost