Discussion about this post

User's avatar
Kathleen's avatar

Good overview! And yes, it's the physical plant that is the greatest challenge - not the LLM's. The required power consumption, cooling requirements, resilience through back-up systems for a 24/7 operational environment. The biggest challenge to date as the investor/owners are having to contend with is location and impact on the environment - both natural and people occupied. The size of these data centres is multiple acres (city sized) and in addition to the power/water consumption is the sound (hum) and equipment lights (glow) emitted. Current projects have escalated power & water costs for neighbours and people are pushing back. More remote locations may be a solution but that will require even more fibre runs. The Facility Management industry is tracking data centre activity and providing input as this industry develops. FM is a broad industry of tech, trades, engineers, architects, planners - all involved. The challenges of both power & cooling are already producing innovative solutions. More to come. FM has long been involved from when data centres were much smaller. The challenges remain sourcing electrical power and cooling systems. Like most large infrastructure projects, they do take detailed planning and time to execute - not contained in the government AI strategy. Many site specific details. Potential neighbours need to be informed and consulted - before the site is chosen.

K Flowers's avatar

Outstanding piece! Why does this make absolute perfect sense for everyone and everything when written plainly here, -- yet never seems to ever make it to the table when planning these huge undertakings? Logic and common sense have been discarded in favor of speed and money.

Your point about training for the work on these racks as opposed to the literacy of learning from books only, has been a fundamental in the "trades". It has to be a hands-on training. There is no other way to gain the knowledge and experience to be really good at a trade. It's essential.

The Ai field is a new frontier but it still needs the basics. The whole northern cold, power, water and the clusters, I believe you call them, is indeed the optimum setting and logistics for this particular endeavor. I hope those in control will get access to this and address it now!

Terrific analysis of another subject.

Thank you. I'll share...

No posts

Ready for more?