Why Smaller AI Factories Matter for the Future of Sovereign AI

General

Much of the discussion around AI infrastructure is currently focused on scale. New projects are increasingly being discussed in hundreds of megawatts, with some proposed AI campuses extending into gigawatt territory. There are good reasons for this. Training increasingly capable foundation models requires enormous amounts of compute, and concentrating thousands of GPUs in a small […]

Read More
Simon Todd in No Comments

What Is It Actually Like to Live Next Door to a Data Centre?

GeneralInformationalInfrastructure
More
SocietyTechnology

Let me start with a confession: I don’t live next door to a data centre. I do, however, spend a significant amount of my working life around the technology that goes inside them, designing and thinking about AI infrastructure, power, cooling, GPUs and the increasingly difficult problem of operating extremely dense compute environments efficiently. If […]

Read More
Simon Todd in No Comments

Scaling AI Inference with Nutanix Enterprise AI: Sharding, Instances, KV Cache and Agent Gateway

General

When discussing AI inference infrastructure, the word “scaling” can mean several very different things. We might need more GPUs because a model is too large for a single GPU, more copies of a model because concurrency is increasing, or better routing between those copies because repeated context is consuming unnecessary compute. Eventually, we may also […]

Read More
Simon Todd in No Comments

The Great Data Centre Water Myth: A Reality Check on Liquid Cooling and Water Consumption

FutureGeneralInformational
More
InfrastructureSocietyTechnology

Understanding where water is actually used in modern data centres and where it isn’t. Introduction Over the past year, stories about data centres consuming vast quantities of water have become increasingly common. Headlines often suggest that modern liquid-cooled servers are continuously drawing fresh water from local supplies, while social media has amplified claims that newly […]

Read More
Simon Todd in No Comments