Scaling AI Inference with Nutanix Enterprise AI: Sharding, Instances, KV Cache and Agent Gateway

General

When discussing AI inference infrastructure, the word “scaling” can mean several very different things. We might need more GPUs because a model is too large for a single GPU, more copies of a model because concurrency is increasing, or better routing between those copies because repeated context is consuming unnecessary compute. Eventually, we may also […]

Read More
Simon Todd in No Comments

The Great Data Centre Water Myth: A Reality Check on Liquid Cooling and Water Consumption

FutureGeneralInformational
More
InfrastructureSocietyTechnology

Understanding where water is actually used in modern data centres and where it isn’t. Introduction Over the past year, stories about data centres consuming vast quantities of water have become increasingly common. Headlines often suggest that modern liquid-cooled servers are continuously drawing fresh water from local supplies, while social media has amplified claims that newly […]

Read More
Simon Todd in No Comments

The Sovereign AI Paradox: Why Energy Independence May Matter More Than Data Sovereignty

FutureGeneralInformational
More
InfrastructureTechnology

For the last two years, the AI industry has been obsessed with sovereignty. Sovereign AI. Sovereign clouds. Sovereign compute. National AI factories. Regional AI ecosystems. Across Europe and beyond, governments and enterprises are racing to ensure that AI infrastructure, data, and models remain under local control. The reasoning makes sense. AI is no longer just […]

Read More
Simon Todd in No Comments

When Speed Outruns Control: DevOps, APIs, and the Infrastructure Reckoning in AI

FutureGeneralInformational
More
InfrastructureSecurityTechnology

The shift that happened quietly Over the last few years, DevOps teams have become the largest consumers of infrastructure without most organisations fully noticing the impact. It started with cloud adoption, accelerated with APIs, and has now exploded with AI. Getting access to a model is as simple as calling an endpoint. Scaling usage is […]

Read More
Simon Todd in No Comments