CO₂ Per Token: The AI Metric We’ve Been Ignoring (Until Now)

BlockchainFinanceFinancial
More
FutureGeneralHealthcareHuman ResourcesInformationalInfrastructureRecruitmentSecuritySocietyTechnology

Why the world needs to think beyond speed and cost The Blind Spot in AI’s Big Moment The UK government recently announced new plans for AI infrastructure. Other countries are doing the same, working urgently to build bigger data centers, expand AI capacity, and secure Sovereign and Confidential AI capabilities. Whenever these announcements happen, the […]

Read More
Simon Todd in No Comments

The Future of AI Isn’t in GPUs—It’s in ASICs

FutureGeneralInformational
More
InfrastructureTechnology

The AI revolution has long been powered by GPUs, especially Nvidia’s. But that era is evolving. On September 5, 2025, Broadcom confirmed a $10 billion deal to develop custom AI chips for OpenAI—chips designed specifically for AI workloads and expected to roll out in 2026. This marks a pivotal shift toward ASICs (Application-Specific Integrated Circuits). […]

Read More
Simon Todd in No Comments

Intel Gaudi 3 PCIe: A Game Changer for AI Workloads Beyond OAM

FutureGeneralInformational
More
InfrastructureTechnology

Intel’s Gaudi 3 AI accelerator has been a significant advancement in AI hardware, previously available primarily in the OAM (Open Accelerator Module) form factor. The introduction of the PCIe version marks a pivotal shift, enabling broader adoption and integration into existing enterprise infrastructures. What Is Intel Gaudi 3 PCIe? The Intel Gaudi 3 PCIe (HL-338) […]

Read More
Simon Todd in No Comments

Fine-Tuning Parameters for vLLM on Gaudi3, H200, and MI300X

BlockchainFinanceFinancial
More
FutureGeneralHealthcareHuman ResourcesInformationalInfrastructureRecruitmentSecuritySocietyTechnology

The rise of large language models (LLMs) has driven significant demand for efficient inference and fine-tuning frameworks. One such framework, vLLM, is optimised for high-performance serving with PagedAttention, allowing for memory-efficient execution across diverse hardware architectures. With the introduction of new AI accelerators such as Gaudi3, H200, and MI300X, optimising fine-tuning parameters is essential to […]

Read More
Simon Todd in No Comments