AI Infrastructure – itsabout.ai

Open Ethernet vs. InfiniBand for AI Fabrics: What’s Different, Why Ethernet Is Surging, and Where Both Still Hurt

AI clusters live or die by their network. When you stitch together thousands of GPUs, the fabric becomes a first-class accelerator: it must deliver brutal bandwidth, ultra-low tail latency, clean congestion control, and predictable job completion times. For years, InfiniBand (IB) owned that story. Today, “Open Ethernet” fabrics—multi-vendor Ethernet with open software (e.g., SONiC) and […]

Simon Todd in 01 Oct 2025 No Comments

LLMs vs SLMs: Why Smaller Models Could Power the Future of Agentic AI

Future General Informational

Infrastructure Technology

The AI landscape has been dominated by Large Language Models (LLMs)—massive neural networks trained on trillions of tokens, spanning hundreds of billions of parameters. These models, such as GPT-4 or Claude, have shown remarkable general-purpose intelligence, but they come with steep costs: enormous compute requirements, GPU dependency, and operational overheads that make them inaccessible for […]

Simon Todd in 13 Sep 2025 No Comments

The Future of AI Isn’t in GPUs—It’s in ASICs

Future General Informational

Infrastructure Technology

The AI revolution has long been powered by GPUs, especially Nvidia’s. But that era is evolving. On September 5, 2025, Broadcom confirmed a $10 billion deal to develop custom AI chips for OpenAI—chips designed specifically for AI workloads and expected to roll out in 2026. This marks a pivotal shift toward ASICs (Application-Specific Integrated Circuits). […]

Simon Todd in 07 Sep 2025 No Comments

Intel Gaudi 3 PCIe: A Game Changer for AI Workloads Beyond OAM

Future General Informational

Infrastructure Technology

Intel’s Gaudi 3 AI accelerator has been a significant advancement in AI hardware, previously available primarily in the OAM (Open Accelerator Module) form factor. The introduction of the PCIe version marks a pivotal shift, enabling broader adoption and integration into existing enterprise infrastructures. What Is Intel Gaudi 3 PCIe? The Intel Gaudi 3 PCIe (HL-338) […]

Simon Todd in 04 Aug 2025 No Comments