AI Hardware – itsabout.ai

Fine-Tuning Parameters for vLLM on Gaudi3, H200, and MI300X

Future General Healthcare Human Resources Informational Infrastructure Recruitment Security Society Technology

The rise of large language models (LLMs) has driven significant demand for efficient inference and fine-tuning frameworks. One such framework, vLLM, is optimised for high-performance serving with PagedAttention, allowing for memory-efficient execution across diverse hardware architectures. With the introduction of new AI accelerators such as Gaudi3, H200, and MI300X, optimising fine-tuning parameters is essential to […]

Simon Todd in 08 Mar 2025 No Comments

The AI Revolution: Why the Technology of Today Won’t Power the AI of the Future

Blockchain Finance Financial

Future General Healthcare Human Resources Informational Infrastructure Recruitment Security Society Technology

Artificial Intelligence (AI) is undergoing a rapid transformation, driven by advancements in hardware and software. Today, AI relies heavily on high-performance computing (HPC), GPUs, TPUs, ASICs, and optimised software frameworks. However, as AI models become more complex, the limits of current technology become apparent. This raises an important question: will the AI infrastructure we rely […]

Simon Todd in 28 Feb 2025 No Comments

Understanding Different Learning Methods in AI

Blockchain Finance Financial

Future General Healthcare Human Resources Informational Infrastructure Recruitment Security Society Technology

Artificial Intelligence (AI) has transformed the way we interact with technology, enabling automation, decision-making, and predictive analytics across various industries. At the core of AI development are different learning methodologies that dictate how models learn from data. In this blog, we will explore the key learning methods used in AI, their typical applications, how they […]

Simon Todd in 20 Feb 2025 No Comments

DeepSeek and the AI Hardware Market: A Disruptor or Just Another Competitor?

Blockchain Finance Financial

Future General Healthcare Human Resources Informational Infrastructure Recruitment Security Society Technology

The AI hardware market is rapidly evolving, driven by the increasing complexity of AI workloads. DeepSeek, a new large-scale AI model from China, has entered the scene, but its impact on the broader AI landscape remains an open question. Is it simply a competitor to OpenAI’s ChatGPT, or does it have wider implications for inferencing, […]

Simon Todd in 30 Jan 2025 No Comments