Society – itsabout.ai

The Most Popular LLMs, VLLMs, and SLMs in Enterprise AI Today

Future General Healthcare Human Resources Informational Infrastructure Recruitment Security Society Technology

As enterprises rapidly adopt AI to improve efficiency, customer experience, and innovation, the choice of model architecture has become a critical factor. Whether it’s deploying a massive Large Language Model (LLM), an efficient Very Large Language Model (VLLM), or a compute-friendly Small Language Model (SLM), organisations are increasingly strategic about balancing performance, cost, and accuracy. […]

Simon Todd in 05 Jun 2025 No Comments

Fine-Tuning Parameters for vLLM on Gaudi3, H200, and MI300X

Blockchain Finance Financial

Future General Healthcare Human Resources Informational Infrastructure Recruitment Security Society Technology

The rise of large language models (LLMs) has driven significant demand for efficient inference and fine-tuning frameworks. One such framework, vLLM, is optimised for high-performance serving with PagedAttention, allowing for memory-efficient execution across diverse hardware architectures. With the introduction of new AI accelerators such as Gaudi3, H200, and MI300X, optimising fine-tuning parameters is essential to […]

Simon Todd in 08 Mar 2025 No Comments

Intel Xeon 6: Transforming AI with Next-Generation AMX Enhancements

Blockchain Finance Financial

Future General Healthcare Human Resources Informational Infrastructure Recruitment Security Society Technology

The evolution of artificial intelligence (AI) has placed increasing demands on hardware, requiring processors that deliver high efficiency, scalability, and performance. Intel’s Xeon 6 marks a substantial leap in AI capabilities, particularly in its Advanced Matrix Extensions (AMX), which have seen major improvements over Xeon 4 and Xeon 5. These enhancements make Xeon 6 a […]

Simon Todd in 05 Mar 2025 No Comments

The AI Revolution: Why the Technology of Today Won’t Power the AI of the Future

Blockchain Finance Financial

Future General Healthcare Human Resources Informational Infrastructure Recruitment Security Society Technology

Artificial Intelligence (AI) is undergoing a rapid transformation, driven by advancements in hardware and software. Today, AI relies heavily on high-performance computing (HPC), GPUs, TPUs, ASICs, and optimised software frameworks. However, as AI models become more complex, the limits of current technology become apparent. This raises an important question: will the AI infrastructure we rely […]

Simon Todd in 28 Feb 2025 No Comments