The New 5th Gen Intel® Xeon® processors now built with AI
As Intel transforms beyond a PC-centric company to address the needs of the new data-centric world, the tech giant has expanded its product offerings to provide end-to-end solutions, scaling from edge computing to 5G network, cloud, and the emerging fields of AI and autonomous driving.
In December 2023 at the “AI Everywhere” event, Intel launched its 5th Gen Intel® Xeon® processors (code-named Emerald Rapids) that deliver increased performance per watt and lower total cost of ownership (TCO) across critical workloads for artificial intelligence (AI), high performance computing (HPC), networking, storage, database and security.
This launch marks the second Xeon family upgrade in less than a year, offering customers more compute and faster memory at the same power envelope as the previous generation. The processors are software- and platform-compatible with 4th Gen Intel® Xeon® processors, allowing customers to upgrade and maximize the longevity of infrastructure investments while reducing costs and carbon emissions.
“As a result of our long-standing work with customers, partners and the developer ecosystem, we’re launching 5th Gen Intel Xeon on a proven foundation that will enable rapid adoption and scale at lower TCO. Designed for AI, our 5th Gen Intel Xeon processors provide greater performance to customers deploying AI capabilities across cloud, network and edge use cases,” said Sandra Rivera, Intel executive vice president and general manager of Data Center and AI Group, during the event.
With AI acceleration in every core, 5th Gen Xeon processors address demanding end-to-end AI workloads before customers need to add discrete accelerators — including up to 42% higher inference performance and less than 100 millisecond latency on large language models (LLMs) under 20 billion parameters.
Compared with the previous generation of Xeon, these processors deliver 21% average performance gain for general compute performance and enable 36% higher average performance per watt across a range of customer workloads. Customers following a typical five-year refresh cycle and upgrading from even older generations can reduce their TCO by up to 77%.
Building on previous generations, 5th Gen Xeon processors bring new innovations to deliver performance and efficiency benefits to customers. 5th Gen Xeon processors support up to 64 cores per CPU and nearly 3x the maximum last-level cache from the previous generation. They offer eight channels of DDR5 per CPU, support DDR5 at up to 5,600 megatransfers per second (MT/s), and increase inter-socket bandwidth with Intel UPI 2.0, offering up to 20 gigatransfers per second (GT/s). Select 5th Gen Xeon processor-based instances will support CXL Type 3 workflows through leading cloud service providers (CSPs).
The 5th Gen Xeon processors are pin-compatible with the previous generation, and top original equipment manufacturers (OEMs), including Cisco, Dell, HPE, IEIT Systems, Lenovo, Super Micro Computer and others, will offer a broad selection of single- and dual-socket systems beginning in the first quarter of 2024. Major CSPs will announce availability of 5th Gen Xeon processor-based instances throughout the year.
