These processors feature AI acceleration in each core, tackling demanding AI workloads efficiently. Notably, they offer up to 42% higher inference performance and sub-100 millisecond latency for large language models under 20 billion parameters, even before incorporating discrete accelerators.
In comparison to their predecessors, the 5th Gen Xeon processors show a 21% average performance improvement in general computing and a 36% increase in performance per watt across various workloads. Users upgrading from older generations, following a typical five-year refresh cycle, could see up to a 77% reduction in TCO.
The new processors support up to 64 cores per CPU and offer nearly triple the maximum last-level cache of the previous generation. They feature eight channels of DDR5 per CPU, DDR5 support up to 5,600 megatransfers per second, and enhanced inter-socket bandwidth with Intel UPI 2.0, reaching up to 20 gigatransfers per second. Select models will also support CXL Type 3 workflows through major cloud service providers. Being pin-compatible with the 4th Gen, the 5th Gen Xeon processors will be incorporated into systems by top original equipment manufacturers (OEMs) such as Cisco, Dell, HPE, IEIT Systems, Lenovo, Super Micro Computer, and others. These will be available in both single- and dual-socket configurations starting in the first quarter of 2024.
Intel Trust Domain Extensions (Intel TDX), introduced with the 4th Gen Xeon processors and now more widely available with the 5th Gen, enhance VM-level confidentiality and security. This technology isolates guest operating systems and applications within a confidential VM from the cloud host, hypervisor, and other VMs, reinforcing data privacy and control. Intel's progression from the 4th to the 5th Gen Xeon processors reflects its commitment to its roadmap and customer needs. Future processors, including Sierra Forest with E-core efficiency and Granite Rapids with P-core performance, are expected to offer significant advances in power efficiency and performance, slated for release in the first half of 2024.
