How five separate silicon dies form a single server brain

How five separate silicon dies form a single server brain
Image: Intellect (generated)

In short: Modern high-performance computing is hitting a physical wall. To pack more power into a single chip without it melting or becoming impossibly large, engineers are moving away from monolithic designs toward complex multi-die architectures that stitch together multiple pieces of silicon into one cohesive unit.

Intel's Granite Rapids architecture represents a significant shift in server processor design. Rather than relying on a single piece of silicon, Granite Rapids utilizes a packaging technique called Embedded Multi-die Interconnect Bridge (EMIB). To link as many as five distinct dies, this method places a silicon bridge inside an organic substrate. This approach is necessary because a traditional silicon interposer—the standard method for connecting multiple dies—would be prohibitively large in area to accommodate all five dies required for this processor.

The architecture follows a bifurcated strategy announced by Intel in February 2022, splitting the Xeon line into P-core (Performance) and E-core (Efficiency) tracks. Granite Rapids sits on the high-performance track, utilizing Redwood Cove P-cores. These cores feature an increased L1 cache of 112KB per core—doubling the instructions cache from previous generations—and a new Matrix Engine for AI inference acceleration. While it targets heavy computing workloads, it also supports advanced AVX-512 and AVX-512-FP16 instructions.

Memory and I/O are equally complex. The processor can support up to 12 memory channels of DDR5-8800, utilizing Multiplexer Combined Ranks (MCR) DIMMs to bypass physical space constraints on motherboards. For connectivity, it features 136 PCIe 5.0 lanes and can function as a standalone SoC with self-booting capabilities. This architecture allows the processor to scale from mainstream server applications, using smaller LGA 4710 sockets, to advanced performance tiers requiring larger LGA 7529 sockets for up to 128 cores.

The rollout of Granite Rapids marks a rebranding era for Intel, retiring the 'Xeon Scalable' name in favor of 'Xeon 6'. This transition emphasizes generation numbers and aligns the branding with Core Ultra processors. By combining these multi-die packaging techniques with specific core architectures like Redwood Cove, Intel aims to balance high core density with the energy efficiency required by modern cloud and AI infrastructures.

Opens the Intellect+ feed with this card first. Swipe up for the next one.

Sources

To cite this card, link to https://intellectplus.co.uk/app/science-granite-rapids.

How we source, check and correct cards: Editorial standards.

General information, not professional advice. Spotted an error? Flag the card or see corrections and complaints.

Intellect Plus is a visual educational discovery platform for exploring fascinating facts and ideas. Brain Food, Not Brain Rot. What is Intellect Plus?

Related

Finding something worth knowing…