The company announced a new generation of processors designed specifically for large-scale artificial intelligence workloads running in data centers. The design prioritizes sustained throughput across thousands of parallel execution threads rather than peak single-thread performance.
Engineers working on the architecture chose to increase the memory bandwidth available to each core, which reduces stalls when serving inference requests that repeatedly access large model weight tensors stored in DRAM.
Early benchmark results from partner deployments suggest that a fully loaded rack of the new processors can sustain more than twice the query throughput of a comparable rack equipped with the previous generation, while remaining within standard air-cooling power envelopes.
The processor integrates a high-speed interconnect fabric that allows adjacent chips on the same blade to share data without going through main memory, cutting the latency on operations that fan out across multiple model replicas simultaneously.
Software compatibility was a stated priority throughout development. All existing workloads compiled for the previous microarchitecture run without modification, and the instruction set extensions introduced for matrix operations are exposed through the same compiler intrinsics already supported by the ecosystem toolchain.
Any re-use permitted for informational and non-commercial or personal use only.