Google just announced Ironwood, their 7th-gen TPU competitor to Nvidia's Blackwell B200 GPUs

– 4,614 TFLOPs per chip (FP8)
– 192 GB HBM, 7.2 Tbps HBM bandwidth
– 1.2 Tbps bidirectional ICI
– 42.5 exaflops per 9,216-chip pod (24x El Capitan)