Genuine-friend.com The Exaflop machine achieves a total peak performance of 1 Exaflop (int8/fp8) by using 256 H100 GPUs. Each H100 GPU has a peak performance of 4 PFLOPs (int8/fp8). The H100 GPUs were connected using the NVLink Switch System, which supports up to 256 GPUs and delivers 57.6 TB/sec of all-to-all bandwidth.