quantization="int8" was silently ignored for TensorRT, so INT8 looked 13% slower than FP16. I traced the slowdown to Q/DQ placement and two TensorRT bugs, then wrote the placement myself on the FP16 graph. INT8 is now faster than FP16 at every size on an RTX 5070 (1.10–1.33×) and a Tesla T4 (1.11–1.21×), for 0.5–0.85 COCO AP points.




