Updated ComfyUI-SeedVR2-VideoUpscaler-with-TensorRT v1.6.6 - Native ConvRot W4A8 Support & DisTorch2 Scope

Key points

• Firstly, as for the advantages of w4a8, benchmark results clearly show that the quality is superior to that of NVFP4.1
• On the other hand, what wasn’t as good as I’d hoped was that VRAM consumption was almost on a par with ConvRot INT8 (though, given that w4a8 expands weights to 8 bits, this was to be expected), and that with Distorch2—which I’d gone to such lengths to implement—VRAM usage actually skyrocketed, rendering it unusable.1
• The on/off function for Norm BF16, which was previously implemented in Distorch2 to counteract VRAM spikes, has now also been implemented in the Legacy Loader.1
• Enabling this feature allows you to suppress VRAM spikes by up to approximately 3GB, albeit at the cost of a slight reduction in image quality.1

Sources (1)

• [1]Updated ComfyUI-SeedVR2-VideoUpscaler-with-TensorRT v1.6.6 - Native ConvRot W4A8 Support & DisTorch2 Scope
  r/StableDiffusion (top, day) · Oct 11, 01:14 PM

  The other day, when I published information about v1.5.7, I received a request in the comments regarding support for w4a8.

  Firstly, as for the advantages of w4a8, benchmark results clearly show that the quality is superior to that of NVFP4.

Extractive summary: sentences quoted from the sources.