Sensitivity analysis (and partial quantization) example is also provided. The figure below shows per-layer sensitivity analysis result of efficientnet_lite0 model ...

AWQ search for accurate quantization. Pre-computed AWQ model zoo for LLMs (LLaMA, Llama2, OPT, CodeLlama, StarCoder, Vicuna, LLaVA; load to generate quantized weights). Memory-efficient 4-bit Linear ...

Abstract: Cloud-based quantization is a key technique for deploying deep neural networks on resource-constrained devices. However, the growing number of heterogeneous devices has placed an increasing ...

Abstract: Single image super-resolution (SISR) aims to reconstruct a high-resolution image from its low-resolution observation. Recent deep learning-based SISR models show high performance at the ...