Seminar by Giuseppe Pagano: A Practical SIMD Implementation and Analysis of Power of Two Quantization on Modern Hardware

Abstract: The rising use of AI in the last few years has greatly reshaped day-to-day productivity in many industries and caused a surge in the demand for AI-capable hardware. To reduce the imposing requirements that running a state of the art model entails many quantization techniques have been introduced.
Among them there is Power of Two Quantization (PoTQ) a novel quantization technique that replaces multiplications with bitwise shifts operations.
In this seminar we'll go over the details of PoTQ, the algorithms used to leverage it in order to improve performance thanks to it and what are the plans to measure its impact on modern hardware.