Earticle

초록

영어

In this paper, we propose a PTQ (Post Training Quantization) static with QO (Quantization Only) technique to efficiently deploy and execute deep learning models. A comparative performance evaluation of PTQ static with QDQ (Quantize and DeQuantize) and the proposed quantization method was conducted using the MNIST (Modified National Institute of Standards and Technology database) dataset and 8- bit quantization. Experimental results indicate that the PTQ static with QO method reduces the size of the model by approximately 33%, increases the inference speed by 1.5 times, and minimizes the accuracy loss, similar to the PTQ static with QDQ method. The proposed PTQ static with QO method offers a significant technical enhancement to facilitate the efficient deployment and execution of AI (Artificial Intelligence) models through the quantization of deep learning models. We have shown that the PTQ static with QO method is a beneficial and efficient approach to decrease the size and computation of deep learning models. This study makes novel contributions to the quantization of deep learning models. The practical potential of the PTQ static with QO method lies in its ability to be more suitably deployed for the purposes of AI hardware.

목차

Abstract
I. INTRODUCTION
II. QUANTIZATION METHOD
A. Quantize-Dequantize
B. Quantization-Only
III. PERFORMANCE EVALUATION
IV. CONCLUSION
ACKNOWLEDGMENT
REFERENCES

키워드

저자

• Seokhun Jeon [ SoC Platform Research Center Korea Electronics Technology Institute Seongnam, Korea ] Corresponding Author
• Kyu Hyun Choi [ SoC Platform Research Center Korea Electronics Technology Institute ]

참고문헌

발행기관

간행물

표지보기 관심저널 등록

• 간행물명

  한국차세대컴퓨팅학회 학술대회

• 간기

  반년간

• 수록기간

  2021~2025

• 십진분류

  KDC 566 DDC 004