Weight quantization retraining for sparse and compressed spatial domain correlation filters

Dilshad Sabir, Muhammmad Abdullah Hanif, Ali Hassan, Saad Rehman, Muhammad Shafique

Research output: Contribution to journalArticlepeer-review

Abstract

Using Spatial Domain Correlation Pattern Recognition (CPR) in Internet-of-Things (IoT)-based applications often faces constraints, like inadequate computational resources and limited memory. To reduce the computation workload of inference due to large spatial-domain CPR filters and convert filter weights into hardware-friendly data-types, this paper introduces the power-of-two (Po2) and dynamic-fixed-point (DFP) quantization techniques for weight compression and the sparsity induction in filters. Weight quantization re-training (WQR), the log-polar, and the inverse log-polar geometric transformations are introduced to reduce quantization error. WQR is a method of retraining the CPR filter, which is presented to recover the accuracy loss. It forces the given quantization scheme by adding the quantization error in the training sample and then re-quantizes the filter to the desired quantization levels which reduce quantization noise. Further, Particle Swarm Optimization (PSO) is used to fine-tune parameters during WQR. Both geometric transforms are applied as pre-processing steps. The Po2 quantization scheme showed better performance close to the performance of full precision, while the DFP quantization showed further closeness to the Receiver Operator Characteristic of full precision for the same bit-length. Overall, spatial-trained filters showed a better compression ratio for Po2 quantization after retraining of the CPR filter. The direct quantization approach achieved a compression ratio of 8 at 4.37× speedup with no accuracy degradation. In contrast, quantization with a log-polar transform is accomplished at a compression ratio of 4 at 1.12× speedup, but, in this case, 16% accuracy of degradation is noticed. Inverse log-polar transform showed a compression ratio of 16 at 8.90× speedup and 6% accuracy degradation. All the mentioned accuracies are reported for a common database.

Original languageEnglish (US)
Article number351
Pages (from-to)1-44
Number of pages44
JournalElectronics (Switzerland)
Volume10
Issue number3
DOIs
StatePublished - Feb 1 2021

Keywords

  • Correlation pattern recognition
  • Dynamic-fixed-point quantization
  • Geometric pre-processing
  • Memory minimization
  • Particle swarm optimization
  • Sparsity
  • Transform
  • Weight precision reduction

ASJC Scopus subject areas

  • Control and Systems Engineering
  • Signal Processing
  • Hardware and Architecture
  • Computer Networks and Communications
  • Electrical and Electronic Engineering

Fingerprint Dive into the research topics of 'Weight quantization retraining for sparse and compressed spatial domain correlation filters'. Together they form a unique fingerprint.

Cite this