TY - JOUR
T1 - Skew-CIM
T2 - Process-Variation-Resilient and Energy-Efficient Computation-in-Memory Design Technique With Skewed Weights
AU - Yi, Donghyeon
AU - Lee, Seoyoung
AU - Choi, Injun
AU - Yun, Gichan
AU - Choi, Edward Jongyoon
AU - Park, Jonghee
AU - Kwak, Jonghoon
AU - Jang, Sung Joon
AU - Ha, Sohmyung
AU - Chang, Ik Joon
AU - Je, Minkyu
N1 - Publisher Copyright:
© 2004-2012 IEEE.
PY - 2024/5/1
Y1 - 2024/5/1
N2 - In analog-mixed-signal (AMS) compute-in-memory (CIM) systems, the two's-complement (2SC) format provides better area efficiency than the sign-and-magnitude (SNM) one. However, the 2SC format exacerbates the challenges of AMS-CIM systems, suffering from significant DNN accuracy drop under process variations and high computation currents from activating multiple WLs. In the 2SC format, '0' and '1' are nearly balanced for all logical-order bits, unlike '0'-skewed higher-order bits in the SNM format. Consequently, the 2SC-based AMS-CIM systems have much more on-cells than the SNM-based counterpart, deteriorating the above challenges. We propose Skew-CIM, a software-hardware co-design technique to relax these challenges. Our proposed weight skewing (WESK) breaks the '0' and '1' balance at the software level. The potential accuracy drops resulting from WESK are successfully compensated by retraining DNNs. The offsets caused by WESK can be easily corrected using online hardware-level processing. Our Skew-CIM technique can be applied to most AMS-CIM systems with memories showing large on-off cell current ratios. As an example, we use it in a custom-designed 8T-SRAM-based CIM device, demonstrating a significant reduction in the DNN classification error by 7.6 times compared to the 2SC-based AMS-CIM without our Skew-CIM technique. Furthermore, our Skew-CIM markedly enhances energy efficiency by up to 39.9%, outperforming conventional SNM-based AMS-CIM systems.
AB - In analog-mixed-signal (AMS) compute-in-memory (CIM) systems, the two's-complement (2SC) format provides better area efficiency than the sign-and-magnitude (SNM) one. However, the 2SC format exacerbates the challenges of AMS-CIM systems, suffering from significant DNN accuracy drop under process variations and high computation currents from activating multiple WLs. In the 2SC format, '0' and '1' are nearly balanced for all logical-order bits, unlike '0'-skewed higher-order bits in the SNM format. Consequently, the 2SC-based AMS-CIM systems have much more on-cells than the SNM-based counterpart, deteriorating the above challenges. We propose Skew-CIM, a software-hardware co-design technique to relax these challenges. Our proposed weight skewing (WESK) breaks the '0' and '1' balance at the software level. The potential accuracy drops resulting from WESK are successfully compensated by retraining DNNs. The offsets caused by WESK can be easily corrected using online hardware-level processing. Our Skew-CIM technique can be applied to most AMS-CIM systems with memories showing large on-off cell current ratios. As an example, we use it in a custom-designed 8T-SRAM-based CIM device, demonstrating a significant reduction in the DNN classification error by 7.6 times compared to the 2SC-based AMS-CIM without our Skew-CIM technique. Furthermore, our Skew-CIM markedly enhances energy efficiency by up to 39.9%, outperforming conventional SNM-based AMS-CIM systems.
KW - Computation-in-memory (CIM)
KW - analog computing
KW - deep neural network
KW - skewed weights
KW - two's complement
UR - http://www.scopus.com/inward/record.url?scp=85188699669&partnerID=8YFLogxK
UR - http://www.scopus.com/inward/citedby.url?scp=85188699669&partnerID=8YFLogxK
U2 - 10.1109/TCSI.2024.3372392
DO - 10.1109/TCSI.2024.3372392
M3 - Article
AN - SCOPUS:85188699669
SN - 1549-8328
VL - 71
SP - 2067
EP - 2078
JO - IEEE Transactions on Circuits and Systems I: Regular Papers
JF - IEEE Transactions on Circuits and Systems I: Regular Papers
IS - 5
ER -