MRAM Design-Technology-System Co-Optimization for Artificial Intelligence Edge Devices

Win San Khwa, Yi Lun Lu, Sai Qian Zhang, Xiaoyu Sun, Syed Shakib Sarwar, Ziyun Li, Wu Wun Chen, Jui Jen Wu, Xiaochen Peng, Kerem Akarvardar, Ming Yuan Song, Hung Li Chiang, Xinyu Bao, Yu Jen Wang, Wen Ting Chu, Harry Chuang, Yu Der Chih, Tsung Yung Jonathan Chang, Barbara De Salvo, Chiao LiuMeng Fan Chang

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Abstract

STT-MRAM shows great promise for use in artificial intelligence (AI) edge devices due to its compact bitcell area and high endurance. However, it faces read challenges because of its low TMR and RP. Conventional sense amplifiers have limitations in optimizing read energy and robustness while providing flexibility to exploit neural-net error tolerance. This article explores the design challenges of conventional sense amplifiers and examines how device parameters (TMR and RP) impact read performances. A novel capacitive-coupling sense amplifier is introduced to offer a new design space for balancing read energy and robustness. Combining the exploitation of neural-net error tolerance with sense amplifier and device co-design, a Design-Technology-System Co-Optimization (DTSCO) approach demonstrates a read energy reduction of 27.1% to 45.3% with minimal inference accuracy degradation in edge AI applications.

Original languageEnglish (US)
Title of host publication2024 IEEE International Electron Devices Meeting, IEDM 2024
PublisherInstitute of Electrical and Electronics Engineers Inc.
ISBN (Electronic)9798350365429
DOIs
StatePublished - 2024
Event2024 IEEE International Electron Devices Meeting, IEDM 2024 - San Francisco, United States
Duration: Dec 7 2024Dec 11 2024

Publication series

NameTechnical Digest - International Electron Devices Meeting, IEDM
ISSN (Print)0163-1918

Conference

Conference2024 IEEE International Electron Devices Meeting, IEDM 2024
Country/TerritoryUnited States
CitySan Francisco
Period12/7/2412/11/24

ASJC Scopus subject areas

  • Electronic, Optical and Magnetic Materials
  • Condensed Matter Physics
  • Electrical and Electronic Engineering
  • Materials Chemistry

Fingerprint

Dive into the research topics of 'MRAM Design-Technology-System Co-Optimization for Artificial Intelligence Edge Devices'. Together they form a unique fingerprint.

Cite this