ChIRAAG: ChatGPT Informed Rapid and Automated Assertion Generation

Bhabesh Mali, Karthik Maddala, Vatsal Gupta, Sweeya Reddy, Chandan Karfa, Ramesh Karri

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Abstract

System Verilog Assertion (SVA) formulation- a critical yet complex task is a prerequisite in the Assertion Based Verification (ABV) process. Traditionally, SVA formulation involves expert-driven interpretation of specifications, which is time-consuming and prone to human error. Recently, LLM-informed automatic assertion generation is gaining interest. We designed a novel framework called ChIRAAG, based on OpenAI GPT4, to generate SVA from natural language specifications of a design. ChIRAAG constitutes the systematic breakdown of design specifications into a standardized format, further generating assertions from formatted specifications using LLM. Furthermore, we used few test cases to validate the LLM-generated assertions. Automatic feedback of log messages from the simulation tool to the LLM ensures that the framework can generate correct SVAs. In our experiments, only 27% of LLM-generated raw assertions had errors, which was rectified in few iterations based on the simulation log. Our results on OpenTitan designs show that LLMs can streamline and assist engineers in the assertion generation process, reshaping verification workflows.

Original languageEnglish (US)
Title of host publication2024 IEEE Computer Society Annual Symposium on VLSI
Subtitle of host publicationEmerging VLSI Technologies and Architectures, ISVLSI 2024
EditorsHimanshu Thapliyal, Jurgen Becker
PublisherIEEE Computer Society
Pages680-683
Number of pages4
ISBN (Electronic)9798350354119
DOIs
StatePublished - 2024
Event2024 IEEE Computer Society Annual Symposium on VLSI, ISVLSI 2024 - Knoxville, United States
Duration: Jul 1 2024Jul 3 2024

Publication series

NameProceedings of IEEE Computer Society Annual Symposium on VLSI, ISVLSI
ISSN (Print)2159-3469
ISSN (Electronic)2159-3477

Conference

Conference2024 IEEE Computer Society Annual Symposium on VLSI, ISVLSI 2024
Country/TerritoryUnited States
CityKnoxville
Period7/1/247/3/24

Keywords

  • Assertion Based Verification
  • Assertion Generation
  • LLM

ASJC Scopus subject areas

  • Hardware and Architecture
  • Control and Systems Engineering
  • Electrical and Electronic Engineering

Fingerprint

Dive into the research topics of 'ChIRAAG: ChatGPT Informed Rapid and Automated Assertion Generation'. Together they form a unique fingerprint.

Cite this