QADQN: Quantum Attention Deep Q-Network for Financial Market Prediction

Siddhant Dutta, Nouhaila Innan, Alberto Marchisio, Sadok Ben Yahia, Muhammad Shafique

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Abstract

Financial market prediction and optimal trading strategy development remain challenging due to market complexity and volatility. Our research in quantum finance and reinforcement learning for decision-making demonstrates the approach of quantum-classical hybrid algorithms to tackling real-world finan-cial challenges. In this respect, we corroborate the concept with rigorous backtesting and validate the framework's performance under realistic market conditions, by including fixed transaction cost per trade. This paper introduces a Quantum Attention Deep Q-Network (QADQN) approach to address these challenges through quantum-enhanced reinforcement learning. Our QADQN architecture uses a variational quantum circuit inside a traditional deep Q-learning framework to take advantage of possible quantum advantages in decision-making. We gauge the QADQN agent's performance on historical data from major market indices, including the S&P 500. We evaluate the agent's learning process by examining its reward accumulation and the effectiveness of its experience replay mechanism. Our empirical results demonstrate the QADQN's superior performance, achieving better risk-adjusted returns with Sortino ratios of 1.28 and 1.19 for non-overlapping and overlapping test periods respectively, indicating effective downside risk management.

Original languageEnglish (US)
Title of host publicationWorkshops Program, Posters Program, Panels Program and Tutorials Program
EditorsCandace Culhane, Greg T. Byrd, Hausi Muller, Yuri Alexeev, Yuri Alexeev, Sarah Sheldon
PublisherInstitute of Electrical and Electronics Engineers Inc.
Pages341-346
Number of pages6
ISBN (Electronic)9798331541378
DOIs
StatePublished - 2024
Event5th IEEE International Conference on Quantum Computing and Engineering, QCE 2024 - Montreal, Canada
Duration: Sep 15 2024Sep 20 2024

Publication series

NameProceedings - IEEE Quantum Week 2024, QCE 2024
Volume2

Conference

Conference5th IEEE International Conference on Quantum Computing and Engineering, QCE 2024
Country/TerritoryCanada
CityMontreal
Period9/15/249/20/24

Keywords

  • Decision-Making
  • Quantum Finance
  • Quantum Reinforcement Learning

ASJC Scopus subject areas

  • Computational Theory and Mathematics
  • Computer Networks and Communications
  • Hardware and Architecture
  • Signal Processing
  • Electrical and Electronic Engineering
  • Safety, Risk, Reliability and Quality
  • Computational Mathematics
  • Statistical and Nonlinear Physics

Fingerprint

Dive into the research topics of 'QADQN: Quantum Attention Deep Q-Network for Financial Market Prediction'. Together they form a unique fingerprint.

Cite this