Automatic multi-organ segmentation in thorax CT images using U-Net-GAN

Yang Lei, Yingzi Liu, Xue Dong, Sibo Tian, Tonghe Wang, Xiaojun Jiang, Kristin Higgins, Jonathan J. Beitler, David S. Yu, Tian Liu, Walter J. Curran, Yi Fang, Xiaofeng Yang

Research output: Chapter in Book/Report/Conference proceedingConference contribution


We propose a method to automatically segment multiple organs at risk (OARs) from routinely-acquired thorax CT images using generative adversarial network (GAN). Multi-label U-Net was introduced in generator to enable end-to-end segmentation. Esophagus and spinal cord location information were used to train the GAN in specific regions of interest (ROI). The probability maps of new CT thorax multi-organ were generated by the well-trained network and fused to reconstruct the final contour. This proposed algorithm was evaluated using 20 patients' data with thorax CT images and manual contours. The mean Dice similarity coefficient (DSC) for esophagus, heart, left lung, right lung and spinal cord was 0.73±0.04, 0.85±0.02, 0.96±0.01, 0.97±0.02 and 0.88±0.03. This novel deep-learning-based approach with the GAN strategy can automatically and accurately segment multiple OARs in thorax CT images, which could be a useful tool to improve the efficiency of the lung radiotherapy treatment planning.

Original languageEnglish (US)
Title of host publicationMedical Imaging 2019
Subtitle of host publicationComputer-Aided Diagnosis
EditorsKensaku Mori, Horst K. Hahn
ISBN (Electronic)9781510625471
StatePublished - 2019
EventMedical Imaging 2019: Computer-Aided Diagnosis - San Diego, United States
Duration: Feb 17 2019Feb 20 2019

Publication series

NameProgress in Biomedical Optics and Imaging - Proceedings of SPIE
ISSN (Print)1605-7422


ConferenceMedical Imaging 2019: Computer-Aided Diagnosis
Country/TerritoryUnited States
CitySan Diego


  • CT thorax multi-organ
  • End-to-end
  • Generative adversarial network
  • U-Net

ASJC Scopus subject areas

  • Electronic, Optical and Magnetic Materials
  • Atomic and Molecular Physics, and Optics
  • Radiology Nuclear Medicine and imaging
  • Biomaterials


Dive into the research topics of 'Automatic multi-organ segmentation in thorax CT images using U-Net-GAN'. Together they form a unique fingerprint.

Cite this