A Real-Time Four-Dimensional Reconstruction Algorithm of Cine-Magnetic Resonance Imaging (Cine-MRI) Using Deep Learning

Purpose The purpose of this study is to propose algorithms and methods for achieving high accuracy in tracking and interception irradiation technology for tumors that move by respiration using MR-linac (MRIdian®, ViewRay Inc.) and to use deep learning to predict the movement of moving tumors in real time during radiation therapy and reconstruct cine magnetic resonance imaging (cine-MRI) into four-dimensional (4D) movies. Methods In this study, we propose a reconstruction algorithm using 4DCT for treatment planning taken before irradiation as training data in consideration of the actual treatment flow. In the algorithm, two neural networks made before treatment are used to reconstruct 4D movies that predict tumor movement in real time during treatment. Cycle GAN (generative adversarial network) was used to convert MR images to CT images, and long short-term memory was used to convert cine-MRI to 4D movies and predict tumor movement. Results We succeeded in predicting the time including the imaging time of the MR images, the lag until irradiation, and the calculation time in the algorithm. In addition, the conversion and prediction results at each phase of reconstruction were generally good so that they could be clinically applied. Conclusions The reconstruction algorithm proposed in this study enables high-precision radiotherapy while predicting the volume information of the tumor and the actual tumor position, which could not be obtained during radiotherapy.