论文标题
医学图像生成的图像翻译 - 缺血性中风病变
Image Translation for Medical Image Generation -- Ischemic Stroke Lesions
论文作者
论文摘要
基于深度学习的疾病检测和分割算法有望改善许多临床过程。但是,这种算法需要大量的带注释的培训数据,由于数据隐私,法律障碍和非统一的数据获取协议,通常在医疗环境中无法使用。具有带注释的病理的合成数据库可以提供所需的培训数据。我们以缺血性中风的例子证明,使用基于深度学习的增强,病变细分的改善是可行的。为此,我们训练不同的图像到图像翻译模型,以合成带有语义分割图的带有中风病变的大脑体积的磁共振图像。此外,我们训练一个生成的对抗网络,以生成合成病变面膜。随后,我们将这两个组件结合在一起,以构建一个大型的合成中风图像数据库。使用U-NET评估各种模型的性能,U-NET经过训练,可在临床测试集中进行分段中风病变。 We report a Dice score of $\mathbf{72.8}$% [$\mathbf{70.8\pm1.0}$%] for the model with the best performance, which outperforms the model trained on the clinical images alone $\mathbf{67.3}$% [$\mathbf{63.2\pm1.9}$%], and is close to the human读取器骰子分数为$ \ mathbf {76.9} $%。此外,我们表明,对于仅10或50例临床病例的小数据库,与不使用合成数据的设置相比,合成数据的增强可显着改善。据我们所知,这是基于图像到图像翻译的合成数据增强的首次比较分析,并首先应用于缺血性中风。
Deep learning based disease detection and segmentation algorithms promise to improve many clinical processes. However, such algorithms require vast amounts of annotated training data, which are typically not available in the medical context due to data privacy, legal obstructions, and non-uniform data acquisition protocols. Synthetic databases with annotated pathologies could provide the required amounts of training data. We demonstrate with the example of ischemic stroke that an improvement in lesion segmentation is feasible using deep learning based augmentation. To this end, we train different image-to-image translation models to synthesize magnetic resonance images of brain volumes with and without stroke lesions from semantic segmentation maps. In addition, we train a generative adversarial network to generate synthetic lesion masks. Subsequently, we combine these two components to build a large database of synthetic stroke images. The performance of the various models is evaluated using a U-Net which is trained to segment stroke lesions on a clinical test set. We report a Dice score of $\mathbf{72.8}$% [$\mathbf{70.8\pm1.0}$%] for the model with the best performance, which outperforms the model trained on the clinical images alone $\mathbf{67.3}$% [$\mathbf{63.2\pm1.9}$%], and is close to the human inter-reader Dice score of $\mathbf{76.9}$%. Moreover, we show that for a small database of only 10 or 50 clinical cases, synthetic data augmentation yields significant improvement compared to a setting where no synthetic data is used. To the best of our knowledge, this presents the first comparative analysis of synthetic data augmentation based on image-to-image translation, and first application to ischemic stroke.