论文标题

通过对解剖学上的物理结构进行深度加固学习,增强了3D MRI中胎儿姿势的检测

Enhanced detection of fetal pose in 3D MRI by Deep Reinforcement Learning with physical structure priors on anatomy

论文作者

Zhang, Molin, Xu, Junshen, Turk, Esra Abaci, Grant, P. Ellen, Golland, Polina, Adalsteinsson, Elfar

论文摘要

胎儿MRI受到不可预测和实质性胎儿运动的严重限制,该运动会导致图像伪像,并限制了可行的诊断图像对比度的集合。当前的运动伪影的缓解主要是通过快速单杆MRI和回顾性运动校正来进行的。在MRI期间实时对胎儿姿势的估计,以使前瞻性方法受益,以检测和减轻胎儿运动伪像,其中推断的胎儿运动与在线切片处方结合使用,并制定低延迟的决策。深度加固学习(DRL)的当前发展为胎儿地标检测提供了一种新颖的方法。在此任务中,DRL同时部署了15个代理商,以同时检测15个地标。优化具有挑战性,在这里我们提出了一个改进的DRL,该DRL在胎儿的物理结构上结合了先验。首先,我们使用图形通信层来改善基于图形代表胎儿标志的图形的代理之间的通信。此外,基于代理和物理结构(例如胎儿四肢)之间的距离的额外奖励用于完全利用物理结构。在3毫米分辨率数据的存储库中对该方法的评估表明,在地面真理10 mm内的地标估计值的平均准确性为87.3%,平均误差为6.9 mm。拟议的用于胎儿姿势地标搜索的DRL证明了在线检测胎儿运动的潜在临床实用性,可指导孕妇MRI期间的实时缓解运动伪像以及健康诊断。

Fetal MRI is heavily constrained by unpredictable and substantial fetal motion that causes image artifacts and limits the set of viable diagnostic image contrasts. Current mitigation of motion artifacts is predominantly performed by fast, single-shot MRI and retrospective motion correction. Estimation of fetal pose in real time during MRI stands to benefit prospective methods to detect and mitigate fetal motion artifacts where inferred fetal motion is combined with online slice prescription with low-latency decision making. Current developments of deep reinforcement learning (DRL), offer a novel approach for fetal landmarks detection. In this task 15 agents are deployed to detect 15 landmarks simultaneously by DRL. The optimization is challenging, and here we propose an improved DRL that incorporates priors on physical structure of the fetal body. First, we use graph communication layers to improve the communication among agents based on a graph where each node represents a fetal-body landmark. Further, additional reward based on the distance between agents and physical structures such as the fetal limbs is used to fully exploit physical structure. Evaluation of this method on a repository of 3-mm resolution in vivo data demonstrates a mean accuracy of landmark estimation within 10 mm of ground truth as 87.3%, and a mean error of 6.9 mm. The proposed DRL for fetal pose landmark search demonstrates a potential clinical utility for online detection of fetal motion that guides real-time mitigation of motion artifacts as well as health diagnosis during MRI of the pregnant mother.

扫码加入交流群

加入微信交流群

微信交流群二维码

扫码加入学术交流群,获取更多资源