论文标题

通过基于点的细节转移,用于移动虚拟现实的Elmina城堡的数字重建

Digital Reconstruction of Elmina Castle for Mobile Virtual Reality via Point-based Detail Transfer

论文作者

Ye, Sifan, Wu, Ting, Jarvis, Michael, Zhu, Yuhao

论文摘要

从大型,密集的点云中重建3D模型对于使虚拟现实(VR)作为娱乐,教育和遗产保护的平台至关重要。现有的3D重建系统不可避免地在三个冲突的目标之间进行权衡:重建效率(例如时间和内存需求),构造场景的视觉质量以及VR设备上的渲染速度。本文提出了一个重建系统,该系统同时满足了所有三个目标。关键的想法是避免完全重建高polygon网格的资源要求过程。取而代之的是,我们建议将详细信息从原始点云直接传输到低多边形网格,从而大大减少重建时间和成本,保留场景详细信息,并在移动VR设备上实时渲染。 虽然我们的技术是一般的,但我们在重建文化遗产遗址中进行了演示。我们第一次从数十亿个激光划定的位置重建了加纳的联合国教科文组织世界遗产Elmina Castle。重建过程在低端桌面系统上执行,而无需高处理能力,从而使其可容纳广泛的社区。重建的场景在Oculus上呈现为60 fps,提供了高视觉质量的实时VR体验。我们的项目是罗切斯特大学和加纳大学之间数字Elmina努力(http://digitalmina.org/)的一部分。

Reconstructing 3D models from large, dense point clouds is critical to enable Virtual Reality (VR) as a platform for entertainment, education, and heritage preservation. Existing 3D reconstruction systems inevitably make trade-offs between three conflicting goals: the efficiency of reconstruction (e.g., time and memory requirements), the visual quality of the constructed scene, and the rendering speed on the VR device. This paper proposes a reconstruction system that simultaneously meets all three goals. The key idea is to avoid the resource-demanding process of reconstructing a high-polygon mesh altogether. Instead, we propose to directly transfer details from the original point cloud to a low polygon mesh, which significantly reduces the reconstruction time and cost, preserves the scene details, and enables real-time rendering on mobile VR devices. While our technique is general, we demonstrate it in reconstructing cultural heritage sites. We for the first time digitally reconstruct the Elmina Castle, a UNESCO world heritage site at Ghana, from billions of laser-scanned points. The reconstruction process executes on low-end desktop systems without requiring high processing power, making it accessible to the broad community. The reconstructed scenes render on Oculus Go in 60 FPS, providing a real-time VR experience with high visual quality. Our project is part of the Digital Elmina effort (http://digitalelmina.org/) between University of Rochester and University of Ghana.

扫码加入交流群

加入微信交流群

微信交流群二维码

扫码加入学术交流群,获取更多资源