基于3D高斯溅射的矿石三维彩色重建方法研究

    Research on three-dimensional color reconstruction method of ore based on 3D Gaussian Splatting

    • 摘要: 针对矿石视觉分析局限于二维图像导致三维彩色信息和纹理特征缺失的问题,提出了一种基于3D高斯溅射(3DGS)的矿石高精度三维彩色重建方法。通过多视角图像采集系统获取矿石序列图像,基于COLMAP生成稀疏点云初始化3D高斯模型,并设计分层优化策略:首先采用3DGS算法实现矿石多尺度几何建模与实时渲染,在3D高斯建模过程中通过二维图像损失函数进行可微分渲染框架联合优化高斯参数,并结合自适应密度控制策略动态调整高斯分布密度,迭代次数固定设为30 000次,以此得到最终高质量的二维渲染图像;然后通过扩展渲染器生成深度图,基于TSDF融合多视角深度信息提升表面连续性,利用Open3D库通过体素化与Marching Cubes算法提取高精度网格模型。为验证有效性,本文以3~6 cm磷矿矿石为研究对象,系统分析图像数量对重建质量的影响,并与MVS重建方法、Poisson重建方法进行对比实验。研究表明,当输入图像量达35张时重建质量趋于稳定,呈现出了高质量重建结果,较15张图像输入时PSNR提升46.5%,SSIM提升31.4%,LPIPS降低34.8%;与MVS重建方法和Poisson重建方法相比,本文所用方法也表现出了较好的优越性,其中,PSNR分别提升了22.6%和9.2%,SSIM分别提升了20.4%和9.8%,LPIPS分别降低了27.6%和16.8%。该方法生成的矿石三维模型能有效表征矿物形貌特征,为矿产资源研究提供了低成本、高质量的三维重建解决方案。

       

      Abstract: To address the limitation of ore visual analysis confined to 2D images, which results in the loss of three-dimensional color information and textural features, this paper proposes a high-precision three-dimensional color reconstruction method for ores based on 3D Gaussian Splatting (3DGS). An ore image sequence is acquired using a multi-view image capture system. Sparse point clouds, generated by COLMAP, are used to initialize the 3D Gaussian model. A hierarchical optimization strategy is designed: firstly, the 3DGS algorithm is employed to achieve multi-scale geometric modeling and real-time rendering of the ore. During the 3D Gaussian modeling process, Gaussian parameters are jointly optimized within a differentiable rendering framework using a 2D image loss function. This is combined with an adaptive density control strategy to dynamically adjust the Gaussian distribution density. The iteration count is fixed at 30 000 to obtain the final high-quality 2D rendered images. Subsequently, the renderer is extended to generate depth maps. Multi-view depth information is fused based on Truncated Signed Distance Function (TSDF) to enhance surface continuity. The Open3D library is then utilized to extract a high-precision mesh model through voxelization and the Marching Cubes algorithm. To validate the effectiveness, 3-6 cm phosphate ores are used as the research subject. A systematic analysis is conducted on the impact of image quantity on reconstruction quality, and comparative experiments are performed against Multi-View Stereo (MVS) and Poisson reconstruction methods. The study demonstrates that reconstruction quality stabilizes when the input image count reaches 35, yielding high-quality results. Compared to using 15 input images, the Peak Signal-to-Noise Ratio (PSNR) increases by 46.5%, the Structural Similarity Index (SSIM) increases by 31.4%, and the Learned Perceptual Image Patch Similarity (LPIPS) decreases by 34.8%. Furthermore, the proposed method exhibits superior performance compared to MVS and Poisson reconstruction: PSNR increases by 22.6% and 9.2%, SSIM increases by 20.4% and 9.8%, and LPIPS decreases by 27.6% and 16.8%, respectively. The 3D ore models generated by this method effectively characterize mineral morphological features, providing a low-cost, high-quality 3D reconstruction solution for mineral resource research.

       

    /

    返回文章
    返回