3D Gaussian Splatting techniques have enabled efficient photo-realistic rendering of static scenes. Recent works have extended these approaches to support surface reconstruction and tracking. However, tracking dynamic surfaces with 3D Gaussians remains challenging due to complex topology changes, such as surfaces appearing, disappearing, or splitting. To address these challenges, we propose GSTAR, a novel method that achieves photo-realistic rendering, accurate surface reconstruction, and reliable 3D tracking for general dynamic scenes with changing topology. Given multi-view captures as input, GSTAR binds Gaussians to mesh faces to represent dynamic objects. For surfaces with consistent topology, GSTAR maintains the mesh topology and tracks the meshes using Gaussians. In regions where topology changes, GSTAR adaptively unbinds Gaussians from the mesh, enabling accurate registration and the generation of new surfaces based on these optimized Gaussians. Additionally, we introduce a surface-based scene flow method that provides robust initialization for tracking between frames. Experiments demonstrate that our method effectively tracks and reconstructs dynamic surfaces, enabling a range of applications.
3D 高斯点渲染技术已经实现了高效的静态场景逼真渲染。近期的研究将这些方法扩展至支持表面重建和跟踪。然而，由于动态表面的复杂拓扑变化（例如表面出现、消失或分裂），使用 3D 高斯跟踪动态表面仍然具有挑战性。 为了解决这些问题，我们提出了 GSTAR，一种新方法，可针对拓扑变化的通用动态场景实现逼真渲染、精确表面重建和可靠的 3D 跟踪。在多视图捕获作为输入的情况下，GSTAR 将高斯绑定到网格面，用于表示动态对象。对于拓扑一致的表面，GSTAR 保持网格拓扑不变，并使用高斯跟踪网格。而在拓扑发生变化的区域，GSTAR 自适应地将高斯从网格解绑，从而通过优化后的高斯实现准确的配准并生成新表面。 此外，我们提出了一种基于表面的场景流方法，为帧间跟踪提供了稳健的初始化。实验表明，我们的方法能够有效地跟踪和重建动态表面，从而支持多种应用场景。