Interactive Stroke-based Neural SDF Sculpting

High Performance Graphics, 2025

Fizza Rubab, Yiying Tong
Michigan State University

Abstract

Recent advances in implicit neural representations have made them a popular choice for modeling 3D geometry. However, directly editing these representations presents challenges due to the complex relationship between model weights and surface geometry, as well as the slow optimization required to update neural fields. Among various editing tools, sculpting stands out as a valuable operation for the graphics and modeling community. While traditional mesh-based tools like ZBrush enable intuitive edits, a comparable high-performance toolkit for sculpting neural SDFs is currently lacking. We introduce a framework that enables interactive surface sculpting directly on neural implicit representations with optimized performance. Unlike previous methods, which are limited to spot edits, our approach allows users to perform stroke-based modifications on the fly, ensuring intuitive shape manipulation without switching representations. By employing tubular neighborhoods to sample strokes and customizable brush profiles, we achieve smooth deformations along user-defined curves, providing intuitive control over the sculpting process. Our method demonstrates that versatile edits can be achieved while preserving the smooth nature of implicit representations, all without compromising interactive performance.

Results

Result 1
Examples of edits using different brush profiles and modulation functions. Above each shape, the left plot shows the brush profile, and the right plot shows the modulation
Result 2
Editing sequence on a flying-unicorn model. For each step, the plot above the arrow shows the modulation curve, while the plot below shows the brush profile. The user successively sculpts tufts on the mane, stylizes the tail, and adds decorative ridges to the wings.

3D Edits Gallery


This website is licensed under the Creative Commons Attribution 4.0 International License.