Our paper 'Coin3D: Controllable and Interactive 3D Assets Generation with Proxy-Guided Conditioning' accepted by SIGGRAPH 2024.

We present a novel controllable and interactive 3D assets modeling framework, named Coin3D. Coin3D allows users to control the 3D generation using a coarse geometry proxy assembled from basic shapes, and introduces an interactive generation workflow to support seamless local part editing while delivering responsive 3D object previewing within a few seconds. To this end, we develop several techniques, including the 3D adapter that applies volumetric coarse shape control to the diffusion model, proxy-bounded editing strategy for precise part editing, progressive volume cache to support responsive preview, and volume-SDS to ensure consistent mesh reconstruction. Extensive experiments of interactive generation and editing on diverse shape proxies demonstrate that our method achieves superior controllability and flexibility in the 3D assets generation task.

PDF: https://ybbbbt.com/publication/coin3d/coin3d.pdf
Code: https://github.com/zju3dv/Coin3D
Page: https://zju3dv.github.io/coin3d/