3DCodeVerse: Exploring 3D Worlds as Code
초록
We introduce 3DCodeVerse, a research ecosystem that enables coding agents to create editable and verifiable 3D content at scale. 3DCodeVerse comprises large-scale, high-quality datasets of executable 3D code, a coding harness for spatial reasoning and automated verification, and practical guidance for 3D coding. First, we construct 3DCodeVerse-2M, a large-scale curated dataset of standalone 3D executable code. We build this corpus by collecting open-source data, converting specialized representations, and generating new programs with coding agents. Each program is packaged with the source files and associated assets required for execution in its declared environment, along with available descriptions and verification records. Second, we develop the 3DCodeVerse Harness, a multi-agent directed acyclic graph framework for generating and refining 3D content. It uses execution checks, spatial measurements, and visual feedback to automatically evaluate and revise generated programs without human feedback during generation. Third, we conduct systematic empirical studies of 3D coding, establishing baselines with fine-tuned open models and deriving practical guidance through component-level analyses of our harness. Extensive experiments demonstrate that fine-tuning on our dataset significantly improves the 3D coding capabilities of open-source models. Notably, our 3DCodeVerse harness achieves a 90% win rate against Claude Design (3D Object) in pairwise human evaluations, when both are utilized by Claude Opus 5.5.
저자 (19명)
- Yipeng Gao — LinkedIn 검색
- Ziyao Zeng — LinkedIn 검색
- Jinfa Huang — LinkedIn 검색
- Yijiang Li — LinkedIn 검색
- Haolin Xiong — LinkedIn 검색
- Wang Qin — LinkedIn 검색
- Xinlei Yu — LinkedIn 검색
- Youheng Yao — LinkedIn 검색
- Jie Zhang — LinkedIn 검색
- Kun-Yu Lin — LinkedIn 검색
- Rong Liu — LinkedIn 검색
- Yinyuan Zhao — LinkedIn 검색
- Yajie Zhao — LinkedIn 검색
- Meiqi Guo — LinkedIn 검색
- Jiebo Luo — LinkedIn 검색
- Lei Shu — LinkedIn 검색
- Yunhao Ge — LinkedIn 검색
- Xinyu Hu — LinkedIn 검색
- Laurent Itti — LinkedIn 검색
저자 LinkedIn 변경 추적은 추후 자동화 예정입니다. 현재는 검색 링크를 제공합니다.