3DStyleGLIP: Part-Tailored Text-Guided 3D Neural Stylization
3D stylization, the application of specific styles to three-dimensional objects, offers substantial commercial potential by enabling the creation of uniquely styled 3D objects tailored to diverse scenes. Recent advancements in artificial intelligence and text-driven manipulation methods have made th...
Gespeichert in:
Hauptverfasser: | , , |
---|---|
Format: | Artikel |
Sprache: | eng |
Schlagworte: | |
Online-Zugang: | Volltext bestellen |
Tags: |
Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
|
Zusammenfassung: | 3D stylization, the application of specific styles to three-dimensional
objects, offers substantial commercial potential by enabling the creation of
uniquely styled 3D objects tailored to diverse scenes. Recent advancements in
artificial intelligence and text-driven manipulation methods have made the
stylization process increasingly intuitive and automated. While these methods
reduce human costs by minimizing reliance on manual labor and expertise, they
predominantly focus on holistic stylization, neglecting the application of
desired styles to individual components of a 3D object. This limitation
restricts the fine-grained controllability. To address this gap, we introduce
3DStyleGLIP, a novel framework specifically designed for text-driven,
part-tailored 3D stylization. Given a 3D mesh and a text prompt, 3DStyleGLIP
utilizes the vision-language embedding space of the Grounded Language-Image
Pre-training (GLIP) model to localize individual parts of the 3D mesh and
modify their appearance to match the styles specified in the text prompt.
3DStyleGLIP effectively integrates part localization and stylization guidance
within GLIP's shared embedding space through an end-to-end process, enabled by
part-level style loss and two complementary learning techniques. This neural
methodology meets the user's need for fine-grained style editing and delivers
high-quality part-specific stylization results, opening new possibilities for
customization and flexibility in 3D content creation. Our code and results are
available at https://github.com/sj978/3DStyleGLIP. |
---|---|
DOI: | 10.48550/arxiv.2404.02634 |