3D Reconstruction of Clothes using a Human Body Model and its Application to Image-based Virtual Try-On

Matiur Rahman Minar¹

Thai Thanh Tuan¹

Heejune Ahn¹

Paul Rosin²

Yu-Kun Lai²

¹Seoul National University of Science and Technology

²Cardiff University

CVPRW 2020 3rd Workshop on Computer Vision for Fashion, Art and Design

[workshop]

[pdf]

[video]

[slide]

[bibtex]

We proposed a novel hybrid method for 3D clothing reconstruction and applying it to image-based virtual try-on (VTON) for fashion clothing, which generates realistically deformed try-on results.

Image-based virtual try-on (VTON) approaches are getting attention since they do not require 3D modeling. However, 2D cloth warping algorithms cannot cover 3D spatial transformations for diverse target human poses. To solve this problem, we propose a 2D and 3D hybrid method. First, a 3D clothing mesh is reconstructed leveraging a 3D human body model in a rest pose. Due to the correspondence, resulting 3D clothing models can be easily transferred to the target human models with different poses and shapes estimated from 2D images. Finally, the deformed clothing models can be rendered and blended with target human representations. Experimental results with an open dataset show that shapes of reconstructed clothing are more natural, compared to the 2D image-based deformation results, when human poses and shapes are estimated accurately.

Video

Visual flow

Results

Citation


							
							Matiur Rahman Minar, Thai Thanh Tuan, Heejune Ahn, Paul Rosin, and Yu-Kun Lai. "3D Reconstruction of Clothes using a Human Body Model and its Application to Image-based Virtual Try-On." In: CVPR Workshop on Computer Vision for Fashion, Art and Design (CVPRW), 2020.
					
							


							
							@InProceedings{Minar_C3DVTON_2020_CVPR_Workshops,
							
							
   	title={3D Reconstruction of Clothes using a Human Body Model and its Application to Image-based Virtual Try-On},
							
   	author={Minar, Matiur Rahman and Thai Thanh Tuan and Ahn, Heejune and Rosin, Paul and Lai, Yu-Kun},
							
   	booktitle = {The IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) Workshops},
							
   	month = {June},
							
   	year={2020}
							
}

Acknowledgements

This webpage template was borrowed from Articulation-aware CSM, who borrowed it from some colorful folks.