Deep 3D Body Landmarks Estimation for Smart Garments Design

Baronetto A, Wassermann D, Amft O (2021)


Publication Type: Conference contribution

Publication year: 2021

Publisher: Institute of Electrical and Electronics Engineers Inc.

Conference Proceedings Title: 2021 IEEE 17th International Conference on Wearable and Implantable Body Sensor Networks, BSN 2021

Event location: Virtual, Online, GRC GR

ISBN: 9781665403627

DOI: 10.1109/BSN51625.2021.9507035

Abstract

We propose a framework to automatically extract body landmarks and related measurements from 3D body scans and replace manual body shape estimation in fitting smart garments. Our framework comprises five steps: 3D scan acquisition and segmentation, 2D image conversion, extraction of body landmarks using a Convolutional Neural Network (CNN), back projection and mapping of extracted landmarks to 3D space, body measurements estimation and tailored garment generation. We trained and tested the algorithm on 3000 synthetic 3D body models and estimated body landmarks required for T-Shirt design. The results show that the algorithm can successfully extract 3D body landmarks of the upper front with a mean error of 1.01 cm and of the upper back with a mean error of 0.78 cm. We validated the framework the framework in automated tailoring of an electrocardiogram (ECG)-monitoring shirt based on the predicted landmarks. The ECG shirt can fit all evaluated body shapes with an average electrode-skin distance of 0.61 cm.

Authors with CRIS profile

How to cite

APA:

Baronetto, A., Wassermann, D., & Amft, O. (2021). Deep 3D Body Landmarks Estimation for Smart Garments Design. In 2021 IEEE 17th International Conference on Wearable and Implantable Body Sensor Networks, BSN 2021. Virtual, Online, GRC, GR: Institute of Electrical and Electronics Engineers Inc..

MLA:

Baronetto, Annalisa, Dominik Wassermann, and Oliver Amft. "Deep 3D Body Landmarks Estimation for Smart Garments Design." Proceedings of the 17th IEEE-EMBS International Conference on Wearable and Implantable Body Sensor Networks, BSN 2021, Virtual, Online, GRC Institute of Electrical and Electronics Engineers Inc., 2021.

BibTeX: Download