Cross-modal Learning of Graph Representations using Radar Point Cloud for Long-Range Gesture Recognition
Hazra S, Feng H, Kiprit GN, Stephan M, Servadei L, Wille R, Weigel R, Santra A (2022)
Publication Type: Conference contribution
Publication year: 2022
Publisher: IEEE Computer Society
Book Volume: 2022-June
Pages Range: 350-354
Conference Proceedings Title: Proceedings of the IEEE Sensor Array and Multichannel Signal Processing Workshop
Event location: Trondheim, NOR
ISBN: 9781665406338
DOI: 10.1109/SAM53842.2022.9827785
Abstract
Gesture recognition is one of the most intuitive ways of interaction and has gathered particular attention for human computer interaction. Radar sensors possess multiple intrinsic properties, such as their ability to work in low illumination, harsh weather conditions, and being low-cost and compact, making them highly preferable for a gesture recognition solution. However, most literature work focuses on solutions with a limited range that is lower than a meter. We propose a novel architecture for a long-range (1m - 2m) gesture recognition solution that leverages a point cloud-based cross-learning approach from camera point cloud to 60-GHz FMCW radar point cloud, which allows learning better representations while suppressing noise. We use a variant of Dynamic Graph CNN (DGCNN) for the cross-learning, enabling us to model relationships between the points at a local and global level and to model the temporal dynamics a Bidirectional Long short-term memory (LSTM) network is employed. In the experimental results section, we demonstrate our model's overall accuracy of 98.4% for five gestures and its generalization capability.
Authors with CRIS profile
Involved external institutions
Germany (DE)How to cite
APA:
Hazra, S., Feng, H., Kiprit, G.N., Stephan, M., Servadei, L., Wille, R.,... Santra, A. (2022). Cross-modal Learning of Graph Representations using Radar Point Cloud for Long-Range Gesture Recognition. In Proceedings of the IEEE Sensor Array and Multichannel Signal Processing Workshop (pp. 350-354). Trondheim, NOR: IEEE Computer Society.
MLA:
Hazra, Souvik, et al. "Cross-modal Learning of Graph Representations using Radar Point Cloud for Long-Range Gesture Recognition." Proceedings of the 12th IEEE Sensor Array and Multichannel Signal Processing Workshop, SAM 2022, Trondheim, NOR IEEE Computer Society, 2022. 350-354.
BibTeX: Download