Event-based 3D SLAM with a depth-augmented dynamic vision sensor

Weikersdorfer D, Adrian DB, Cremers D, Conradt J (2014)


Publication Type: Conference contribution

Publication year: 2014

Journal

Publisher: Institute of Electrical and Electronics Engineers Inc.

Pages Range: 359-364

Conference Proceedings Title: Proceedings - IEEE International Conference on Robotics and Automation

Event location: Hong Kong, CHN

ISBN: 9781479936854

DOI: 10.1109/ICRA.2014.6906882

Abstract

We present the D-eDVS- a combined event-based 3D sensor - and a novel event-based full-3D simultaneous localization and mapping algorithm which works exclusively with the sparse stream of visual data provided by the D-eDVS. The D-eDVS is a combination of the established PrimeSense RGB-D sensor and a biologically inspired embedded dynamic vision sensor. Dynamic vision sensors only react to dynamic contrast changes and output data in form of a sparse stream of events which represent individual pixel locations. We demonstrate how an event-based dynamic vision sensor can be fused with a classic frame-based RGB-D sensor to produce a sparse stream of depth-augmented 3D points. The advantages of a sparse, event-based stream are a much smaller amount of generated data, thus more efficient resource usage, and a continuous representation of motion allowing lag-free tracking. Our event-based SLAM algorithm is highly efficient and runs 20 times faster than realtime, provides localization updates at several hundred Hertz, and produces excellent results. We compare our method against ground truth from an external tracking system and two state-of-the-art algorithms on a new dataset which we release in combination with this paper.

Involved external institutions

How to cite

APA:

Weikersdorfer, D., Adrian, D.B., Cremers, D., & Conradt, J. (2014). Event-based 3D SLAM with a depth-augmented dynamic vision sensor. In Proceedings - IEEE International Conference on Robotics and Automation (pp. 359-364). Hong Kong, CHN: Institute of Electrical and Electronics Engineers Inc..

MLA:

Weikersdorfer, David, et al. "Event-based 3D SLAM with a depth-augmented dynamic vision sensor." Proceedings of the 2014 IEEE International Conference on Robotics and Automation, ICRA 2014, Hong Kong, CHN Institute of Electrical and Electronics Engineers Inc., 2014. 359-364.

BibTeX: Download