Model-based tracking at 300hz using raw time-of-flight observations
Stuehmer J, Nowozin S, Fitzgibbon A, Szeliski R, Perry T, Acharya S, Cremers D, Shotton J (2015)
Publication Type: Conference contribution
Publication year: 2015
Publisher: Institute of Electrical and Electronics Engineers Inc.
Book Volume: 2015 International Conference on Computer Vision, ICCV 2015
Pages Range: 3577-3585
Conference Proceedings Title: Proceedings of the IEEE International Conference on Computer Vision
Event location: Santiago, CHL
ISBN: 9781467383912
Abstract
Consumer depth cameras have dramatically improved our ability to track rigid, articulated, and deformable 3D objects in real-time. However, depth cameras have a limited temporal resolution (frame-rate) that restricts the accuracy and robustness of tracking, especially for fast or unpredictable motion. In this paper, we show how to perform model-based object tracking which allows to reconstruct the object's depth at an order of magnitude higher frame-rate through simple modifications to an off-the-shelf depth camera. We focus on phase-based time-of-flight (ToF) sensing, which reconstructs each low frame-rate depth image from a set of short exposure 'raw' infrared captures. These raw captures are taken in quick succession near the beginning of each depth frame, and differ in the modulation of their active illumination. We make two contributions. First, we detail how to perform model-based tracking against these raw captures. Second, we show that by reprogramming the camera to space the raw captures uniformly in time, we obtain a 10x higher frame-rate, and thereby improve the ability to track fast-moving objects.
Involved external institutions
Technische Universität München (TUM)
Germany (DE)
Microsoft Research Lab UK
United Kingdom (GB)
Microsoft Corporation
United States (USA) (US)
Germany (DE)
Microsoft Research Lab UK
United Kingdom (GB)
Microsoft Corporation
United States (USA) (US)
How to cite
APA:
Stuehmer, J., Nowozin, S., Fitzgibbon, A., Szeliski, R., Perry, T., Acharya, S.,... Shotton, J. (2015). Model-based tracking at 300hz using raw time-of-flight observations. In Proceedings of the IEEE International Conference on Computer Vision (pp. 3577-3585). Santiago, CHL: Institute of Electrical and Electronics Engineers Inc..
MLA:
Stuehmer, Jan, et al. "Model-based tracking at 300hz using raw time-of-flight observations." Proceedings of the 15th IEEE International Conference on Computer Vision, ICCV 2015, Santiago, CHL Institute of Electrical and Electronics Engineers Inc., 2015. 3577-3585.
BibTeX: Download