Low-latency communication for fast DBMS Using RDMA and shared memory

Fent P, Van Renen A, Kipf A, Leis V, Neumann T, Kemper A (2020)

Publication Type: Conference contribution

Publication year: 2020

Publisher: IEEE Computer Society

Book Volume: 2020-April

Pages Range: 1477-1488

Conference Proceedings Title: Proceedings - International Conference on Data Engineering

Event location: Dallas, TX US

ISBN: 9781728129037

DOI: 10.1109/ICDE48307.2020.00131

Abstract

While hardware and software improvements greatly accelerated modern database systems' internal operations, the decades-old stream-based Socket API for external communication is still unchanged. We show experimentally, that for modern high-performance systems networking has become a performance bottleneck. Therefore, we argue that the communication stack needs to be redesigned to fully exploit modern hardware - as has already happened to most other database system components.We propose L5, a high-performance communication layer for database systems. L5 rethinks the flow of data in and out of the database system and is based on direct memory access techniques for intra-datacenter (RDMA) and intra-machine communication (Shared Memory). With L5, we provide a building block to accelerate ODBC-like interfaces with a unified and message-based communication framework. Our results show that using interconnects like RDMA (InfiniBand), RoCE (Ethernet), and Shared Memory (IPC), L5 can largely eliminate the network bottleneck for database systems.

Authors with CRIS profile

Viktor Leis

Involved external institutions

Technische Universität München (TUM) DE Germany (DE) Friedrich-Schiller-Universität Jena DE Germany (DE)

How to cite

APA:

Fent, P., Van Renen, A., Kipf, A., Leis, V., Neumann, T., & Kemper, A. (2020). Low-latency communication for fast DBMS Using RDMA and shared memory. In Proceedings - International Conference on Data Engineering (pp. 1477-1488). Dallas, TX, US: IEEE Computer Society.

MLA:

Fent, Philipp, et al. "Low-latency communication for fast DBMS Using RDMA and shared memory." Proceedings of the 36th IEEE International Conference on Data Engineering, ICDE 2020, Dallas, TX IEEE Computer Society, 2020. 1477-1488.

BibTeX: Download