On the impact of memory allocation on high-performance query processing

Durner D, Leis V, Neumann T (2019)


Publication Type: Conference contribution

Publication year: 2019

Publisher: Association for Computing Machinery

Conference Proceedings Title: Proceedings of the ACM SIGACT-SIGMOD-SIGART Symposium on Principles of Database Systems

Event location: Amsterdam NL

ISBN: 9781450368018

DOI: 10.1145/3329785.3329918

Abstract

Somewhat surprisingly, the behavior of analytical query engines is crucially affected by the dynamic memory allocator used. Memory allocators highly influence performance, scalability, memory efficiency and memory fairness to other processes. In this work, we provide the first comprehensive experimental analysis on the impact of memory allocation for high-performance query engines. We test five state-of-the-art dynamic memory allocators and discuss their strengths and weaknesses within our DBMS. The right allocator can increase the performance of TPC-DS (SF 100) by 2.7x on a 4-socket Intel Xeon server.

Authors with CRIS profile

Involved external institutions

How to cite

APA:

Durner, D., Leis, V., & Neumann, T. (2019). On the impact of memory allocation on high-performance query processing. In Proceedings of the ACM SIGACT-SIGMOD-SIGART Symposium on Principles of Database Systems. Amsterdam, NL: Association for Computing Machinery.

MLA:

Durner, Dominik, Viktor Leis, and Thomas Neumann. "On the impact of memory allocation on high-performance query processing." Proceedings of the 15th International Workshop on Data Management on New Hardware, DaMoN 2019, Held with ACM SIGMOD/PODS 2019, Amsterdam Association for Computing Machinery, 2019.

BibTeX: Download