title

text

Евгений Бузюркин
Евгений Бузюркин PostgresPro
Дарья Барсукова
Дарья Барсукова
Рустам Хамидуллин
Рустам Хамидуллин PostgresPro
13:10 31 March
40 min

Statistical Analysis of Benchmark Results

In PostgreSQL performance testing, benchmarks measure query execution time (latency). To get more reliable results, queries are executed repeatedly, generating a dataset of latency values. Performance is often assessed using standard metrics like the median or mean, but we propose a more advanced approach.

In practice, latency distributions are often multimodal, consisting of multiple underlying distributions with distinct characteristics. In such cases, traditional statistical methods are insufficient, requiring a more detailed analysis of the dataset’s structure.

Our work presents a tool that automatically performs statistical analysis of benchmark results, accounting for dataset-specific features. It detects multimodality, identifies the number and boundaries of dominant modes, and determines key distribution parameters—providing deeper insights into PostgreSQL performance variations.

Other talks