PgConf.Russia 2017

Database systems are increasing in size and so is the need to process huge amounts of data in real time. As commercial database vendors are bragging about their capabilities we decided to push PostgreSQL to the next level and exceed 1 billion rows per second to show what we can do with Open Source. To those who need even more: 1 billion rows is by far not the limit - a lot more is possible. Watch and see how we did it.

VIDEO

I will tell you about why Postgres is first-choice product as a foundation for your BI system with classical OLAP workload. Briefly it will be said about existing open source BI solutions.

I will also describe specific of our architecture, why we chose snowflake scheme and how we are doing extract, transformation and load procedures. It will be mentioned about special Postgres tuning for OLAP and massive data bulkload workloads. Also I will let you know about Postgres usage as a column database with cstore_fdw by Citus and results achieved. Cons and problems of our approach will be described in the end of the talk.

VIDEO

Dalibo team produces open source tools for PostgreSQL among other things for many years now (see http://dalibo.github.io/).

This time I'll present temBoard, a new tool to remotely control PostgreSQL databases. The project is visible at https://github.com/dalibo/temboard

It's about monitoring, supervision, remote settings and actions... and many more features to come. The main goal is to provide a comprehensive console for PostgreSQL. It's needed by production DBAs, to daily achieve their tasks. We heard Dalibo's customers, as many of them wrote the specs :-)