Cases for monitoring & troubleshooting at highload PosgreSQL DB
A database is one of the key components in any information system, requiring the monitoring of multiple metrics. The talk highlights examples and approaches of monitoring and analysis of PostgreSQL performance that allow to minimize the load on the database server from the monitoring and data collection system for the subsequent analysis of problem situations.
- Quantum effects or as an observer affect the observed system
- Features of collecting metrics while monitoring the database with Zabbix
- Data collection for analytics and visualization PostgreSQL queries with rsyslog + kafka + clickhouse + grafana
- Operational Analysis Tools for DB loglile
Слайды
Видео
Другие доклады
-
45 мин
Dmitriy Sarafannikov ЯндексHow to save statistics during major update, and what can be the consequences
It's not a secret for anyone that statistics can not be transferred with a major upgrade. For small and not heavily loaded databases this is not a problem, you can quickly collect new statistics. But we have databases with a volume of about 5TB and a load of about 100k rps, for which it became a big problem: taking off without statistics, the replicas could not even replay WAL. In my report I'll tell you what tricks we went to upgrade these databases with requirements of 100% read only availability, about what mistakes were made, and about how these errors were painfully corrected. The result of these errors was the extension called "pg_dirty_hands", in which we will collect various hacks, which can be last resort to repair data corruption.
-
45 мин
Olivier Courtin DataPinkAdvanced spatial analysis with PostgreSQL, PostGIS and Python
PostGIS is well known and widely used since two decades, as the best OpenSource database solution for Spatial Analysis. This talk will focus on: spatial and advanced spatial analysis with pure PostGIS (including cutting edge PostGIS functions available); how to go further throught GeoDataScience, with Python libs and framework tied with PostgreSQL/PostGIS (including Machine and DeepLearning)
-
45 мин
Sergei Kim Ingram Micro Cloud
Vadim Yatsenko Tantor LabPostgreSQL High Availability cluster for Enterprise
Lately, the PostgreSQL is more widely being used for Enterprise. Our company, Ingram Micro Cloud, is one of the first companies that did it. We have been using PostgreSQL for many years as the main DBMS for our products. In our report, we want to tell about the evolution of our High Availability (HA) PostgreSQL cluster. We will tell about how quickly we implemented the solution using pgpool-II, wrote failover scripts, tested Postgres-XL, and came up with unusual configurations of Stolon. We will also cover the problems of load balancing, pooling connections, and backups.
-
45 мин
Alexander Pogodin Корпорация ПАРУС, МГОТУAAlexander Pankratov НПЦ ПарусMigration Technology of client-server applcations from Oracle to PostgreSQL: Principles, approaches and features.
The report reviews approaches and implementattion options for the migration of Parus-Budget 8 client-server application from the Oracle Database platform to the PostgreSQL platform without changing the client application for Desktop and the Web. The proposed solution allows to make transparent transition of the existing users' workplaces.