title

text

Dmitry Cremer
Dmitry Cremer МИА "Россия Сегодня"
15:00 06 February
22 мин

Cases for monitoring & troubleshooting at highload PosgreSQL DB

A database is one of the key components in any information system, requiring the monitoring of multiple metrics. The talk highlights examples and approaches of monitoring and analysis of PostgreSQL performance that allow to minimize the load on the database server from the monitoring and data collection system for the subsequent analysis of problem situations.

  • Quantum effects or as an observer affect the observed system
  • Features of collecting metrics while monitoring the database with Zabbix
  • Data collection for analytics and visualization PostgreSQL queries with rsyslog + kafka + clickhouse + grafana
  • Operational Analysis Tools for DB loglile

Слайды

Видео

Другие доклады

  • Антон Дорошкевич
    Антон Дорошкевич Инфософт
    45 мин

    1C-Battle. PostgreSQL vs MS SQL

    Comparison of capabilities of PostgreSQL and MS SQL to work with 1С. What does pg_restore mean for 1С user? Results of load testing for 1C database of more than 1TB size. The story of one 1C Production: 2 years, 500+ databases 1C, 4TB of data, cascading replication.

  • Ivan Panchenko
    Ivan Panchenko Postgres Professional
    90 мин

    Full text search from A to Ω

    Tutorial on Full Text Seach in PostgreSQL, containing all recent improvemets. All recipies necessary for building an application will be given: dictionary and parser configuration, faceted search, fuzzy search, multilanguage search, ranking etc. Participants will be provided with a test database for exercises.

  • Valery Kosarev
    Valery Kosarev -
    22 мин

    Pluggable storage for large objects

    Storing binary data in database tables is sometimes a good solution for a particular project. But sometimes, due to changes in conditions or insufficient consideration of decisions, such storage is becoming a real nightmare. If there is an understanding of how and where to place these data, the transition to the new solutions are often very hard, often require modification in the application code and downtime the system for migration. The presentation is a particular solution of such problems. Our extension allows to move binary data from database to the storage Ceph and not only. And does it seamless for the applications.

  • Dmitriy Sarafannikov
    Dmitriy Sarafannikov Яндекс
    45 мин

    How to save statistics during major update, and what can be the consequences

    It's not a secret for anyone that statistics can not be transferred with a major upgrade. For small and not heavily loaded databases this is not a problem, you can quickly collect new statistics. But we have databases with a volume of about 5TB and a load of about 100k rps, for which it became a big problem: taking off without statistics, the replicas could not even replay WAL. In my report I'll tell you what tricks we went to upgrade these databases with requirements of 100% read only availability, about what mistakes were made, and about how these errors were painfully corrected. The result of these errors was the extension called "pg_dirty_hands", in which we will collect various hacks, which can be last resort to repair data corruption.