title

text

Konstantin Evteev
Konstantin Evteev X5 FoodTech
15:00 03 March
45 мин

Building real-time analytics with PostgreSQL

In today's world, operational reporting and real-time analytics are becoming a basic need. There are a huge number of tools, practices, and approaches, which in turn require different expertise and resources. In this talk, I will tell you how to transform your analytics using PostgreSQL. We'll discuss pitfalls when using different schemes. We'll talk about data quality and performance. I expect this talk to be of interest to both beginners and seasoned practitioners with many years of experience (Discussions and questions after the talk will be highly appreciated). The talk outline is as follows. 1. The evolution of reporting - migration from OLTP to OLAP. 2. Data delivery to DWH and related challenges. 3. Scaling architecture in response to growing data volumes. 4. Data quality issues. 5. Maintaining stability with a large number of changes. 6. Different approaches to organizing the work of the DWH team. 7. And, finally, we'll list the challenges we have successfully responded to with various solutions (pgAgent, PGWatch, working with the file system, the new reading of postgresql.conf).

Видео

Другие доклады

  • David Steele
    David Steele Crunchy Data
    45 мин

    Backup Best Practices with pgBackRest

    Backups are a critical part of any enterprise database solution but they are often done poorly or skipped altogether, which can lead to data loss in the event of hardware failure or some other disaster.

    In this talk we'll cover database backup best practices and how to implement them with pgBackRest, including:

    • WAL archiving and retention
    • Backup frequency and retention
    • How to meet recovery time/point objectives
    • Configuration options
    • Performance considerations

  • Dimitri Fontaine
    Dimitri Fontaine
    45 мин

    Postgres Architectures in Production

    When using PostgreSQL in production it is important to implement a strategy for High Availability. With a database service, the HA properties apply to both the service itself and of course to the data set.

    In this talk we learn how to think about specific HA needs of your production environment and how to achieve your requirements with Open Source tooling when it comes to your database of choice, PostgreSQL. In particular, we dive in many options that could be implemented for Postgres to evolve its offering from being a toolset to being “batteries included”. What does it mean in the context of HA? How to achieve it?

  • Ibrar Ahmed
    Ibrar Ahmed Percona LLC
    45 мин

    All about PostgreSQL Security

    PostgreSQL provides different levels of security. This talk will cover all the available security techniques used in PostgreSQL 13. We’ll look at client-side security (LibPq, JDBC) through to server-side security. It will cover all supported authentication methods and the pros and cons of all these methods. Some of the key features of the talk are:

    • Introduction to Cryptography
    • SSL, TLS, GSSAPI, and OpenSSL
    • Client-Side Encryption
    • Securing Authentication
    • Securing Data on the disk
    • Securing Backup & Basebackup
    • Securing Replication
    • Database Roles and Privileges

    It’s important to be familiar with all the security levels such as (1)network-level security (2) on-disk security (3) row-level, (4), and column level security. The talk will cover all the aspects with some real-life use cases and examples.

  • Henrietta Dombrovskaya
    Henrietta Dombrovskaya Braviant Holdings
    45 мин

    NORM - No ORM Framework

    It's a well-known fact, that although the database performance is great, and each query is executed in milliseconds, the overall application response time may be slow, making the users wait for a response for an extended period of time. We know that the problem is not the database, but the way the application developers communicate with the database. Specifically, we are talking about ORMs - Object-Relational Mappers. Database developers hate them, but application developers love them because they allow developing applications without any knowledge of database internals. As a result, the system performance is often unacceptably slow.

    The only way to change this behavior is to provide application developers with a tool, which is as easy to use, as an ORM, but which will allow escaping the common ORM pitfalls. That's why we developed NORM - No-ORM Framework. During this presentation, we will go over examples of code from https://github.com/hettie-d/NORM repo and learn how to build "transport objects" for efficient data transfer between applications and databases