title

text

Dmitry  Lebedev
Dmitry Lebedev BestPlace
13:30 15 March
90 мин

Researching GIS data with PostGIS and adjacent toolset

Nowadays one can make a decent urban research based simply on public datasets, making interesting and unexpected insights. In the presentation, I'll show examples of these calculations in PostGIS, the industry standard de-facto.

But just PostGIS is not enough. You need tools to import, verify and visualize the data. It's critically important to visualize the data live, to debug your calculations and shorten iterations. I'll describe all these steps:

  1. Collecting the data: public API, OpenStreetMap; direct user input.
  2. 3rd party APIs for calculations.
  3. Visualization of GIS and other sorts of data: QGIS, Matplotlib, Zeppelin integrated with PostGIS.
  4. Debugging the calculations: live visualization (Arc, QGIS, NextGIS Web)
  5. Scripting and minimizing the chores: Makefile, Gulp

Слайды

Видео

Другие доклады

  • Philip Delgyado
    Philip Delgyado ООО «Лектон»
    22 мин

    Distributed workflow specifics in PostrgeSQL

    When working with a complex business logic, you often have to implement a workflow - a sequence of several processing steps, with each step implementing a separate part of the business logic. This is usually done with specialized queues, but if there are high reliability demands, it makes sense to do everything on PostgreSQL.

    I will describe the tasks that require a workflow implementation, offer a solution, compare it with other options, and tell you about the implementation traps and pitfalls.

  • Anton Doroshkevich
    Anton Doroshkevich ИнфоСофт
    45 мин

    PostgreSQL – a real alternative for high-load 1C-based systems

    1. Why is it time to consider switching to PostgreSQL?
    2. 1С and PostgreSQL interoperability.
    3. Why should we start with Windows?
    4. The first experience of migrating big enough 1С databases to Postgres.
    5. Large-scale projects on high-load systems, in figures.

  • Ildar Musin
    Ildar Musin Postgres Professional
    Dmitry Ivanov
    Dmitry Ivanov Postgres Professional
    45 мин

    Partitioning with pg_pathman

    Partitioning is a long-awaited feature in PostgreSQL. Although Postgres supports partitioning via inheritance, this approach has some disadvantages, such as the need to manually create partitions and support triggers, significant planning overhead, and no query execution optimizations. In this talk, we’ll tell you about the pg_pathman extension we are developing. pg_pathman supports HASH and RANGE partitioning, performs planning and execution optimizations, supports fast insert by using Custom Node instead of triggers, provides functions for partition management (add, split, merge, etc.), supports FDW, non-blocking data migration, and more. We'll also speak about pg_pathman integration with Postgres Pro Enterprise Edition and Oracle-like syntax support for partitioning. Finally, we'll discuss new partitioning capabilities in PostgreSQL 10, the already implemented features and further development plans.

    VIDEO

  • Алексей Лесовский
    Алексей Лесовский PostgreSQL Consulting LLC
    45 мин

    Troubleshooting PostgreSQL Streaming Replication

    Streaming replication has been introduced in 2010 and quickly became one of the most popular features of PostgreSQL. Today, it is hard to imagine PostgreSQL installation without streaming replication. With its stability, high efficiency and ease of configuration one would have thought it is an optimal feature. However, while using it you might sometimes enter murky waters. This often can be resolved by using a combination of built-in and third party troubleshooting tools. In my talk I will provide an overview of these tools and explain how with their help one can diagnose, understand and eliminate problems related to streaming replication. I will also go through the most frequent issues occurring when streaming replication is used and will propose possible solutions. This talk is primarily aimed at DBAs and system administrators who use PostgreSQL in their day-to-day.

    VIDEO