title

text

Alvaro Hernandez
Alvaro Hernandez 8Kdata
11:00 16 March
45 мин

Миграция с MongoDB на PostgreSQL

MongoDB is a successful database in the NoSQL space, mostly used for OLTP-type workloads. However, due to the lack of ACID (transactions in particular) and significant performance issues with OLAP/DW workloads, more and more MongoDB users are considering migrating off of MongoDB to a RDBMS, where PostgreSQL is the usual choice. This represents a significant opportunity for the PostgreSQL ecosystem, to "bring NoSQL to SQL". This talk will present the challenges that MongoDB users are facing and the state of the art of the available tools and open source solutions available to perform ETL and live migrations to PostgreSQL. In particular, ToroDB Stampede will be discussed, an open source solution that replicates live from MongoDB, transform JSON documents into relational tables, and stores the data in PostgreSQL.

VIDEO

Слайды

Другие доклады

  • Dmitry  Lebedev
    Dmitry Lebedev BestPlace
    90 мин

    Исследования геоданных при помощи PostGIS и смежных инструментов

    Nowadays one can make a decent urban research based simply on public datasets, making interesting and unexpected insights. In the presentation, I'll show examples of these calculations in PostGIS, the industry standard de-facto.

    But just PostGIS is not enough. You need tools to import, verify and visualize the data. It's critically important to visualize the data live, to debug your calculations and shorten iterations. I'll describe all these steps:

    1. Collecting the data: public API, OpenStreetMap; direct user input.
    2. 3rd party APIs for calculations.
    3. Visualization of GIS and other sorts of data: QGIS, Matplotlib, Zeppelin integrated with PostGIS.
    4. Debugging the calculations: live visualization (Arc, QGIS, NextGIS Web)
    5. Scripting and minimizing the chores: Makefile, Gulp

  • Igor Chizhevskiy
    Igor Chizhevskiy НИИ "Восход"
    Sergey Korolev
    Sergey Korolev МЦСТ
    Dmitry Pogibenko
    Dmitry Pogibenko ФГБУ "НИИ Восход"
    Stanislav Merzlyakov
    Stanislav Merzlyakov ФГБУ НИИ "Восход"
    Илья Космодемьянский
    Илья Космодемьянский Data Egret
    Иван Богданов
    Иван Богданов НИИ "Восход"
    45 мин

    Восход PostgreSQL на Эльбрус

    Practical experience of carrying out import substitution with using PostgreSQL in government information system including not only the free software, but also the Russian hardware (Elbrus servers and other).

    VIDEO

  • Vadim Yatsenko
    Vadim Yatsenko ООО Прогресс Софт
    45 мин

    Очень большие таблицы в PostgreSQL. Или как превратить 60+ Tb в 10+ Tb

    The talk will describe how we have implemented storage of large tables (+1 billion rows per day). The project exists in production 2 years. The total amount of data - 300 Tb (25 PostgreSQL servers * 2 Data Center). I'll tell about mistakes in organization of large tables storage in the initial phase of the project, and how these mistakes were corrected. I'll also talk about how to organize the data rotation and archiving. I voiced questions about what we were missing in PostgreSQL 9.4 out of what appeared in the 9.5 and 9.6. And also, what new features we are waiting for new releases of PostgreSQL.

  • Anton Doroshkevich
    Anton Doroshkevich ИнфоСофт
    45 мин

    PostgreSQL - реальная альтернатива для высоконагруженных систем на базе 1С

    1. Why is it time to consider switching to PostgreSQL?
    2. 1С and PostgreSQL interoperability.
    3. Why should we start with Windows?
    4. The first experience of migrating big enough 1С databases to Postgres.
    5. Large-scale projects on high-load systems, in figures.