title

text

Alexey Mergasov
Alexey Mergasov НОКСА Дата Лаб
17:30 17 March
22 мин

10+ PB efficient storage and processing via PostgreSQL. Novel paradigm of lean data infrastructure for Data-Driven Enterprise

Alexey will present technical details and share hands-on experience of extreme data normalization application for data infrastructure with exceptional parameters design and development. Extreme normalization-based data infrastructures has the following competitive advantages in comparison with market leaders: - Real-time data processing for 10 PB of data and more - 2-6 times better overall performance - 100% data consistency through total data landscape - Almost linear scalability - 4-10 lower cost of ownership - etc The abovementioned approach has been successfully utilized out of Russian market in telecommunication, retail, fin-tech, manufacturing (Industry 4.0, industrial IoT), and government institutions.

VIDEO

Слайды

Другие доклады

  • Andrey Borodin
    Andrey Borodin Яндекс
    45 мин

    GiST speedup: patches, hacks and tweaks

    This report overviews some ideas and implementations to speedup different parts of generalized search trees (GiST): 1. Intrapage indexing 2. Fractal tree technology 3. Modern algorithms for spatial indexing (RR*-tree) 4.. Possible advancements of GiST API

    VIDEO

  • Mikhail Tyurin
    Mikhail Tyurin ИТ предприниматель
    22 мин

    Deadlock explanations

    < Query failed: ERROR: deadlock detected
    < DETAIL: Process 17371 waits for ShareLock on transaction 102733872; Blocked by process.
    < Process 10414 waits for ShareLock on transaction 102733874; Blocked by process 17371.
    

    Such "unpleasant" messages from the server can seriously puzzle the developer. When working with locks, in particular, with transactions in general, it is necessary to take into account the features of the implementation of client libraries, which can cause the above exception.

    In the short talk, the mechanics of the interaction of locks will be explained, main attention being paid to causes of deadlocks. References to the relevant documentation pages will be given. A technique of "bypassing" this problem of concurrent data access will be described and illustrated with some generalized examples from practice are shown. The talk will be interesting to database developers and administrators as well as the client-side application developers.

  • Teodor Sigaev
    Teodor Sigaev Postgres Professional
    Arthur Zakirov
    Arthur Zakirov Postgres Professional
    90 мин

    Full text search capabilities in PostgreSQL

    Full text search in PostgreSQL is probably the most advanced one among relational DBMS. This tutorial will explain how to setup full text search configurations and dictionaries and how to build a ful text search system using an example of a simple popular science web site, with demonstration of various ranking functions. Also I will tell about new RUM index, which allows to accelerate execution of some kinds of full text queries and implements a new improved ranking function.

  • Dmitry Cremer
    Dmitry Cremer МИА "Россия Сегодня"
    22 мин

    Building PostgreSQL from sources for system administrators

    • why we build PostgreSQL from sources?
    • choice build options
    • dependencies
    • creation system environment
    • how to customise Linux for work with PostgreSQL
    • extra soft for PostgreSQL DBA

    VIDEO