Buit-in Sharding update and future
Database sharding enables a distribution of the database over a large number of machines, greatly improving performance. With the advent of Foreign Data Wrappers (FDW), it's possible to consider a database sharding in PostgreSQL with acceptable level of code changes using FDW. We've been working on enhancing around FDW infrastructure such as foreign table inheritance and pushing down so that PostgreSQL can execute the distributed query efficiently using FDW. In this talk, I'll cover what FDW-based sharding is and what use-cases it can cover. And then I'll demonstrate how to build sharding and describe our achievement of a FDW-based sharding in PostgreSQL community. Finally, I'll describe further enhancements to FDW such as Async Execution and Distributed Transaction Support.
Слайды
Видео
Другие доклады
-
22 мин
Jean-Paul Argudo DalibotemBoard a new tool for PostgreSQL
Dalibo team produces open source tools for PostgreSQL among other things for many years now (see http://dalibo.github.io/).
This time I'll present temBoard, a new tool to remotely control PostgreSQL databases. The project is visible at https://github.com/dalibo/temboard
It's about monitoring, supervision, remote settings and actions... and many more features to come. The main goal is to provide a comprehensive console for PostgreSQL. It's needed by production DBAs, to daily achieve their tasks. We heard Dalibo's customers, as many of them wrote the specs :-)
-
22 мин
Alexey Mergasov НОКСА Дата Лаб10+ PB efficient storage and processing via PostgreSQL. Novel paradigm of lean data infrastructure for Data-Driven Enterprise
Alexey will present technical details and share hands-on experience of extreme data normalization application for data infrastructure with exceptional parameters design and development. Extreme normalization-based data infrastructures has the following competitive advantages in comparison with market leaders: - Real-time data processing for 10 PB of data and more - 2-6 times better overall performance - 100% data consistency through total data landscape - Almost linear scalability - 4-10 lower cost of ownership - etc The abovementioned approach has been successfully utilized out of Russian market in telecommunication, retail, fin-tech, manufacturing (Industry 4.0, industrial IoT), and government institutions.
VIDEO
-
22 мин
Dmitry Vagin AvitoMonitoring PostgreSQL in Avito.ru, with case studies
A short talk about collecting data and monitoring database workload in Avito. Exporting metrics from stored procedures to Graphite. Collecting and visualizing pg_stat* metrics in Grafana. Case studies.
VIDEO
-
22 мин
Oleg Alekseev МойСкладSemiautomatic database schema conversion in MoySklad
MoySklad online service includes important component - semiautomatic database conversion framework. Its history and supported conversions are subject of this speech.
VIDEO