Database platform architecture and administrating PostgreSQL in Skype
Most of the main Skype services use a database platform based on PostgreSQL and other open-source technologies, such as Skytools, plProxy, pgBouncer, etc. This platform consists of several hundreds of servers with thousands of databases, which process hundreds of thousands of transactions per second. At the same time, the platform architecture allows its users (applications and their developers) to work with "logical" databases, without any worries about their real “physical” structure.
Our Skype Database Platform team is responsible for the database platform infrastructure. We develop automation systems for various processes that help us ensure service reliability and facilitate development, testing, and deployment of code. In this presentation, I will outline the database platform architecture, review its main components, and tell you about the methods we use in our every-day work to ensure high availability, scalability, replication, fault tolerance, and more.
Слайды
Видео
Другие доклады
-
22 мин
Michael Shurutov СтандартПроектAutonomous transactions in Postgres
- What is an autonomous transaction?
- An overview of autonomous transactions in "big" DBMS: Oracle.
- Autonomous transaction logic in Postgres Pro.
- An overview of emulation methods for autonomous transactions in PostgreSQL.
- Comparing performance of the built-in Postgres Pro autonomous transaction mechanism and PostgreSQL emulation methods.
VIDEO
-
22 мин
Dmitry Cremer МИА "Россия Сегодня"Building PostgreSQL from sources for system administrators
- why we build PostgreSQL from sources?
- choice build options
- dependencies
- creation system environment
- how to customise Linux for work with PostgreSQL
- extra soft for PostgreSQL DBA
VIDEO
-
22 мин
Sergey Mirvoda ООО Октоника, УрФУData analysis for all. Developing BI system, working on limited and even shared hardware
Experience we've got after 5 years of developing, deploying and improving BI system http://colibri365.ru used in government. I would talk about government IT reality and our way over it. Postgres performance improvements, using of latest features, overwriting of user generated queries to help query optimizer and other tweaks and hacks to tackle limited hardware problems. These lead us to number of computer science papers and (now committed) patches to Postgres (see Andrey Borodin talks for details).
VIDEO
-
45 мин
Alvaro Hernandez 8KdataMigrating off of MongoDB to PostgreSQL
MongoDB is a successful database in the NoSQL space, mostly used for OLTP-type workloads. However, due to the lack of ACID (transactions in particular) and significant performance issues with OLAP/DW workloads, more and more MongoDB users are considering migrating off of MongoDB to a RDBMS, where PostgreSQL is the usual choice. This represents a significant opportunity for the PostgreSQL ecosystem, to "bring NoSQL to SQL". This talk will present the challenges that MongoDB users are facing and the state of the art of the available tools and open source solutions available to perform ETL and live migrations to PostgreSQL. In particular, ToroDB Stampede will be discussed, an open source solution that replicates live from MongoDB, transform JSON documents into relational tables, and stores the data in PostgreSQL.
VIDEO