Very large tables in PostgreSQL. Or how to make 60+ Tb to 10+ Tb
Progress Soft, Chief of the Department of storage systems
My acquaintance with PostgreSQL happened in 2008. Since 2011, I am developing a database to PostgreSQL. At present I am the chief of the Department of storage systems to the company "Progress Soft". Our specialization - the development highly loaded large projects, using PostgreSQL as the primary database.
The talk will describe how we have implemented storage of large tables (+1 billion rows per day). The project exists in production 2 years. The total amount of data - 300 Tb (25 PostgreSQL servers * 2 Data Center). I'll tell about mistakes in organization of large tables storage in the initial phase of the project, and how these mistakes were corrected. I'll also talk about how to organize the data rotation and archiving. I voiced questions about what we were missing in PostgreSQL 9.4 out of what appeared in the 9.5 and 9.6. And also, what new features we are waiting for new releases of PostgreSQL.