Scaling With Postgres
3 likes1,808 views
This document discusses various strategies for scaling PostgreSQL databases, including implementation tuning, optimizing queries and schemas, caching, replication, and federation. The key points are that PostgreSQL scales well vertically by adding hardware resources like memory, CPUs and disks, and optimization efforts should focus on resolving underlying data and schema issues rather than being an end solution. Horizontal scaling using replication and federation can also help scale reads and writes.
Scaling With Postgres
- 1. Scaling with Postgres Robert Treat Percona Performance Conference 2009
- 2. Disclaimer Every “really big” site uses custom solutions. Don’t expect to get there using out of the box software. You don’t have to reinvent the wheel. But you may have to build the car.
- 3. Who am I ? OmniTI TB+ databases top 100 websites Oracle/MySQL/Postgres Not necessarily in that order :-) P.S. We’re Hiring
- 4. Scaling Databases 101 Implementation Tuning Optimize Queries Optimize Schema Throw Hardware At It Caching Replication Federation
- 5. Implementation Normalization Foreign Keys Relational Modeling Mostly Irrelevant
- 6. Implementation Monitoring nagios, munin, etc.. check_postgres Trending cacti, noit watch your hardware!
- 7. Tuning Get the Basics Right http://wiki.postgresql.org/wiki/Tuning_Your_PostgreSQL_Server Someday Xlogs, Checkpoints Vacuum Strategy Costs and other Minutia
- 8. Optimize Queries explain explain analyze explain analyze verbose
- 9. Optimize Queries writing queries tuned to your databases planner
- 10. Optimize Schema indexing partial, functional fix data types add/remove tables de-normalize (maybe)
- 11. Why is this important? Postgres is good at scaling vertically Flawed database schema hides the real problems
- 12. Why is this unimportant? Optimizing is often a trade off of time vs. money It is not an ultimate solution
- 13. Throw Hardware At It Find your bottlenecks Memory / RAM CPU I/O, DISKS usually the biggest problem
- 14. Can you take me higher? 32 Cores 128 GB+ RAM Spindles out the wazoo tablespaces
- 15. Caching Internal materialized views External memcached, et al. static files
- 16. Oh, the places you’ll go Nothing Fancy or Exciting Solid Engineering Understanding needs / limits Top 1000+ Website
- 17. Replication Ignore the hype Triggers won’t destroy your site Scripting solves a lot of config issues Telling your DBA to do his !@#$ job solves config issues too Add-on is FUD for Modular
- 18. Replication Truth in advertising Oracle does it better MySQL does it simpler
- 19. Replication Scaling Reads Master, many slaves Slony, Londiste, Bucardo, PGPoolII Scaling Writes Mostly impossible Bucardo, PGPoolII
- 20. What is Federation? A process for eliminating performance and/or scaleability as a requirement for your database
- 21. Federation MySQL software has no federation advantage MySQL community has large federation advantage
- 22. Federation Things to consider Horizontal Partitioning Application Based Partitioning BASE golconde, gearman
- 23. El Fin www.xzilla.net www.omniti.com www.postgresql.us
- 24. Postgres BOF Tonight @ 7:30 PM Location @ Camino Real