AWS Users Meetup April 2015

Apr 15, 20150 likes671 views

This document summarizes the evolution of using MySQL in AWS, from initial small deployments to more complex architectures with high availability and geo-redundancy needs. It describes starting with basic RDS instances, scaling to handle more reads with read replicas, and the limitations of multi-AZ deployments that require rolling your own HA solutions using tools like Pacemaker and mysqlfailover. As needs grow further, it discusses exploring synchronous replication and geo-redundancy across locations.

MySQL in AWS, An
Evolutionary Tale
Jervin Real
AWS Users Group, Apr 2015

Hello! My name is Jervin
• Student
• Senior MySQL Consultant at Percona
• @dotmanila
• https://github.com/dotmanila
• http://dotmanila.com/blog/
• http://www.percona.com/blog/author/jervin

Roll Your Own HA
• MySQL Master HA
• Pacemaker (PRM)

Roll Your Own HA
• MySQL Master HA
• Pacemaker (PRM)
• mysqlfailover

Roll Your Own HA
• MySQL Master HA
• Pacemaker (PRM)
• mysqlfailover
• Custom scripts found on GitHub!

Roll Your Own HA
• MySQL Master HA
• Pacemaker (PRM)
• mysqlfailover
• Custom scripts found on GitHub!
• etc . . .

To summarize:
• Start small, but delegate early - RDS instances are cheap!
• Scale your reads, but do not forget your primary’s HA
• RDS multi-AZ has limited health checks, plan failure around
them as well.
• EC2 instance provides more flexibility minus convenient RDS
features
• HA solutions for asynchronous replication is available
• Percona XtraDB Cluster (Galera based) for multi location
writes*

From my presentation at OSCON 2014 http://www.oscon.com/oscon2014/public/schedule/detail/37779 Abstract: There’s only one way to do it here at PayPal – with a framework. Everything you’ll ever need is done if you stay inside the lines. Imagine my reaction when I joined PayPal with Scala and high hopes. We have many reasons to avoid the monolithic framework, so we were going against the grain from day 1. My team came on to “shake things up” and we’ve been doing just that. We brought Scala to PayPal, built small components to defeat “framework-itis” and generally pissed some people off. Now we want to open source the stuff we’re building. I’m going to talk about our challenges so far, and how we overcame them. I’ll have tales (both funny and sad) to tell about my experience so far, and I’ll share plenty of lessons learned along the way.

MWUG wp-mythsMike Little

The document discusses several common myths about WordPress performance and security. It notes that while some plugins can slow a site down, others speed it up or have no effect. Inactive plugins and themes still need updates for security. Revisions and trash do not significantly impact performance. WordPress scales well for large sites. It is used by major companies and organizations, not just blogs or amateurs. WordPress security has improved, but proper precautions like updating plugins are still needed. Function calls are cached so removing them prevents functionality.

Customizing the custom loop wordcamp 2012-jeffAlexander Sapountzis

One Framework to Rule Them AllSirar Salih

The document discusses AngularJS, a framework for building client-side web applications. It introduces key concepts in AngularJS like directives, data binding, controllers, and services. It then provides recommendations for code organization with AngularJS including file naming conventions and design patterns. Finally, it discusses testing AngularJS applications with tools like Jasmine, Karma, and integrating tests with continuous integration servers.

2010 11 pubcon_hendison_wordpressshendison

This document discusses using WordPress for SEO purposes. It recommends installing the Core Tweaks Setup plugin after installing WordPress to automate typical post-installation tasks. It also recommends installing the All in One SEO Pack plugin or alternatives like HeadSpace2 or Greg's High Performance SEO to automatically generate title tags, meta descriptions, and other SEO elements. For more advanced users, it suggests trying the WordPress SEO plugin by Joost de Valk, which is currently in beta but offers more control and features than All in One SEO Pack.

Why puppet? Why now?Server Density

Why Puppet? Why now? Can you get by without using any config management? You probably think don't have time, or that your project is too small. What can using Puppet really add? How can you justify investing time up front? Maybe you can just do it later? Getting started with config management can often seem like a big project, especially if you only manage a few systems or have a small team. This talk will examine why you should use Puppet from the beginning. It will examine what you can do with Puppet that couldn't do otherwise, how much time it will save and why it's especially important if you think your project has even the smallest chance of scaling in the future. Presented by David Mytton at Puppet Camp London 2015-04-13

Drupal and Elasticsearch - The "new school" search engineNikolay Ignatov

This document provides an overview of Elasticsearch, including: - Elasticsearch is a distributed, RESTful search and analytics engine that allows for real-time search, indexing, and analytics of data. - It was created by Shay Banon and is open source, written in Java and built on Apache Lucene. - Elasticsearch can be used to power search on Drupal sites through modules like the Elasticsearch Connector which integrate Elasticsearch with Drupal.

The Case for the WordPress REST API | WordCamp Montreal 2016Roy Sivan

There are many reasons ways the REST API can be utilized, but why should we care? Why are any of these reasons so good we need to have the API in core vs. a plugin? I will take a non-code approach to explaining from the basics, why the REST API is not just a good thing to have for development, but a good thing to have for WordPress to keep it going and keeping it relevant. Then you can be the judge if it is a good and necessary addition.

How We Introduced Continuous Delivery?Dr. Alexander Schwartz

The document discusses how a team introduced continuous delivery for a legacy application and a new application. For the legacy application, the cycle time was reduced from over 35 days to around 10 days. For the new application, they achieved 1-5 releases per week with over 40 releases to production in 5 months and a minimum cycle time of 2 hours. The key aspects that enabled this included forming a dedicated team, focusing on the value stream, implementing kanban/lean principles, automation including full end-to-end pipelines, and eating their own dog food by applying continuous delivery principles to their own improvement process.

Premature optimisation: The Root of All EvilFabio Akita

Erlang - Dive Right Invorn

Erlang is a functional programming language built for reliability and concurrency. It is used to build scalable and fault-tolerant systems through features like its supervision tree, behaviors, and OTP framework. The document recommends learning more about Erlang through various books and online resources, and suggests trying out the build tools rebar and ChicagoBoss or contributing to open source projects like Riak to get hands-on experience with the language.

Selling WordPress to Enterprises by Rahul Bansal @ WordCamp Ann ArborrtCamp

Building a JavaScript App powered by WordPress & AngularJSRoy Sivan

The Goat and the SiloMichael Ducy

The document discusses silos in organizations and how they are a reflection of organizational structure. It notes that silos form due to processes like Parkinson's Law where work expands to fill available time. This leads to multiplication of subordinates and work. The document suggests that cross-functional teams and DevOps teams are attempted solutions but can still result in new silos forming or missing the underlying issues. It argues that the focus should be on improving manufacturing processes, communication, education and collaboration between teams to solve the problems created by silos rather than trying to eliminate the silos themselves.

WordPress Development EnvironmentsJosh Cummings

This document discusses tools for creating a WordPress development environment. It covers common development setups like LAMP/LEMP stacks, tools for local development like text editors and version control, and options for setting up a local environment like MAMP, native Linux/Mac stacks, Virtual Machines with Vagrant/VVV, and containers with Docker. The goals are to choose tools that allow for effective collaboration, testing, and deploying code across different environments.

WordPress WorkshopTerri Orlowski

This document summarizes a WordPress workshop presented by Terri Orlowski. The workshop covered an introduction to WordPress, how to install WordPress manually or via one-click installation, important security practices, useful plugins for backups, security and other functions, themes, and various ways WordPress can be used like for podcasts, newsletters, and more. The workshop provided information to help attendees understand and get started using WordPress.

SEO Why bother if your site is dead slowJira ICT

This document discusses how website performance optimization (WPO) and server performance optimization (SPO) are important for SEO. It notes that Google aims for site speeds under 1.5 seconds and studies show 2 seconds is the threshold for an acceptable user experience. The document then provides tips for optimizing Joomla sites, including using professional web hosting, reducing HTTP requests, compressing content, optimizing images, and employing a content delivery network. Case studies show how optimizing a Joomla site can significantly improve response times.

11 Amazing things I Learnt At Word Camp Sydney 2014WordPressBrisbane

The document summarizes key learnings from a WordPress conference. It covers topics like CSS naming conventions, best coding practices, localization, custom post types, SEO, hiring remote workers, writing simple plugins, and planning WordPress sites at scale. The last section highlights several lightning talks on project management, accessibility, grammar, unit testing, migrations, and big brands using WordPress.

Big WebsitesFour Kitchens

Selling WordPress To Enterprises by Rahul Bansal WordCamp NYC 2017rtCamp

Drupal Dev Days Milan 2016Kristiaan Van den Eynde

This document discusses the new Group module for Drupal. It summarizes that Group allows content to be organized into user-defined collections called groups. Groups have group types that define available content, fields, roles and permissions. Relationships between group members and private group pages are managed through plugins to provide flexibility while requiring minimal code. The document promotes Group as improving upon the previous OG module for managing access to content in Drupal.

Angular Remote Conf - Building with Angular & WordPressRoy Sivan

This document discusses using the WordPress REST API to build applications with Angular. It provides reasons for using WordPress, including managing content with a simple CMS, creating native apps easily with site content, and leveraging the large WordPress developer community. The document also covers extending the API, building demos with Angular and WordPress, and lists additional resources for using the WordPress REST API with Angular.

Blogs and RSS – Trawling the Internet for MeaningESUG

This document discusses blogs and RSS feeds. It explains that blogs are personal publishing sites that are becoming influential. RSS feeds use XML format to syndicate blog post titles, links, and descriptions. The author notes how adding an RSS feed to their blog increased traffic. Aggregators like BottomFeeder collect RSS feeds, which drove more traffic to the author's blog. In conclusion, blogs and RSS feeds are useful for publicity, project management, marketing, community building and communication.

Git超入門Sherlock Chiang

This document discusses Git and the author's experience with it. It includes: - The author has over 12 years of experience in software development and specializes in Agile and Scrum. - An overview of some basic Git commands like add, commit, log and clean. - Tips for ignoring files that don't need to be tracked with .gitignore and undoing changes with checkout. - Mentions that Git allows seeing differences between commits via the diff command.

Polyglot GrailsMarcin Gryszko

This document discusses using multiple programming languages with Grails, known as polyglot programming. It describes how to use Clojure, Scala, and Ruby with Grails through plugins. For each language, it covers why you would use it with Grails, how to set up the plugin, examples of usage, and limitations. The goal is to push Grails towards being more polyglot and leverage different languages' strengths.

Adopting Elixir in a 10 year old codebaseMichael Klishin

More Related Content

What's hot (20)

2010 11 pubcon_hendison_wordpressshendison

Why puppet? Why now?Server Density

Drupal and Elasticsearch - The "new school" search engineNikolay Ignatov

The Case for the WordPress REST API | WordCamp Montreal 2016Roy Sivan

How We Introduced Continuous Delivery?Dr. Alexander Schwartz

Premature optimisation: The Root of All EvilFabio Akita

Erlang - Dive Right Invorn

Selling WordPress to Enterprises by Rahul Bansal @ WordCamp Ann ArborrtCamp

Building a JavaScript App powered by WordPress & AngularJSRoy Sivan

The Goat and the SiloMichael Ducy

WordPress Development EnvironmentsJosh Cummings

WordPress WorkshopTerri Orlowski

SEO Why bother if your site is dead slowJira ICT

11 Amazing things I Learnt At Word Camp Sydney 2014WordPressBrisbane

Big WebsitesFour Kitchens

Selling WordPress To Enterprises by Rahul Bansal WordCamp NYC 2017rtCamp

Drupal Dev Days Milan 2016Kristiaan Van den Eynde

Angular Remote Conf - Building with Angular & WordPressRoy Sivan

Blogs and RSS – Trawling the Internet for MeaningESUG

Git超入門Sherlock Chiang

2010 11 pubcon_hendison_wordpressshendison

Why puppet? Why now?Server Density

Drupal and Elasticsearch - The "new school" search engineNikolay Ignatov

The Case for the WordPress REST API | WordCamp Montreal 2016Roy Sivan

How We Introduced Continuous Delivery?Dr. Alexander Schwartz

Premature optimisation: The Root of All EvilFabio Akita

Erlang - Dive Right Invorn

Selling WordPress to Enterprises by Rahul Bansal @ WordCamp Ann ArborrtCamp

Building a JavaScript App powered by WordPress & AngularJSRoy Sivan

The Goat and the SiloMichael Ducy

WordPress Development EnvironmentsJosh Cummings

WordPress WorkshopTerri Orlowski

SEO Why bother if your site is dead slowJira ICT

11 Amazing things I Learnt At Word Camp Sydney 2014WordPressBrisbane

Big WebsitesFour Kitchens

Selling WordPress To Enterprises by Rahul Bansal WordCamp NYC 2017rtCamp

Drupal Dev Days Milan 2016Kristiaan Van den Eynde

Angular Remote Conf - Building with Angular & WordPressRoy Sivan

Blogs and RSS – Trawling the Internet for MeaningESUG

Git超入門Sherlock Chiang

Similar to AWS Users Meetup April 2015 (20)

Polyglot GrailsMarcin Gryszko

Adopting Elixir in a 10 year old codebaseMichael Klishin

Drupal High Availability High Performance 2012Amazee Labs

This document discusses strategies for achieving high availability and high performance with Drupal. It recommends using redundant web and database servers, load balancers, caching with Varnish and Memcache, and a distributed file system like GlusterFS. MySQL master-slave replication is suggested for database redundancy. The goal is a scalable system with no single point of failure and fast response times.

ElasticBeanstalk で新規事業を爆速ローンチするRyo Shibayama

Minami Aoyama Night #1 で発表したスライドです。ザッパラスで行っているリーンな開発におけるインフラ周りの話をしました。また、タイミングよく @i2key さんのブログポスト「新規事業のグロース期を支えるエンジニアリングについて」が投稿されましたが、その文脈においての一部が ElasticBeanstalk を使ったインフラストラクチャなのではないかと感じています。

PL/Parrot San Francisco Perl Mongers 2010/05/25David Fetter

Parrot is a virtual machine for dynamic languages that is register-based, pluggable, interoperable, and dynamic. It allows writing PostgreSQL procedural languages (PLs) once in a high-level language like Perl or Python and calling them from any PL, avoiding duplicating code. Current PLs built on Parrot include PL/PIR and PL/PIRU. Future work includes improving data type support, adding sandboxing and calling high-level languages, and increasing testing.

Functional RubyAmoniac OÜ

Funtional Ruby - Mikhail BortnykRuby Meditation

This document provides an overview of functional programming concepts using Ruby. It discusses some of the problems with object-oriented programming like side effects and sharing of data and code. It then presents some ways to adopt a more functional style in Ruby, such as treating loops and data structures as functions. The document also introduces the Functional Ruby gem which adds features inspired by languages like Erlang and Haskell, including pattern matching, immutability and memoization. Overall, the document aims to demonstrate how functional programming principles can be applied in Ruby.

6 reasons Jubilee could be a Rubyist's new best friendForrest Chang

(Video here: http://confreaks.com/videos/5014-RubyConf2014-6-reasons-jubilee-could-be-a-rubyist-s-new-best-friend or https://www.youtube.com/watch?feature=player_embedded&v=FFR0G89WXI8) Rubyconf 2014 talk on Jubilee, a Vert.x module that runs rack apps. Alternate titles Beyond Rails while using Rails Rails can't do everything I want and <fill> makes me want to cry Rubyconf abstract Do you do web development in Ruby? Have you been forced to go to node or other technologies just for concurrency/websockets etc. Do miss your gems, and tire of functionality you have to implement from scratch? Do you hate javascript? Well no need to switch languages/platforms, Jubilee could be your new best friend. Jubilee, a rack server on top of Vert.x gives you * Concurrency * Speed * Easy Websockets support * Shared Memory * Access to the JVM ecosystem * Ability to reuse your existing Ruby knowledge and gems "Say Hello to your new friend" - Al Pacino

Refactoring RIA Unleashed 2011Jesse Warden

Scaling with swaggerTony Tam

This document discusses scaling applications and services. It recommends taking a vertical approach by breaking monolithic applications into microservices that communicate through APIs. The Swagger framework is presented as a way to document and test APIs. Swagger can generate client libraries and helps services scale by enabling asynchronous communication through websockets. Taking this vertical, microservices approach with Swagger improves scalability by allowing dedicated teams to own individual services and improves performance through asynchronous communication protocols.

Doing cool stuff with WordPressPeter Baylies

The document provides tips for developing with WordPress. It recommends always learning through curiosity, not expecting to know everything, researching topics by Googling them and using WordPress resources like the codex. It suggests asking questions on support forums, following Twitter users for help, and looking at existing code and themes for examples. The document also advises testing features thoroughly, using debugging tools, and following a process of breaking problems down and crafting solutions.

Puppet101Puppet

- Puppet has been used at Stanford University since August 24th 2006 to provide consistency of configuration and practice across 20 system administrators. It started with 73,167 lines of code and 1,784 classes. - The presentation discusses coding practices like using a style guide for readable code, creating reusable modules and classes, and using descriptive names. - It also covers using packages for compiled software and Puppet for configurations, best team practices like never making local changes, and server practices such as version control, security models, and custom reports.

Evaluating Drupal for the Enterpriseultimike

Social dev camp_2011Craig Ulliott

The document provides advice on building APIs based on the author's experience building WIB APIs. Some key points include: - Use Ruby on Rails for its RESTful design, ease of development, and ability to scale horizontally. - Implement OAuth2 for authentication and authorization for its simplicity. - Return errors and limit data in standardized JSON formats for consistency. - Abstract the API into layers and keep it DRY to improve scalability and extensibility. - Prioritize documentation, testing, monitoring, and following standards used by other successful APIs.

Tweakers AnonymousJohn Anderson

The document discusses ways to optimize a programmer's text editor by configuring features like syntax highlighting, indentation, and making the editor programmable. It provides tips for automatic executable permissions on save, code formatting, syntax checking, auto-completion, and browsing documentation from within the editor. The document emphasizes that spending time to customize the editor for one's needs can improve productivity.

Doodling for-great-successRadamanthus Batnag

This talk was presented at RubyConfPH 2015, a conference for Ruby programmers. As coders, we are very familiar with how to communicate using written words. But words exercise only half of our brain. Using sketches to enhance our message leads to more effective communication. It is fun, too! I discuss sketching tips that everyone - even those who think they have no drawing skills - can use right away. These can be applied to blog posts, open-source documentation, bug reports, and even emails.

Le PERL est mortapeiron

The document discusses the history and evolution of Perl web development. It covers early tools like CGI.pm and mod_perl that allowed Perl to be used for web apps. It then discusses issues with these approaches and the rise of reusable code repositories like Matt's Script Archive. It outlines how Perl best practices and the maturation of CPAN helped improve code quality. Key modern frameworks like Catalyst, Plack, Moose and DBIx::Class are also summarized.

WebGL Camp 4 - A3 3D Engineaerotwist

The document discusses the author's experience developing a simple 3D engine called A3. It provides biographical information about the author and explains his motivations for creating the engine, including learning opportunities and a desire to share his work. It outlines goals such as keeping the API and codebase lean, generating documentation automatically, and recording tutorial videos. Key features implemented so far include geometry, lighting, texturing and cameras. Sample applications are provided. The conclusion encourages setting goals, refactoring, asking for help, writing samples, sharing work, and pursuing ambitious ideas.

talkRubens Stulzer

Growth hacking is the combined efforts of product, engineering, marketing and data science teams to achieve growth goals. The document discusses how a growth team at VivaReal can experiment and validate hypotheses faster by acting more independently from other teams. It proposes injecting code via a third-party JavaScript to run A/B tests without approvals or changing the main codebase. This would allow experiments to be deployed in seconds through an external API and give the growth team freedom to try new ideas.

Message:Passing - lpw 2012Tomas Doran

This document summarizes Tomas Doran's talk about his new Message::Passing Perl library for messaging, interoperability, and log aggregation. The library provides a framework for passing messages between different messaging systems and protocols. It uses a simple model where inputs produce events as hashes, outputs consume events, and filters can both produce and consume events. The core distribution includes roles for common inputs, outputs, and filters. Adaptors in separate modules provide connectivity to protocols like ZeroMQ, AMQP, STOMP, Elasticsearch, Redis PubSub, Syslog, MongoDB, and others. The goal is to simplify building complex message processing chains across different systems. Examples are provided to illustrate passing messages between protocols.

Polyglot GrailsMarcin Gryszko

Adopting Elixir in a 10 year old codebaseMichael Klishin

Drupal High Availability High Performance 2012Amazee Labs

ElasticBeanstalk で新規事業を爆速ローンチするRyo Shibayama

PL/Parrot San Francisco Perl Mongers 2010/05/25David Fetter

Functional RubyAmoniac OÜ

Funtional Ruby - Mikhail BortnykRuby Meditation

6 reasons Jubilee could be a Rubyist's new best friendForrest Chang

Refactoring RIA Unleashed 2011Jesse Warden

Scaling with swaggerTony Tam

Doing cool stuff with WordPressPeter Baylies

Puppet101Puppet

Evaluating Drupal for the Enterpriseultimike

Social dev camp_2011Craig Ulliott

Tweakers AnonymousJohn Anderson

Doodling for-great-successRadamanthus Batnag

Le PERL est mortapeiron

WebGL Camp 4 - A3 3D Engineaerotwist

talkRubens Stulzer

Message:Passing - lpw 2012Tomas Doran

More from Jervin Real (12)

Low Cost Transactional and Analytics with MySQL + ClickhouseJervin Real

This document discusses using Clickhouse as a data warehouse to improve analytics performance compared to MySQL. It describes replicating data from MySQL to Clickhouse using different methods, including challenges with updates and deletes. Sample queries are provided showing improved performance in Clickhouse. Next steps discussed include using CollapsingMergeTree in Clickhouse to better handle updates and deletes while maintaining data consistency between the data sources.

Low Cost Transactional and Analytics with MySQL + ClickhouseJervin Real

This document discusses using Clickhouse to improve query performance for dashboards compared to using MySQL alone. It describes replicating data from MySQL to Clickhouse to enable faster analytics queries. Three methods for replication are outlined, and the process used is described, including initial full table imports and incremental changes. Limitations are noted around updates/deletes and resource usage. Sample dashboard queries are shown that demonstrate significant performance gains in Clickhouse. In summary, Clickhouse was able to meet the sub-15 minute latency requirement for dashboard queries, using a single instance, whereas MySQL required multiple instances and caching to achieve similar performance.

ZFS and MySQL on Linux, the Sweet SpotsJervin Real

The document discusses using ZFS as the storage backend for MySQL and Percona XtraDB Cluster. It finds that while ZFS can provide reliable storage, encryption, compression and backups for MySQL, direct performance is limited by disk throughput. Adding an NVMe SLOG helps improve performance for a large MySQL dataset, but is still limited by the underlying storage. ZFS snapshots provide an alternative to XtraBackup for state snapshot transfers in Percona XtraDB Cluster that keeps the donor node available. Testing backups with ZFS snapshots on MySQL shows initial steady performance, but degradation over time as reads saturate the disks.

Lock, Stock and Backup: Data GuaranteedJervin Real

Learning MySQL 5.7Jervin Real

The document discusses learning MySQL 5.7. It provides an agenda that includes background on MySQL 5.7, new features in 5.7, and upgrading to 5.7. Some of the new features covered include support for JSON, GIS, improved replication options like multi-source and parallel replication, and changes to InnoDB like online buffer pool resizing. The section on upgrading provides details on installation changes, new configuration defaults, deprecations, and recommended upgrade procedures like backing up data, running mysql_upgrade, and testing.

Heterogenous PersistenceJervin Real

This document provides an overview of heterogeneous persistence and different database management systems (DBMS). It discusses why a single DBMS is often not sufficient and describes different types of DBMS including relational databases, key-value stores, and columnar databases. For each type, it outlines good and bad use cases, examples, considerations, and pros and cons. The document aims to help readers understand the different flavors of DBMS and how to choose the right ones for their specific data and access needs.

Preventing and Resolving MySQL DowntimeJervin Real

This document summarizes a presentation about preventing and resolving MySQL downtime. It discusses common issues that can cause downtime like disk failures, crashes from bugs or upgrades, unnoticed cluster node failures, and performance problems. Solutions presented include tools from Percona like XtraDB Cluster for high availability, the Percona Monitoring Plugins, and the Percona Toolkit. The presentation also covers preventing issues through monitoring, proper configuration of MySQL, the operating system, and hardware.

TokuDB - What You Need to KnowJervin Real

TokuDB is an alternative storage engine for MySQL that offers features like compression, hot schema changes, amortized writes, and multiple clustering indexes. It can help get past limitations of InnoDB. When evaluating TokuDB, you should test queries and overall performance and make sure it meets your requirements. The minimum installation involves configuring parameters like open file limits, cache size, and direct I/O in MySQL and disabling transparent huge pages in Linux. Loading and backing up data may require using ALTER TABLE, SELECT INTO OUTFILE, or the TokuDB Hot Backup plugin. Key things to monitor include open file descriptors, swapping, and checkpoint durations.

PLAM 2015 - Evolving Backups Strategy, Devploying pyxbackupJervin Real

Not all backup requirements are the same, there are simple backups and then there are complex backup and recovery strategies. After working with hundreds of users laying out the ground work, we've decided that although not all installations are the same, all of them run through the same procedure so we have decided to automate most of this things with pyxbackup. This talk will highlight the evolution of the project from the most basic backup implementation to extending capabilities for different scenarios like compression, remote storage, encryption and being a portable, comprehensible backup utility for the novice and experts alike. The pyxbackup project can be found at: https://github.com/dotmanila/pyxbackup

Learning by Experience, Devploying pyxbackupJervin Real

The document discusses the development of pyxbackup, a Python backup management tool that was created to address the limitations of an existing Bash script backup solution. It describes how the developer used Python to make pyxbackup more flexible, portable, maintainable and easy to debug compared to the Bash script. The document outlines various Python features and standard library modules used in pyxbackup's development to handle tasks like configuration, environment interaction, error handling and logging in order to improve the tool's functionality and usability.

High Performance Rails with MySQLJervin Real

This document discusses optimizing performance for Rails applications using MySQL. It recommends exhausting application optimizations first through profiling tools. For MySQL, it suggests disabling the query cache, using indexes, optimizing schemas, and upgrading to newer versions. For Rails, it advises caching queries, avoiding N+1 queries through includes/joins, compressing transactions, and learning SQL. The goal is to squeeze performance from software before prematurely scaling hardware.

Highly Available MySQL/PHP Applications with mysqlndJervin Real

This document discusses how to achieve high availability in PHP/MySQL applications using the mysqlnd driver. It describes different MySQL high availability configurations including master-slave replication, multi-master replication using Galera or NDB Cluster, and how mysqlnd's mysqlnd_ms plugin allows applications to connect to these clustered MySQL instances in a highly available manner by handling failover between nodes. The document provides examples of mysqlnd_ms connection configuration for both master-slave and multi-master setups.

Low Cost Transactional and Analytics with MySQL + ClickhouseJervin Real

ZFS and MySQL on Linux, the Sweet SpotsJervin Real

Lock, Stock and Backup: Data GuaranteedJervin Real

Learning MySQL 5.7Jervin Real

Heterogenous PersistenceJervin Real

Preventing and Resolving MySQL DowntimeJervin Real

TokuDB - What You Need to KnowJervin Real

PLAM 2015 - Evolving Backups Strategy, Devploying pyxbackupJervin Real

Learning by Experience, Devploying pyxbackupJervin Real

High Performance Rails with MySQLJervin Real

Highly Available MySQL/PHP Applications with mysqlndJervin Real

Recently uploaded (20)

Linux Professional Institute LPIC-1 Exam.pdfRHCSA Guru

Splunk Security Update | Public Sector Summit Germany 2025Splunk

Manifest Pre-Seed Update | A Humanoid OEM Deeptech In Francechb3

Designing Low-Latency Systems with Rust and ScyllaDB: An Architectural Deep DiveScyllaDB

Want to learn practical tips for designing systems that can scale efficiently without compromising speed? Join us for a workshop where we’ll address these challenges head-on and explore how to architect low-latency systems using Rust. During this free interactive workshop oriented for developers, engineers, and architects, we’ll cover how Rust’s unique language features and the Tokio async runtime enable high-performance application development. As you explore key principles of designing low-latency systems with Rust, you will learn how to: - Create and compile a real-world app with Rust - Connect the application to ScyllaDB (NoSQL data store) - Negotiate tradeoffs related to data modeling and querying - Manage and monitor the database for consistently low latencies

Mobile App Development Company in Saudi ArabiaSteve Jonas

EmizenTech is a globally recognized software development company, proudly serving businesses since 2013. With over 11+ years of industry experience and a team of 200+ skilled professionals, we have successfully delivered 1200+ projects across various sectors. As a leading Mobile App Development Company In Saudi Arabia we offer end-to-end solutions for iOS, Android, and cross-platform applications. Our apps are known for their user-friendly interfaces, scalability, high performance, and strong security features. We tailor each mobile application to meet the unique needs of different industries, ensuring a seamless user experience. EmizenTech is committed to turning your vision into a powerful digital product that drives growth, innovation, and long-term success in the competitive mobile landscape of Saudi Arabia.

Build Your Own Copilot & Agents For DevsBrian McKeiver

Increasing Retail Store Efficiency How can Planograms Save Time and Money.pptxAnoop Ashok

Drupalcamp Finland – Measuring Front-end Energy ConsumptionExove

How analogue intelligence complements AIPaul Rowe

Artificial Intelligence is providing benefits in many areas of work within the heritage sector, from image analysis, to ideas generation, and new research tools. However, it is more critical than ever for people, with analogue intelligence, to ensure the integrity and ethical use of AI. Including real people can improve the use of AI by identifying potential biases, cross-checking results, refining workflows, and providing contextual relevance to AI-driven results. News about the impact of AI often paints a rosy picture. In practice, there are many potential pitfalls. This presentation discusses these issues and looks at the role of analogue intelligence and analogue interfaces in providing the best results to our audiences. How do we deal with factually incorrect results? How do we get content generated that better reflects the diversity of our communities? What roles are there for physical, in-person experiences in the digital world?

SAP Modernization: Maximizing the Value of Your SAP S/4HANA Migration.pdfPrecisely

HCL Nomad Web – Best Practices and Managing Multiuser Environmentspanagenda

Webinar Recording: https://www.panagenda.com/webinars/hcl-nomad-web-best-practices-and-managing-multiuser-environments/ HCL Nomad Web is heralded as the next generation of the HCL Notes client, offering numerous advantages such as eliminating the need for packaging, distribution, and installation. Nomad Web client upgrades will be installed “automatically” in the background. This significantly reduces the administrative footprint compared to traditional HCL Notes clients. However, troubleshooting issues in Nomad Web present unique challenges compared to the Notes client. Join Christoph and Marc as they demonstrate how to simplify the troubleshooting process in HCL Nomad Web, ensuring a smoother and more efficient user experience. In this webinar, we will explore effective strategies for diagnosing and resolving common problems in HCL Nomad Web, including - Accessing the console - Locating and interpreting log files - Accessing the data folder within the browser’s cache (using OPFS) - Understand the difference between single- and multi-user scenarios - Utilizing Client Clocking

AI and Data Privacy in 2025: Global TrendsInData Labs

In this infographic, we explore how businesses can implement effective governance frameworks to address AI data privacy. Understanding it is crucial for developing effective strategies that ensure compliance, safeguard customer trust, and leverage AI responsibly. Equip yourself with insights that can drive informed decision-making and position your organization for success in the future of data privacy. This infographic contains: -AI and data privacy: Key findings -Statistics on AI data privacy in the today’s world -Tips on how to overcome data privacy challenges -Benefits of AI data security investments. Keep up-to-date on how AI is reshaping privacy standards and what this entails for both individuals and organizations.

Enhancing ICU Intelligence: How Our Functional Testing Enabled a Healthcare I...Impelsys Inc.

Transcript: #StandardsGoals for 2025: Standards & certification roundup - Tec...BookNet Canada

Book industry standards are evolving rapidly. In the first part of this session, we’ll share an overview of key developments from 2024 and the early months of 2025. Then, BookNet’s resident standards expert, Tom Richardson, and CEO, Lauren Stewart, have a forward-looking conversation about what’s next. Link to recording, presentation slides, and accompanying resource: https://bnctechforum.ca/sessions/standardsgoals-for-2025-standards-certification-roundup/ Presented by BookNet Canada on May 6, 2025 with support from the Department of Canadian Heritage.

Technology Trends in 2025: AI and Big Data AnalyticsInData Labs

At InData Labs, we have been keeping an ear to the ground, looking out for AI-enabled digital transformation trends coming our way in 2025. Our report will provide a look into the technology landscape of the future, including: -Artificial Intelligence Market Overview -Strategies for AI Adoption in 2025 -Anticipated drivers of AI adoption and transformative technologies -Benefits of AI and Big data for your business -Tips on how to prepare your business for innovation -AI and data privacy: Strategies for securing data privacy in AI models, etc. Download your free copy nowand implement the key findings to improve your business.

2025-05-Q4-2024-Investor-Presentation.pptxSamuele Fogagnolo

Andrew Marnell: Transforming Business Strategy Through Data-Driven InsightsAndrew Marnell

IEDM 2024 Tutorial2_Advances in CMOS Technologies and Future Directions for C...organizerofv

Cybersecurity Identity and Access Solutions using Azure ADVICTOR MAESTRE RAMIREZ

HCL Nomad Web – Best Practices und Verwaltung von Multiuser-Umgebungenpanagenda

Webinar Recording: https://www.panagenda.com/webinars/hcl-nomad-web-best-practices-und-verwaltung-von-multiuser-umgebungen/ HCL Nomad Web wird als die nächste Generation des HCL Notes-Clients gefeiert und bietet zahlreiche Vorteile, wie die Beseitigung des Bedarfs an Paketierung, Verteilung und Installation. Nomad Web-Client-Updates werden “automatisch” im Hintergrund installiert, was den administrativen Aufwand im Vergleich zu traditionellen HCL Notes-Clients erheblich reduziert. Allerdings stellt die Fehlerbehebung in Nomad Web im Vergleich zum Notes-Client einzigartige Herausforderungen dar. Begleiten Sie Christoph und Marc, während sie demonstrieren, wie der Fehlerbehebungsprozess in HCL Nomad Web vereinfacht werden kann, um eine reibungslose und effiziente Benutzererfahrung zu gewährleisten. In diesem Webinar werden wir effektive Strategien zur Diagnose und Lösung häufiger Probleme in HCL Nomad Web untersuchen, einschließlich - Zugriff auf die Konsole - Auffinden und Interpretieren von Protokolldateien - Zugriff auf den Datenordner im Cache des Browsers (unter Verwendung von OPFS) - Verständnis der Unterschiede zwischen Einzel- und Mehrbenutzerszenarien - Nutzung der Client Clocking-Funktion

Linux Professional Institute LPIC-1 Exam.pdfRHCSA Guru

Splunk Security Update | Public Sector Summit Germany 2025Splunk

Manifest Pre-Seed Update | A Humanoid OEM Deeptech In Francechb3

Designing Low-Latency Systems with Rust and ScyllaDB: An Architectural Deep DiveScyllaDB

Mobile App Development Company in Saudi ArabiaSteve Jonas

Build Your Own Copilot & Agents For DevsBrian McKeiver

Increasing Retail Store Efficiency How can Planograms Save Time and Money.pptxAnoop Ashok

Drupalcamp Finland – Measuring Front-end Energy ConsumptionExove

How analogue intelligence complements AIPaul Rowe

SAP Modernization: Maximizing the Value of Your SAP S/4HANA Migration.pdfPrecisely

HCL Nomad Web – Best Practices and Managing Multiuser Environmentspanagenda

AI and Data Privacy in 2025: Global TrendsInData Labs

Enhancing ICU Intelligence: How Our Functional Testing Enabled a Healthcare I...Impelsys Inc.

Transcript: #StandardsGoals for 2025: Standards & certification roundup - Tec...BookNet Canada

Technology Trends in 2025: AI and Big Data AnalyticsInData Labs

2025-05-Q4-2024-Investor-Presentation.pptxSamuele Fogagnolo

Andrew Marnell: Transforming Business Strategy Through Data-Driven InsightsAndrew Marnell

IEDM 2024 Tutorial2_Advances in CMOS Technologies and Future Directions for C...organizerofv

Cybersecurity Identity and Access Solutions using Azure ADVICTOR MAESTRE RAMIREZ

HCL Nomad Web – Best Practices und Verwaltung von Multiuser-Umgebungenpanagenda

AWS Users Meetup April 2015

1. MySQL in AWS, An Evolutionary Tale Jervin Real AWS Users Group, Apr 2015

2. Hello! My name is Jervin • Student • Senior MySQL Consultant at Percona • @dotmanila • https://github.com/dotmanila • http://dotmanila.com/blog/ • http://www.percona.com/blog/author/jervin

3. Birth

4. Infancy

5. Infancy

6. First Steps

7. First Steps

8. Playful Toddler

9. Am I Awesome, or Am I Awesome?

10. Your First Bruise

12. Success?

13. Infancy

14. Everybody Gets a Database!

15. Load Balancing

16. OMG!

17. OMG!

18. OMG!

19. Need. More. Flexibility!

20. You Loose Convenience

22. Roll Your Own HA

23. Roll Your Own HA • MySQL Master HA

24. Roll Your Own HA • MySQL Master HA • Pacemaker (PRM)

25. Roll Your Own HA • MySQL Master HA • Pacemaker (PRM) • mysqlfailover

26. Roll Your Own HA • MySQL Master HA • Pacemaker (PRM) • mysqlfailover • Custom scripts found on GitHub!

27. Roll Your Own HA • MySQL Master HA • Pacemaker (PRM) • mysqlfailover • Custom scripts found on GitHub! • etc . . .

28. Roll Your Own HA

29. Roll Your Own HA

30. Roll Your Own HA

31. Business Wants to Expand

32. Roll Your Own HA

33. Geo-Redundancy

34. Synchronous Replication

35. To summarize: • Start small, but delegate early - RDS instances are cheap! • Scale your reads, but do not forget your primary’s HA • RDS multi-AZ has limited health checks, plan failure around them as well. • EC2 instance provides more flexibility minus convenient RDS features • HA solutions for asynchronous replication is available • Percona XtraDB Cluster (Galera based) for multi location writes*

36. Questions?

AWS Users Meetup April 2015

Recommended

More Related Content

What's hot (20)

Similar to AWS Users Meetup April 2015 (20)

More from Jervin Real (12)

Recently uploaded (20)

AWS Users Meetup April 2015