MySQL Sandbox - A toolkit for productive laziness

MySQL Sandbox
A toolkit for
productive laziness
Giuseppe Maxia
QA Director, Continuent, Inc

This work is licensed under the Creative Commons
Attribution-Share Alike 3.0 Unported License. To view a
copy of this license, visit http://creativecommons.org/
licenses/by-sa/3.0/ or send a letter to Creative Commons,
171 Second Street, Suite 300, San Francisco, California,
94105, USA.
Tuesday, October 25, 11

about me - Giuseppe Maxia
• a.k.a. The Data Charmer
• QA Director at Continuent, Inc
• Long time hacking with MySQL features
• Formerly, community manager,db consultant, designer,
coder.
• A passion for QA and open source
• Blogger
• http://datacharmer.blogspot.com


Laziness
Laziness is a disinclination to
activity or exertion despite
having the ability to do so.

http://en.wikipedia.org/wiki/Laziness

I am an experienced DBA


• I have the ability of installing
multiple MySQL servers.


• In the same host.


• Without conflicting.


• Manually.


• Manually.
• Do I feel inclined to do so?


• Manually.
• Several times a day?


• Manually.
• Several times a day?
• I DON'T THINK SO.

I am a command line wizard



• After installing multiple servers



• I can use them



• I can use them
• with various long options.



• I can use them
• Manually.



• I can use them
• Manually.
• Many dozen times a day?



• I can use them
• Manually.
• Many dozen times a day?
• I DEFINITELY DON'T THINK SO.

I can set up replication



• Almost without errors.



• And then I can connect to masters
and slaves with long options on the
command line.



command line.



command line.
• I DON'T THINK SO.


I have the ability


I have the ability

• but I don't feel inclined to do repetitive
work


I have the ability

• but I don't feel inclined to do repetitive
work
• I ADMIT IT: I AM LAZY


A lazy developer ®

Someone who writes 12,000
lines of code to spare himself
the trouble of typing 15 lines
on a terminal.


A lazy developer ®

Someone who writes 12,000
lines of code to spare himself (*)
the trouble of typing 15 lines
on a terminal.
(*) And another 1,000,000 people

That's me


MySQL Sandbox
http://mysqlsandbox.net
• Free software (Perl under GPL)
• One (unix) host
• Many database servers
• Single or multiple sandboxes
• Customized scripts to use the servers
• Standard or circular replication
• Installs IN SECONDS

overview

MySQL MySQL
server server
Data DB1 Data DB1

DB2 DB3
DATA DIRECTORY DB2 DB3

PORT

SOCKET


overview

MySQL MySQL
server server
Data DB1
SAME Data DB1

DB2 DB3
DATA DB2 DB3

DIRECTORY?
/var/lib/mysql /var/lib/mysql

DATA CORRUPTION

overview

MySQL MySQL
server server

SAME
PORT or
SOCKET?
3306 3306

/tmp/mysql.sock /tmp/mysql.sock

DOES NOT START

The hard way (1)


the hard way (2)


The easy way
$ make_sandbox
/path/to/mysql-5.1.54_linux.tar.gz

$ make_sandbox
Percona-Server-5.1.54_linux.tar.gz

# it should work always


The easier way
$ make_sandbox 5.1.54

# Needs some preliminary work


The easiest way
$ sb 5.1.54

# Needs the same preliminary work


MySQL Sandbox
VERSION
MySQL
server
Data DB1

DB2 DB3
$SANDBOX_HOME/msb_VERSION/data

VERSION

/tmp/mysql_VERSION.sock


MySQL Sandbox
5.1.54
MySQL
server
Data DB1

DB2 DB3
$SANDBOX_HOME/msb_5_1_54/data

5154

/tmp/mysql_5154.sock


MySQL Sandbox
5.5.9
MySQL
server
Data DB1

DB2 DB3
$SANDBOX_HOME/msb_5_5_09/data

5509

/tmp/mysql_5509.sock


Single Sandbox
MySQL customized scripts
server

start
stop
restart
status
clear
send_kill
use


Multiple Sandbox
MySQL customized scripts
server

start_all
stop_all
restart_all m n1
status_all s1 n2
clear_all s2 n3
send_kill_a
ll
use_all

Where do you get it

•from CPAN
sudo cpan MySQL::Sandbox

•from launchpad
http://launchpad.net/mysql-sandbox


The easy replication way
$ make_replication_sandbox
/path/to/mysql-5.1.54_linux.tar.gz

# or, after some preparation

$ make_replication_sandbox 5.1.54


default architecture
$HOME

/sandboxes opt
expanded
tarballs
$SANDBOX_HOME
mysql

$SANDBOX_BINARY
installed
sandboxes


default architecture
$HOME

/sandboxes opt

msb_5_0_91
mysql
msb_5_1_48
5.0.91
rsandbox_5_1_48
5.1.45
master
5.1.48
node1
5.5.4
node2

creating a single sandbox
make_sandbox
/path/to/mysql-X.X.XX-OS.tar.gz


using a single sandbox
# after
# make_sandbox
# /path/to/mysql-X.X.XX-OS.tar.gz

$ cd $SANDBOX_HOME/msb_X_X_XX
$ ./use


creating a single sandbox
with a speciﬁc options ﬁle

make_sandbox
/path/to/mysql-X.X.XX-OS.tar.gz
-- --my_file=/path/to/my.cnf


easily create a sandbox after the ﬁrst
one
The long way
$ cd $HOME/opt/mysql # $SANDBOX_BINARY
$ gunzip -c
/path/to/mysql-5.1.34-osx10.5-x86.tar.gz
| tar -xf -
$ mv mysql-5.1.34-osx10.5-x86 5.1.34
$ make sandbox 5.1.34


easily create a sandbox after the ﬁrst
one
The short way
$ make_sandbox --export_binaries
path/to/mysql-5.1.34-osx10.5-x86.tar.gz


starting a single sandbox
$ ./start


starting a single sandbox
with temporary options
$ ./start --option=value

$ ./restart --option=value

$ ./start --key-buffer=20000000


creating a sandbox with custom port
and directory
$ make_sandbox 5.1.34 --
--sandbox_port=7800
--sandbox_directory=mickeymouse


creating a sandbox with automatic
port checking
$ make_sandbox 5.1.34 -- --check_port

# if 5.1.34 is free
# port=5134
# directory=msb_5_1_34
# else
# port=5135 (or the first free)
# directory=msb_5_1_34_a


create a replication sandbox



create a circular replication sandbox

--circular=4


changing port to an existing sandbox

$ sbtool -o port
-s /path/to/source/sandbox
--new_port=XXXX


installing the innodb plugin

$ sbtool -o plugin
--plugin=innodb
-s /path/to/source/sandbox


creating a replication sandbox with
new base port

--replication_directory=newwdir
--check_base_port 5.0.79

# Creates a replication directory under
# $SANDBOX_HOME/newdir
# The previous one is preserved.
# No conflicts happen


more recipes

$ perldoc MySQL::Sandbox::Recipes


MySQL Sandbox evolution


Tungsten Sandbox


replicator
1

replicator
TSB 2

replicator
3

database
HOME 1

database
sandboxes base_dir 2

database
3


tungsten sandbox help
./tools/tungsten-sandbox -h
USAGE: ./tools/tungsten-sandbox [flags] args
flags:
-n,--nodes: how many nodes to install (default: 3)
-m,--mysql_version: which MySQL version to use (default: '5.5.13')
-t,--tungsten_base: where to install the sandbox (default: '$HOME/tsb2/')
-d,--group_dir: sandbox group directory name (default: 'tr_dbs')
-x,--tsb_prefix: Tungsten Sandbox prefix (default: 'db')
-s,--service: how the service is named (default: 'tsandbox')
-P,--base_port: port base for MySQL sandbox nodes (default: 7100)
-l,--thl_port: port for the THL service (default: 12110)
-r,--rmi_port: port for the RMI service (default: 10100)
-v,--[no]version: show Tungsten sandbox version (default: false)
-h,--[no]help: show Tungsten sandbox help (default: false)


tungsten sandbox
$ ./tools/tungsten-sandbox -m 5.5.10
executing "clear" on node 1
installing node 1
installing node 2
installing node 3
group directory installed in $HOME/sandboxes/tr_dbs


tungsten sandbox
ls ~/tsb2
clear_tsandbox
db1 db2 db3
db_clear_all db_send_kill_all db_start_all
db_status_all db_stop_all db_use_all
n1 n2 n3 replicator_all start_tsandbox trepctl_all


Participate!


THANKS
Let's talk!

This work is licensed under the Creative Commons Attribution-Share Alike 3.0 Unported License. To view a copy of this license, visit http://
creativecommons.org/licenses/by-sa/3.0/ or send a letter to Creative Commons, 171 Second Street, Suite 300, San Francisco, California,
94105, USA.

MySQL Sandbox - A toolkit for productive laziness

Recommended

More Related Content

What's hot (12)

Viewers also liked (9)

More from Giuseppe Maxia (20)

Recently uploaded (20)

MySQL Sandbox - A toolkit for productive laziness