MySQL as a Document Store

Copyright © 2015, Oracleand/orits affiliates. Allrights reserved. |Copyright © 2015, Oracleand/orits affiliates. Allrights reserved. |
MySQL as a Document Store
Ted Wennmark
ted.wennmark@oracle.com

Copyright © 2015, Oracleand/orits affiliates. Allrights reserved. |
Safe Harbor Statement
The following is intended to outline our general product direction. It is intended for
information purposes only, and may not be incorporated into any contract. It is not a
commitmentto deliver any material, code, or functionality, and should not be relied upon
in making purchasing decisions. The development, release, and timing of any features or
functionalitydescribed for Oracle’s products remains at the sole discretion of Oracle.

Program Agenda
MySQL Document Store
MySQL Future
1
2
3

Program Agenda
MySQL Future
1
2
4

Today’s Challenges
• Developers want to move faster
• Time to market has a premium value
• Rapid prototyping, iterate fast…
5

Today’s Challenges (cont.)
• Relational databases ask for schema up front
– Potentiallysaving you time in the future
– Less variations; less code to handle edge cases
– Added cost with each schema change
• NoSQL databases do not ask for schema
– Saving you time up front
– But potentially adding operational costs over time
– No cost per schema change
6

Why can you not…
• Have both schema-less and schema in the same technology stack?
• One that checks all the boxes of all stakeholders:
7
Developers:
[ x ] Schemaless
[ x ] Rapid Prototyping/SimplerAPIs
[ x ] Document Model
Operations:
[ x ] Performance Management/Visibility
[ x ] Robust Replication, Backup, Restore
[ x ] ComprehensiveTooling Ecosystem
Business Owner:
[ x ] Don’t lose my data = ACID transactions
[ x ] Capture all my data = Extensible/Schemaless
[ x ] ProductsOn Schedule/Timeto Market = Rapid Development

NEW! MySQL Document Store
• NativeJSON Documents in MySQL 5.7
– Schema-less Document Storage
• X Protocol (MySQL 5.7.12 DMR)
– Implementedby X Plugin to Extend MySQL Server as a Document Store
• X Dev API
– SQL and Document CRUD Operations
– Implementedin Connector/Node.js,Connector/J,Connector/Net
• MySQL Shell
– Javascript,Python,SQL modes

Architecture
9
MySQL
Plugins
X ProtocolPlugin MemcachedPlugin
Core
X ProtocolStdProtocol
X Protocol
33060
StdProtocol
3306
SQLAPI CRUD API
X and Std
Protocols
MySQL
Shell

New! MySQL X DevAPI
• Modern: fluent API, method chaining
• Stateless sessions enable transparent scaling to multi-server environments
• SQL support
• CRUD for Collections of Documents and Tables
– Documentsas simple basic domain objects
– Search expressions match SQL SELECT expressions
• Implemented in MySQL Shell & MySQL Connectors
– NEW! MySQL Connector/node.js
– MySQLConnector/J
– MySQLConnector/Net

New! MySQL Shell
• Integrated Development and Administration Shell
• Exposes New X DevAPI
• Multi-Language scripting
– JavaScript, Python, and SQL
• Configurable results formats
– Traditional Table, JSON, Tab Separated
11

Copyright © 2015, Oracleand/orits affiliates. Allrights reserved. | 12
tomas@localhost $ mysqlsh --uri root@localhost/test
Creatingan X Sessionto root@localhost:33060/test
Enter password:
Default schema `test` accessible through db.
…
Currently in JavaScript mode. Use sql to switch to SQL mode and execute queries.
mysql-js> db.createCollection("posts");
<Collection:posts>
mysql-js> db.posts.add({"title":"Hello World", "text":"First post!"})
Query OK, 1 item affected(0.03 sec)
mysql-js> db.posts.find("title = 'Hello World'").sort(["title"]);
[
{
"_id": "8202bda28206e611140b3229389b6526",
"text": "First post!",
"title": "Hello World"
}
]
1 document in set (0.01 sec)

Under the Hood

Collections are tables
Tables with:
- JSON column
- GeneratedColumn
Create a Collection

Under The Hood II
15
• X-Plugin translatesCRUD -> SQL
• No code changes in core parts of MYSQL
Create Document (CRUD)
Look inside general-log

Under The Hood III
16
Read Document (CRUD)
Look inside general-log

CRUD Operations – NoSQL/Document and SQL/Relational
Operation Document Relational
Create Collection.add() Table.insert()
Read Collection.find() Table.select()
Update Collection.modify() Table.update()
Delete Collection.remove() Table.delete()
17

CRUD Operations
NoSQL/Document
Javascript Java
C#NodeJS

CRUD Operations
SQL/Relational
19
Javascript Java
C#NodeJS

✔ Built on Proven SQL/InnoDB/Replication
✔ Schema-less/Relational/Hybrid
✔ ACID/Transactions
✔ CRUD/JSON/Documents
✔ Modern Dev API
✔ Modern/Efficient Protocol
✔ SQL Queries/Analytics over JSON Documents
✔ Transparent and Easy HA/Scaling/Sharding

New! Documentation
• Developer Guides
• Lots of examples
New Style - Developer Focused
21
http://dev.mysql.com/doc/dev/mysqlsh-api-javascript/

Program Agenda
MySQL Future
1
2
22

Vision

“Be the most popular open source
database for scale-out”
24

3 MySQL will focus on three things.
25

Scale-Out
Ease-of-Use
Out-of-Box
Solution
MySQL

Ease-of-Use
• Download, Install, HA & Scale-Out in 15 minutes
• Single Interface for Everything MySQL
• Easy to Setup, Scale-Out, Manage & Monitor
• Excellent Quality
MySQL

Out-of-Box Solution
• Integrated Solution vs. Individual Components
• Designed & Developed Together
• Tested & Delivered Together
• Managed & Monitored Together
MySQL

Scale-Out
• Maintain World-Class Performance
• Rock Solid, Server-Side HA With Auto-Failover
• Read Scale-Out With Replication
• Write Scale-Out With Sharding
MySQL

4 Rollout will happen in four steps.
30

Read Scale-Out
Async Replication+ Auto Failover
Write Scale-Out
Sharding
S1
S2
S3
S4
MySQL Vision – 4 Steps
Timeline
MySQLDocumentStore
Relational & Document Model
MySQLHA
Out-Of-BoxHA

Introducing …
32

Scale-Out
High Performance
Ease-of-Use
Built-inHA
Out-of-Box Solution
Everything Integrated
MySQL
InnoDB
cluster

A single product: MySQL
• All componentscreated together
• Tested together
• Packaged together
Flexible and Modern
• C++ 11
• ProtocolBuffers
• Developer friendly
MySQL InnoDB Cluster – Goals
Easy to use
• A single client: MySQL Shell
• Easy packaging
• Homogenousservers
Scale-out
• Sharded clusters
• Federated system of N replica sets
• Each replica set manages a shard

MySQL
InnoDB
cluster
MySQL InnoDB Cluster – Architecture - S2
M
M M
MySQLConnector
Application
MySQL Router
MySQL Connector
Application
MySQL Router
MySQL Shell
HA
Group Replication

S1 S2 S3 S4 S…
M
M M
MySQLConnector
Application
MySQL Router
MySQL Connector
Application
MySQL Router
MySQL Shell
HA
MySQL InnoDB Cluster – Architecture - S3 MySQL
InnoDB
cluster
Read-Only Slaves

S1 S2 S3 S4 S…
M
M M
MySQLConnector
Application
MySQL Router
MySQL Connector
Application
MySQL Router
MySQL Shell
HA
ReplicaSet(Shard1)
S1 S2 S3 S4 S…
M
M M
MySQLConnector
Application
MySQL Router
HA
ReplicaSet(Shard2)
S1 S2 S3
M
M M
H
ReplicaSet(Shard3)
MySQLConnector
Application
MySQL Router
MySQL InnoDB Cluster – Architecture - S4 MySQL
InnoDB
cluster
…

MySQLConnector
Application
MySQL Connector
Application
MySQL Shell
MySQLConnector
Application
MySQLConnector
Application
MySQL InnoDB Cluster – Architecture
MySQL
InnoDB
cluster
MySQL Enterprise Monitor
…

MySQL
InnoDB
cluster

Demo
MySQL
InnoDB
cluster

MySQL
InnoDB
cluster
MySQL InnoDB Cluster – DEMO
M
M M
Application
MySQL Router
MySQL Connector
Applicaion
MySQL Shell
HA
Group Replication
3310
3320 3330

The Demo Showed…
• MySQL HA in 4 minutes
• Very easy, even for somebody new to MySQL
• Everything managed through MySQL Shell
• Convenient, easy-to-use AdminAPI
MySQL
InnoDB
cluster

1 One seamless solution for HA:
Easy-to-Use, Out-of-Box, Scale-
Out.
43
MySQL
InnoDB
cluster

What’s next?
44

Read Scale-Out
Async Replication+ Auto Failover
Write Scale-Out
Sharding
S1
S2
S3
S4
MySQL Vision – 4 Steps
Timeline
Download Preview Release from
labs.mysql.com
MySQLDocumentStore
Relational & Document Model
MySQLHA
Out-Of-BoxHA

Resources
Topic Link(s)
MySQLas a Document Database http://dev.mysql.com/doc/refman/5.7/en/document-database.html
MySQLShell http://dev.mysql.com/doc/refman/5.7/en/mysql-shell.html
http://dev.mysql.com/doc/refman/5.7/en/mysqlx-shell-tutorial-javascript.html
http://dev.mysql.com/doc/refman/5.7/en/mysqlx-shell-tutorial-python.html
X Dev API http://dev.mysql.com/doc/x-devapi-userguide/en/
X Plugin http://dev.mysql.com/doc/refman/5.7/en/x-plugin.html
MySQLJSON http://mysqlserverteam.com/tag/json/
https://dev.mysql.com/doc/refman/5.7/en/json.html
https://dev.mysql.com/doc/refman/5.7/en/json-functions.html
46

Thank you!

MySQL as a Document Store

Recommended

More Related Content

What's hot (20)

Similar to MySQL as a Document Store (20)

More from Ted Wennmark (13)

Recently uploaded (20)

MySQL as a Document Store