+

NoSQL

W2013
CSCI 2141
+
OLTP vs. OLAP
 We can divide IT systems into transactional (OLTP) and analytical
(OLAP). In general we can assume that OLTP systems provide source
data to data warehouses, whereas OLAP systems help to analyze it

.
+
Challenges of Scale Differ
+

A Comparison of SQL and NoSQL Databases

Slides from: Keith W. Hare
Metadata Open Forum

More reading: http://martinfowler.com/articles/nosqlKeyPoints.html

Metadata Open Forum
+
Abstract

NoSQL databases (either no-SQL or Not Only SQL) are currently a

hot topic in some parts of computing. In fact, one website lists over
a hundred different NoSQL databases.

This presentation reviews the features common to the NoSQL

databases and compares those features to the features and
capabilities of SQL databases.

BIG DATA!
6 November 9, 2020
7 November 9, 2020
+
SQL Characteristics

 Data stored in columns and tables

 Relationships represented by data

 Data Manipulation Language

 Data Definition Language

 Transactions

 Abstraction from physical layer

8 November 9, 2020
+
SQL Physical Layer Abstraction

 Applications specify what, not how

 Query optimization engine

 Physical layer can change without modifying applications

 Create indexes to support queries
 In Memory databases

9 November 9, 2020
+
Data Manipulation Language (DML)

 Data manipulated with Select, Insert, Update, & Delete

statements
 Select T1.Column1, T2.Column2 …
From Table1, Table2 …
Where T1.Column1 = T2.Column1 …

 Data Aggregation

 Compound statements

 Functions and Procedures

 Explicit transaction control

10 November 9, 2020
+
Data Definition Language

 Schema defined at the start

 Create Table (Column1 Datatype1, Column2 Datatype 2, …)
 Constraints to define and enforce relationships
 Primary Key
 Foreign Key
 Etc.
 Triggers to respond to Insert, Update , & Delete
 Stored Modules
 Alter …
 Drop …
 Security and Access Control

11 November 9, 2020
+
Transactions – ACID Properties

 Atomic
– All of the work in a transaction completes
(commit) or none of it completes
 Consistent
– A transaction transforms the database
from one consistent state to another consistent state.
Consistency is defined in terms of constraints.
 Isolated– The results of any changes made during a
transaction are not visible until the transaction has
committed.
 Durable – The results of a committed transaction
survive failures

12 November 9, 2020
+
NewSQL: more OLTP throughput, real-
time analytics
 ) SQL as the primary mechanism for application interaction

 2) ACID support for transactions

 3) A non-locking concurrency control mechanism so real-time reads

will not conflict with writes, and thereby cause them to stall.

 4) An architecture providing much higher per-node performance than

available from the traditional "elephants”

 5) A scale-out, shared-nothing architecture, capable of running on a

large number of nodes without bottlenecking
+
NoSQL Definition

From www.nosql-database.org:
Next Generation Databases mostly addressing some
of the points: being non-relational, distributed, open-
source and horizontal scalable. The original intention
has been modern web-scale databases. The
movement began early 2009 and is growing rapidly.
Often more characteristics apply as: schema-free,
easy replication support, simple API, eventually
consistent / BASE (not ACID), a huge data amount,
and more.

14 November 9, 2020
+
NoSQL Products/Projects

http://www.nosql-database.org/ lists
122 NoSQL Databases
Cassandra

CouchDB

Hadoop & Hbase

MongoDB

StupidDB

Etc.

15 November 9, 2020
+
NoSQL Products/Projects

http://www.nosql-database.org/ lists
122 NoSQL Databases
Cassandra

CouchDB

Hadoop & Hbase

MongoDB

StupidDB

Etc.

16 November 9, 2020
+ 17

NoSQL Distinguishing Characteristics

 Large data volumes  Asynchronous
 Google’s “big data” Inserts & Updates
 Scalable replication
and distribution  Schema-less
 Potentially thousands of
machines  ACID transaction
 Potentially distributed
around the world properties are not
needed – BASE
 Queries need to return
answers quickly  CAP Theorem
 Mostly query, few
 Open source
updates
development

November 9, 2020
+
BASE Transactions

 Acronym contrived to be the opposite of ACID

 Basically Available,
 Soft state,
 Eventually Consistent

 Characteristics
 Weak consistency – stale data OK
 Availability first
 Best effort
 Approximate answers OK
 Aggressive (optimistic)
 Simpler and faster

18 November 9, 2020
+
Brewer’s CAP Theorem

A distributed system can support only two of the

following characteristics:
 Consistency
 Availability
 Partition tolerance

19 November 9, 2020
+
+
NoSQL Database Types

Discussing NoSQL databases is complicated

because there are a variety of types:
Column Store – Each storage block contains
data from only one column
Document Store – stores documents made up
of tagged elements
Key-Value Store – Hash table of keys

21 November 9, 2020
+
Other Non-SQL Databases

 XML Databases

 Graph Databases
 DocumanetDatabases

 Object Oriented Databases

 Column Family

22 November 9, 2020
+
Storing and Modifying Data

 Syntax varies
 HTML
 Java Script
 Etc.

 Asynchronous – Inserts and updates do not wait for

confirmation
 Versioned

 Optimistic Concurrency

25 November 9, 2020
+
Retrieving Data

 Syntax Varies
 No set-based query language
 Procedural program languages such as Java, C, etc.

 Application specifies retrieval path

 No query optimizer
 Quick answer is important
 May not be a single “right” answer

26 November 9, 2020
+
Open Source

 Small upfront software costs

 Suitable for large scale distribution on commodity hardware

27 November 9, 2020
+
NoSQL Summary

 NoSQL databases reject:

 Overhead of ACID transactions
 “Complexity” of SQL
 Burden of up-front schema design
 Declarative query expression
 Yesterday’s technology

 Programmer responsible for

 Step-by-stepprocedural language
 Navigating access path

28 November 9, 2020
+
Summary

 SQL Databases
 Predefined Schema
 Standard definition and interface language
 Tight consistency
 Well defined semantics

 NoSQL Database
 No predefined Schema
 Per-product definition and interface language
 Getting an answer quickly is more important than
getting a correct answer

29 November 9, 2020
+
Web References

 “ NoSQL -- Your Ultimate Guide to the Non - Relational Universe!”

http://nosql-database.org/links.html
 “ NoSQL (RDBMS)”
http://en.wikipedia.org/wiki/NoSQL
 PODC Keynote, July 19, 2000. Towards Robust. Distributed Systems.
Dr. Eric A. Brewer. Professor, UC Berkeley. Co-Founder & Chief
Scientist, Inktomi .
www.eecs.berkeley.edu/~brewer/cs262b-2004/PODC-keynote.pdf
 “ Brewer's CAP Theorem” posted by Julian Browne, January 11,
2009. http://www.julianbrowne.com/article/viewer/brewers-cap-
theorem
 “ How to write a CV” Geek & Poke Cartoon
http://geekandpoke.typepad.com/geekandpoke/2011/01/nosql.html

30 November 9, 2020
+
Web References

 “ Exploring CouchDB: A document-oriented database for Web

applications” , Joe Lennon, Software developer, Core
International.
http://www.ibm.com/developerworks/opensource/library/os-
couchdb/index.html
 “ Graph Databases, NOSQL and Neo4j” Posted by Peter
Neubauer on May 12, 2010  at:
http://www.infoq.com/articles/graph-nosql-neo4j
 “ Cassandra vs MongoDB vs CouchDB vs Redis vs Riak vs
HBase comparison” , Kristóf Kovács.
http://kkovacs.eu/cassandra-vs-mongodb-vs-couchdb-vs-redis
 “ Distinguishing Two Major Types of Column-Stores” Posted
by Daniel Abadi onMarch 29, 2010
http://dbmsmusings.blogspot.com/2010/03/distinguishing-two-
major-types-of_29.html

31 November 9, 2020
+
Web References

 “ MapReduce: Simplified Data Processing on Large

Clusters” , Jeffrey Dean and Sanjay Ghemawat, December
2004.
http://labs.google.com/papers/mapreduce.html
 “ Scalable SQL” , ACM Queue, Michael Rys, April 19,
2011
http://queue.acm.org/detail.cfm?id=1971597
“a practical guide to noSQL” , Posted by Denise Miura on
March 17, 2011 at
http://blogs.marklogic.com/2011/03/17/a-practical-guide-
to-nosql/

32 November 9, 2020