Ashnik EnterpriseDB PostgreSQL - A real alternative to Oracle

Enterprise Class PostgreSQL Database from EDB

CONFIDENTIAL
© 2011 EnterpriseDB. All rights reserved.

A Technical introduction
to PostgreSQL and PPAS

Agenda
Introduction
About Ashnik
PostgreSQL and buzz it has created
Postgres Plus Advanced Server
•
•
•
•
•
•

Architecture
Oracle Compatibility
Performance Feature
Security Features
High Availability Features
DBA Tools

• User Stories
• What’s coming up in v9.3
• How to start adopting

CONFIDENTIAL

•
•
•
•

2

PostgreSQL and the Community
• Independent & Thriving Development Community for over 20 years

CONFIDENTIAL

• Thousands of active deployments worldwide in public and private
sector organizations of all sizes

3

CONFIDENTIAL

Postgres’ IMPACT

4

CONFIDENTIAL

PostgreSQL – Postgres Plus Users, Globally

5

PostgreSQL – Postgres Plus Users, across ASEAN
Malaysia

Singapore

Vietnam

Indonesia

Thailand

CONFIDENTIAL

Philippines

6

EnterpriseDB – The Company
• The Enterprise PostgreSQL company was founded in 2004,
first product GA in 2005

Postgres Plus - Recognized

• 2,000+ customers across all market segments

Quadrant as a challenger

• 70,000+ downloads/week of PostgreSQL and related products

in the Database Market

• Saving customers millions through the power of open source

• Strong financial backing:

CONFIDENTIAL

• Enabling database consolidation using PostgreSQL and
advanced Oracle compatibility

by Gartner’s Magic

7

The EnterpriseDB Advantage
Products and Tools
• Advanced database server software
• Deep Oracle compatibility
• Bundled development and management tools

•

Technical Support and Services
• Around the clock support
• Expert consulting
• Oracle migration services
• Remote management and monitoring
Professional Training
• Learn PostgreSQL from the experts
• Web and on-site training
• Training for developers and DBAs

•

CONFIDENTIAL

•

8

Bringing the Advantage to Enterprises

•
•
•
•

Fast development cycles
Thousands of developers
Better code
Lower cost

Commercial
Software

EnterpriseDB

•
•
•
•
•

24/7 support
Services and training
Certification
Indemnification
Product strategy

CONFIDENTIAL

Open Source
Software

9

About PPAS

SECURITY

PostgreSQL

and
Cloud

PERFORMANCE
and
Manageability

xDB
REPLICATION

Database
MIGRATION

Toolkit

Server

CONFIDENTIAL

HIGH
AVAILABILITY
and
Scalability

10

CONFIDENTIAL

Architectural Overview

11

Process Architecture
Postmaster

Shared Memory

BGWRITER

Process Array

WAL Buffers

STATS
COLLECTOR

AUTO--VACUUM

ARCHIVER

WAL Writer

Data
Files

LOG WRITER

WAL
Segments

Archived
WAL

CONFIDENTIAL

Shared Buffers

Error Log Files

12

Database Limitations
Limit

Value

Maximum Database Size

Unlimited

Maximum Table Size

32 TB

Maximum Row Size

1.6 TB

Maximum Field Size

1 GB (4TB in v9.3 Beta)

Maximum Rows per Table

Unlimited

Maximum Columns per Table

250-1600 (Depending on
Column types)

Maximum Indexes per Table

Unlimited

CONFIDENTIAL

• Limitations are generally
defined by
• Operating System Limits
• Compile-Time Parameters
– Data Type Usage
General Database
Limitations

13

Oracle Compatibility
• Run applications written for
Oracle virtually unchanged

• Support for PL/SQL language and
OCI interoperability
• Replication for easy sharing of
data
• Dramatic Cost Savings
• No Vendor Lock-in
• Same technology which is used
by IBM in DB2 since v9.7

CONFIDENTIAL

• No need to re-train Oracle DBAs
and developers

14

Compatibility Means
• SQL Extension support
• Decode, NVL, Substr, NVL2,replace,translate, table()
• Date/time functions: add_months, extract, next_day,months_between,trunc, current_date support
• Support for cascade option in drop table
•
•
•
•
•
•
•

REF Cursors, Implicit and explicit cursors
Looping, variable declarations, conditional statements
Collections: Associative Arrays, Varrays, Nested tables
Bulk binding
Named parameters
User Defined Exceptions
Explicit Transaction Control - within a stored procedure

• Tools
• EDB*Plus – SQL*Plus look-a-like
• EDB*Loader – SQL*Loader equivalent
• EDB*Wrap – similar to the PL/SQL wrapper

CONFIDENTIAL

• PL/SQL support

15

Compatibility Means (cont.)
•
•
•
•
•
•
•
•
•
•
•

Packages
Stored procedures
Functions
Triggers
Optimizer Hints
Database Links
Hierarchical Queries
Synonyms – Public and Private
Sequences
Rownum
Object types
o
o
o
o

Create type … as object
Create type … as table
Create type …as varray
Constructor and collection methods

• PL/SQL like SUBTYPE, which inherits form base type
• Users/Roles
• Dynamic SQL

CONFIDENTIAL

• Features

16

Compatibility Means (cont.)
• Data Types
•

Integer, number, char, double precision, float, varchar2, blob, clob, xmltype, rowid, boolean

• Built-in Packages
• DBMS_:
o SQL, LOB, JOB, PIPE, ALERT, OUTPUT, UTILITY, PROFILER, RLS

• UTL_:

• Oracle-like Data Dictionary
• ALL_, DBA_, USER_ views
• Most commonly accessed views

• Diagnostics - DRITA
• System and session waits
o Not exposed in PostgreSQL
o Part of Advanced Server

• Statspack-like reporting

CONFIDENTIAL

o FILE, MAIL, SMTP, ENCODE, TCP

17

Flexible Partitioning Scheme in PostgreSQL
o
o
o
o
o
o
o
o

CREATE TABLE employees
Create Child Tables
create table emp_mgmt (check (job in (MANAGER'))) inherits (employees);
create table emp_sales (check (job in ('SALESMAN'))) inherits (employees);
Create the partitioning function
CREATE OR REPLACE FUNCTION partition_emp();
Create the trigger for partition
CREATE TRIGGER employees_partition_trigger BEFORE INSERT ON employees
FOR EACH ROW EXECUTE PROCEDURE partition_emp();

• Advantages
•
•

Flexible
Customize your Partitioning Policy

• Disadvantages
•
•

Complex
Difficult to add/delete/split Partitions

CONFIDENTIAL

• Partitioning Example in PostgreSQL

18

Compatible and Flexible Partitioning Scheme in PPAS
Partitioning Example in PPAS
CREATE TABLE employees
(empno numeric(4,0),ename varchar(10),job varchar(9),hiredate timestamp)
PARTITION BY LIST (job)
(PARTITION emp_mgmt VALUES ('MANAGER', 'PRESIDENT') tablespace tbsp_1, PARTITION
emp_sales VALUES ('SALESMAN') tablespace tbsp_2, PARTITION emp_ops VALUES ('CLERK')
tablespace tbsp_3
);

•

PPAS Offers
•
•
•
•
•

LIST and RANGE Partitioning Syntax
Easy to manage and maintain partitions
You can still take benefit of PostgreSQL syntax for complex partitioning e.g. Dynamic Partitions
Easy to Add/Delete/Split/Swap/Detach/Attach partitions
Brings the best of both the world!

CONFIDENTIAL

•

19

Database Migration Toolkit
• Online Migration Toolkit enables point and click migration from Oracle
•
•
•
•

•
•
•
•

•
•

Data
Schemas
Stored Procedures
Triggers
Functions
Sequences
Packages
Views
Database Links
Synonyms

CONFIDENTIAL

• Automatically Migrates:

20

Performance enhancement in PPAS
• Developed for High Performance Transaction
Environments (OLTP)
• DynaTune:

• Index Advisor:
• Helps determine which columns you should index
to improve performance in a given workload.

• Query Optimization Hints, Hi-Speed Bulk Loader,
Multi-Threaded Replication

CONFIDENTIAL

• Dynamic tuning of the database server to make the
optimal usage of the system resources available on
the host machine

21

• Infinite Cache
• High performance
horizontal scaling
architecture for
cache memory
• Cache expands with
inexpensive
commodity
hardware

CONFIDENTIAL

Scalability with Infinite Cache

22


Update

If not in buffer

Read
Database Server

High
Speed
Network

High
speed

InfiniteCache
RAM blades

Application

High
speed
pg_cach
e buffers
in RAM

Update
d Data
Blocks

Slow speed
disk

CONFIDENTIAL

• Architecture: How it Works
• Disk access for data is slower than RAM access
• Infinite Cache puts disk data into the RAM cache
• Additional requests for that data are read from the faster cache
• The cache scales as needed with inexpensive hardware

23

• Single Machine Performance

Advanced Server is 16X
faster on a single machine
with large amounts of
memory
(e.g. greater than 2 GB)

CONFIDENTIAL

Infinite Cache can be used
on a single machine!

24

• Expands and Distributes buffer cache across multiple machines
• Designed for Read-Mostly applications (e.g. Content Management, Query Intensive, Business Intelligence, Data
Warehouse)
• Cache is transparent to client applications (no cache coding needed)
• Compression feature enables caching entire databases (e.g. put a 250 GB database into 32 GB RAM Cache)
• Cache can be pre-warmed for immediate results
• Cache scales using inexpensive commodity hardware
• Infinite Cache can be run to boost single machine performance!

• Created For
• DBAs and data managers overseeing large amounts of data requiring fast response times for queries and
reporting loads
• Developers who don’t want to write specialized caching code

CONFIDENTIAL

• Infinite Cache - Features

25

Performance Benchmark to SQL Server
• Red Hat Reference Architecture Series:
• Comparing BenchmarkSQL Performance
on Red Hat Enterprise Linux 5 to Windows

CONFIDENTIAL

Server Enterprise (2010)

26

CONFIDENTIAL

Scalability MySQL Vs PostgreSQL

27

•
•
•
•
•
•
•
•

Object level privileges assigned to roles and users
Virtual Private Database
Kerberos and LDAP authentication
Host base authentication
SSL communication
Data Level Encryption (AES, 3DES, etc)
Ability to utilize 3rd party Key Stores in a full PKI Infrastructure
Foundation for full compliance with the strictest of security standards (PCI Data Security
Standard)
• Flexible field level encryption and row level security

“By default, PostgreSQL is probably the most
security-aware database available ...”
Database Hacker's Handbook- David Litchfield

CONFIDENTIAL

Security

28

PL/Secure and EDB*Wrap

CONFIDENTIAL

• Encrypt your Pl/pgsql stored programs with PL/Secure
• Encrypt your SPL procedures with EDB*Wrap

29

SQL/Protect
•

DBA Managed SQL Injection Protection
• Preventing attacks is normally the responsibility of the application developer, but with SQL/Protect, DBAs can
now provide another layer of protection to prevent corruption or co-opting of the database.

Multiple Prevention Techniques
•
•
•
•

Unauthorized Relations
Utility Commands (e.g. DDL)
SQL Tautology
Unbounded DML

CONFIDENTIAL

•

30

High Availability
Multi-Master Replication – Active-Active Technology
Near real-time Replication
Multi-Version Concurrency Control (MVCC)
Point-in-Time Recovery
Log Shipping for Standby (~ Oracle® Data Guard)

Availability

CONFIDENTIAL

•
•
•
•
•

31

Backup and Recovery Options
• Physical and Logical Backup
• Logical Backup using pg_dump
• Instance level logical backup using pg_dumpall

• pg_restore
• Physical Backups
• pg_basebackup

• Compressed backup
• Recovery with WAL and archived WAL
• Point in Time Recover

CONFIDENTIAL

• Table level, Schema level or DB level logical backup

32

Active – Passive OS HA Clustering
Using OS Clustering

•

Using a shared disk for data

CONFIDENTIAL

•

33

Hot Streaming Replication (Hot Standby Mode)
Uses WAL (Write Ahead Log)

•

WAL is continuously shipped through
an opened TCP channel to Hot
Standby Node

•

Hot Standby node can be used for
read scalability

CONFIDENTIAL

•

34

Log Shipping Replication (Hot Standby Mode)
Uses WAL (Write Ahead Log)

•

Archived WAL is shipped to Hot
Standby Node

•

Hot Standby node can be used for
read scalability
CONFIDENTIAL

•

35

HA with read scaling (with pg-pool)
Using pg-pool

•

Using redundant disk for data

•

Hot Standby node can be used
for read scalability
CONFIDENTIAL

•

36

xDB Single Master Replication (SMR)
Trigger based replication

•

Publication – Subscription

•

Snapshot and Continuous

•

Cascaded Replication

•

Read Scalability

•

Master/Slave DB can be:
• Oracle
• MSSQL
• Postgres Plus Advanced Server
• Either Master or Slave should be
PPAS/PostgreSQL

CONFIDENTIAL

•

37

xDB Replication Use Cases
High Availability uses
Geographic distribution of load
For creation of Testing/staging env using snapshot replication
Segregate OLTP and reporting

Replication

CONFIDENTIAL

•
•
•
•

38

xDB Single-Master Replication (SMR)

Objects

Transaction
Replication
Table
A

Table
C

Table
B

Table
D

Oracle Server

Continuous
or Scheduled
---------------Filtered
or All Rows

Queries

Reports

Table Table
C
D

Postgres Plus Advanced Server

CONFIDENTIAL

Procs

Inexpensive
Query /
Reporting

Improved
OLTP
Performance

39

xDB Multi Master Replication (MMR)
Trigger based replication

•

2 or more Masters can be Sync

•

Auto Conflict Detection & Resolution

•

Read & Write Scalability
CONFIDENTIAL

•

40

xDB MMR Architecture

CONFIDENTIAL

• Java-based Replication Server and Replication Console
• Delta changes recorded in shadow tables via post Insert/Update/Delete triggers
• Data Replication through JDBC channel

41

CONFIDENTIAL

Enterprise Class DBA Tools

42

Postgres Enterprise Manager
Remotely Manage, Monitor And Tune
• Management En-Mass Design
• Enterprise Performance Monitoring
• Graphical Administration
• SQL Workload Profiling
• Simplified Capacity Planning
• Full SQL IDE

CONFIDENTIAL

• Proactive Alert Management

43

CONFIDENTIAL

PEM Distributed Architecture

44

• Performance
Monitoring Dashboards
• Capacity Manager
• Postgres Expert
• Alert Management
• Browser based console
and dashboard
• Audit Manager
• Team Support
• Distributed Architecture
• Convenient Access

CONFIDENTIAL

PEM For DBAs: Centralized Tool

45

Stackbuilder Plus

CONFIDENTIAL

Helps you apply patches and
updates for all the
products under PPAS:

46

Replicating & Migrating Microsoft SQL Server
Replicate below objects from MS SQL Server to

•
•
•
•
•
•

Schemas
Tables
Constraints
Indexes
Table data
Views

CONFIDENTIAL

Postgres Plus Advanced Server:

47

Parallel Data Loader
Split input files into multiple files
Load single tables in parallel
Magnitudes better load time performance
Parallel load capabilities also in Migration Toolkit and Migration Studio
CONFIDENTIAL

•
•
•
•

48

InMobi Delivers Mobile Ads with Postgres
Background
•

One of the fastest growing mobile advertising networks

•

Huge scalability and performance requirements, billions of ads per month

•

Uses HP Proliant server

Postgres the best fit for a scalable open-source

Why Postgres
•

Most scalable open-source database

•

•

Lower cost than traditional databases

database
•

Community support not sufficient to meet business
requirements, EnterpriseDB a partner

•

Initial database install supported organic growth

•

•

25 instances across 4 data centers with replication
•

•

Database sizes upwards of 600 GB

•

200K txns/minute with 3 ms response time

Performance and reliability up to the task at
internet scale, supporting the most extreme
workloads
Customizations by EnterpriseDB rapidly
incorporated into the product ensuring costly
customization maintenance is avoided

CONFIDENTIAL

Mobile Ad Platform Project

49

Sony Reduces TCO of database environment by 80%
Why Postgres

• Free Realms massively multiplayer online game
• >9M registered players since April 2009

•
•

• IT Oracle scale-up was cost-prohibitive
•

Free Realms Project
•

Lower TCO and improve licensing flexibility

•

Leverage existing Oracle DBA and Developer talent

•

•

Reduced TCO by 80%
East of Migration – majority of Oracle apps
could run unmodified on Postgres Plus
Skills re-use – Oracle – trained staff could
immediately work with Postgres Plus
Exceptional technical support from
EnterpriseDB

Migrate key Oracle apps to Postgres

•

•

Commercial-grade quality and reliability, including
backup and recovery standards, to support missioncritical applications
Scalable, high performance execution

“Postgres Plus has proven to be a cost-effective
database that can accommodate Free Realms’
massive growth.”
- Andy Sites, Free Realms Senior Producer, SOE

CONFIDENTIAL

Background

50

Achieved Comparable Performance Replacing Oracle
Background
Multi-terabyte Oracle DB and needed to
reduce DB costs

•

Running old, unsupported version of
Oracle and had to pay to upgrade

Why Postgres
•

2.2 TeraByte system migrated and
now running on Postgres Plus
Advanced Server

The EPBS Project
•

Engaged EnterpriseDB consulting
services to migrate

•

Current performance is comparable
to Oracle

•

Unique migration process developed
and implemented

•

Costs reduced significantly by
migrating to EnterpriseDB solutions

CONFIDENTIAL

•

51

ToT, Thailand plans to replace Oracle Exadata-TimesTen Inmemory database with HP-EnterpriseDB stack
Background
•

Largest public sector company in telecom in Thailand

•

Has very stringent response time SLA (20ms response time for user requests ~ 3-5 read queries)

•

Current setup has Oracle Exadata and four TimeTen In-memory databases

HP-EnterpriseDB Stack Proposed to be DR for Exadata

Issues in sync of Exadata with
In-memory databases

•

•

Full refresh locks the tables

•

•

Current system can go upto 1500 tps

•

Dynamic Partitioning for huge table

•

•

•

Current system load is 750 TPS with
write operations
5000 user requests (16.5K read queries)
per second with 4 servers

•

•

•
•
•
•

HP DL-980 (4 CPU * 10 cores, 256GB RAM)
1TB VMA Disks for faster access
Simulation tests show 2800 write-TPS achieved
Flexible Partitioning scheme in PPAS (add partition on the fly for
each new date, no manual intervention)
Currently this server is being tested as DR for Exadata
Replication using xDB near-relatime replication for 1000 tps
Scalability achieved using cascaded replication and Infinite Cache
Setup can handle 5500 user requests (18K queries per second)
with 1.5-2.5ms response time per query

CONFIDENTIAL

Current Challenges in Oracle Stack

52

What’s Coming Up?
v.9.3 Beta is out

Switch master without archive logs in cascaded replication

•

Faster recovery

•

More extended JSON support

•

Materialized Views

•

Updatable Views

•

Recursive Views

•

Replication between Heterogeneous System Architectures

•

pg_xlogdump to decode WAL

•

4TB Large Object Support

•

Better memory managements

CONFIDENTIAL

•

53

How to start adoption

BACKUP / DR SERVER

NEW APPLICATION

MIGRATION

CONFIDENTIAL

REPLICATION SERVER

54

Conclusion

Economical

Technically

Easy to

Sound

Adopt

CONFIDENTIAL

You have a ‘Real’ alternative to Oracle or other conventional
proprietary Databases

55

56

CONFIDENTIAL

Ashnik EnterpriseDB PostgreSQL - A real alternative to Oracle

Recommended

More Related Content

What's hot (20)

Viewers also liked (12)

Similar to Ashnik EnterpriseDB PostgreSQL - A real alternative to Oracle (20)

More from Ashnikbiz (20)

Recently uploaded (20)

Ashnik EnterpriseDB PostgreSQL - A real alternative to Oracle