Azure Data platform

Azure Data Overview
Mostafa Elzoghbi
Sr. Technical Evangelist @ Microsoft
@MostafaElzoghbi

Agenda
 SQL Database
 SQL Server VM
 DocumentDB
 Search
 HDInsight
 Additional Databases

SQL Database Server
The Service head contains databases
Connect via automatically generated
FQDN: {name}.database.windows.net
Initially contains only a master
database

IP Based Firewall Rules
Server Connectivity

Limit Exposure of Sensitive Data
Protect Sensitive Data
 Limits sensitive data exposure
 Prevents unauthorized access to data
 Policy-based security – no changes to
data or application
 Meet regulatory compliance
 Dev/Test production data without
compromising data
Dynamic Data Masking

Encrypt and Protect Database
 Encrypted database, backups, and
transaction log at rest
 2-click provisioning
 Reduced attack surface area
 No code changes to existing applications
 Database encryption key - AES-256
 Accelerated hardware encryption
Transparent Data Encryption (TDE)

Fine-grained Access Over Rows
 Fine-grained access over rows
 Access restrictions logic contained in
database
 Simplified design and coding of security
 Reduced surface area of your security
system
 Available on SQL Server 2016.
Row-Level Security (RLS)

Fine-grained Access Over Rows
 Contained Database Users
 Parallel Queries
 Common Language Runtime (CLR)
assemblies
Other notable features

Provision Servers Interactively
In the Preview Management Portal create a SQL Database server

http://bit.ly/azurepowershell
Automate Server Provisioning
Microsoft Azure Platform PowerShell cmdlets

http://bit.ly/azurexplatcli
Automate Server Provisioning
Azure Cross-Platform Command-Line Interface (xplat-cli)

Demo: Creating A SQL
Database Server
and a SQL Database

Service
Tier
Performance
Level
Common App
Pattern
Performance Business Continuity
Max DB
Size
Transaction
Perf. Objective
DTU PITR DR / GEO-Rep
Basic Basic Small DB, SQL opp 2 GB Reliability / Hr. 5 7 Days DB Copy +
Manual Export
Standard S0
S1
S2
Wrkgp/cloud app,
multiple concurrent
operations
250 GB Reliability / Min. 10
20
50
14
Days
DB Copy +
Manual Export
Premium P1
P2
P3
Mission Critical, High
volume, Many
concurrent Users
500 GB Reliability / sec. 100
200
800
35
Days
Active Geo-
replication
Selecting the right SQL Database edition
This information is subject to change over time.

 Auto backups, transactional logs every 5 min
 Backups in Azure Storage and geo-replicated
 Creates a side-by-side copy, non-disruptive
 Backups retention policy: 7, 14 or 35 days
 Automated export of logical backups for long-term
backup protection
Point-in-time restore - “oops recovery”

 Available in all tiers: Basic, Standard and Premium
 Built on geo-redundant Azure Storage
 Recover to any Azure region
Geo-restore – Emergency data recovery when you need it most

 Opt-in for Standard & Premium databases
 Creates a stand-by secondary
 Replicate to pre-paired Azure region
 Automatic data replication, asynchronous
 Opt-in via REST API, PowerShell or Azure Portal
 Microsoft-managed, RTO<24h, RPO<1 hr
Standard geo-replication

 Self-service activation in Premium
 Create up to 4 readable secondaries
 Replicate to any Azure region
 Automatic data replication, asynchronous
 REST API, PowerShell or Azure Portal
 RTO<1h, RPO<5m, you choose when to failover
Active geo-replication

 Configurable to track & log database activity
 Dashboard views in the portal for at-a-glance insights
 Pre-defined Power View reports for deep visual
analysis on Audit log data
 Audit logs reside in your Azure Storage account
 Available in Basic, Standard, and Premium
Auditing

 Fast and flexible indexing of textual data
 Data types: char, varchar, nchar, nvarchar, text, ntext,
image, xml, varbinary(max), or FILESTREAM
 Handles high query volume
 Common use cases:
 Searching websites, product catalogs, news items and more
 Document management systems
 Any applications that need to provide search capabilities over data stored in a SQL
Database
Full-Text Search

 XML Indexes - improves XQuery-based query
performance
 Primary XML Index - speed up access to elements and
attributes
 CREATE PRIMARY XML INDEX XML_Order_Items
 ON Sales.Order (Items);
 Secondary XML Index – help resolve specific XQuery
expressions rapidly
XML Indexes

Demo: Connect from on
premise using SSMS

(obviously)
Use Familiar Technologies
Transact-SQL

.NET Framework (C#, Visual Basic, F#): ADO.NET
C / C++: ODBC
Java: Microsoft JDBC provider
PHP: Microsoft PHP provider
Use Familiar Technologies - Languages
.NET Framework (C#, Visual Basic, F#): ADO.NET
C / C++: ODBC
Java: Microsoft JDBC provider
PHP: Microsoft PHP provider

Use Familiar Technologies - Frameworks
OData
Entity Framework
WCF Data Services
NHibernate (etc.)

Use Familiar Technologies - Tools
SQL Server Management Studio (>=2008 R2)
SQL Server command-line utilities (SQLCMD, BCP)
Visual Studio IDE for database development

Unsupported
SQL Server
Features
 Use command, distributed
transactions, distributed views
 Service Broker
 SQL Agent
 SQL Profiler
 Native Encryption

Web designers for tables, views, stored procs
Interactive query editing and execution
Azure SQL Database Management Portal

Demo: Deployment Scenarios
From SQL Server Management
Studio

Elastic Database Pool
Predictable model for deploying large numbers of databases

Elastic Database Model PREVIEW
 Elastic databases, Elastic database pools
 Pooled resources leveraged by many databases
 Standard elastic pool provides 200-1200* eDTUs for up to 100* databases
 Elastic Standard databases can burst up to 100 eDTUs (S3 level)
 Create/configure pool via portal, PowerShell, REST APIs
 Move databases in/out using portal, PowerShell, REST APIs, T-SQL
 Databases remain online throughout
 Monitoring and alerting is available on both pool and databases
*Additional pricing tiers may be introduced, and the ranges and limits may be increased during the preview
Max per-database burst level

Scalability options in Azure SQL DB
Vertical: Scale-up or scale-down
Horizontal: Scale-out or scale-in
Basic
Standard
Premium
Basic Basic Basic Basic Basic Basic
Premium
Standard
Scale out/in
Scaleup/down

Run SQL on VM
 Run any SQL product on cloud VM
 Support for SQL Server, Oracle, MySql
 Ready to go VM images available in Gallery
 Persistent storage using attached disk in blob storage
 Has all the benefits and powers of VMs combined with
the full features of a SQL Engine

Why (at least) two offerings of SQL in Azure?

Other features SQL IaaS supports that SQL Database
doesn’t (yet)
 Full SQL Server functionality (e.g. Reporting Services)
 Windows authentication available (requires VM to be
joined to on-premises domain)
 Larger database sizes possible (16TB)

Demo: Standing up a SQL
Server in Azure using
Marketplace

Fully managed, scalable JSON
document database service

Microsoft Azure Data Services
fully managed, scalable, queryable, schemafree JSON
document database service for modern applications
transactional processing
rich query
managed as a service
elastic scale
internet accessible http/rest
schema-free data model
arbitrary data formats

Demo: Working with
DocumentDB on Azure

Azure Search
Embed a sophisticated search experience into web
and mobile applications without having to worry
about the complexities of full-text search and
without having to deploy, maintain or manage any
infrastructure.

Azure Search
Perfect for enterprise cloud developers,
cloud software vendors, cloud architects
who need a fully-managed search
solution.

Search
Functionality
 Simple HTTP/JSON API for creating
indexes, pushing documents, searching
 Keyword search with user-friendly
operators (+, -, *, “”, etc.)
 Hit highlighting
 Faceting (histograms over ranges,
typically used in catalog browsing)

Search
Functionality
 Suggestions (auto-complete)
 Rich structured queries (filter, select,
sort) that combines with search
 Scoring profiles to model search result
relevance
 Geo-spatial support integrated in
filtering, sorting and ranking

Data size
Access
Updates
Structure
Integrity
Scaling
Relational DB vs. Hadoop

Programming
HDInsight –
Microsoft .NET
C#
F#
Map/Reduce
Microsoft .NET management clients

Programming
HDInsight –
DevOps / IT
Pros
PowerShell
Cross-Platform CLI tools (xplat-cli)

App Service Azure SQL Database
Azure Machine Learning
Intelligent App
Hadoop
Azure SQL Data
Warehouse
Power BI
A relational data warehouse-as-a-service

Scales to petabytes of data
Massively Parallel Processing
Instant-on compute scales in
seconds
Query Relational / Non-
Relational
Get started in minutes
Integrated with Azure ML,
PowerBI & ADF
Enterprise Ready
Simple billing compute &
storage
Pay for what you need, when
you need it with dynamic
pause
Bring DW to the Cloud
without rewriting

Azure Data Lake service
 Store and manage infinite data
 Keep data in its original form
 High through put, low latency analytic
jobs
 Enterprise-grade security + access
control
Data Lake

Data Lake service
Transformative way to store and process infinite data
Other analytic
solutions SQL Data
Warehouse

MongoDB, MySQL, Oracle,
Cassandra, Neo4j and more

Additional Database options in Azure
 Azure Table Service is a “Big Table” entity store.
 MongoDB is a document (JSON) store.
 Cassandra is a columnar store with excellent
replication.
 HBase is a Big Data (Hadoop) store available in
HDInsight.
 Oracle VMs are supported in Azure.
 MySQL is offered from the partner ClearDB.

SQL Database SQL on IaaS DocumentDB
Search HDInsight
MongoDB, MySQL,
Oracle, Cassandra,
Neo4j and more
Microsoft Azure Data Platform

 Post your questions to:
 Stack Overflow Forums
 MSDN Forums
 Twitter: @MostafaElzoghbi

Get started
Visit azure.microsoft.com

Azure Data platform

Recommended

More Related Content

What's hot (20)

Similar to Azure Data platform (20)

More from Mostafa (20)

Recently uploaded (20)

Azure Data platform

Editor's Notes