Ad
More Related Content
What's hot (20)
Similar to NOVA SQL User Group - Azure Synapse Analytics Overview - May 2020 (20)
Ad
More from Timothy McAliley (7)
Ad
Recently uploaded (20)
NOVA SQL User Group - Azure Synapse Analytics Overview - May 2020
- 1. Jim Boriotti CSA – Data & AI [email protected] Azure Synapse Analytics Overview & Demo
- 2. Agenda
- 3. The Modern Data Warehouse
- 6. Azure Synapse Analytics Integrated data platform for BI, AI and continuous intelligence Platform Azure Data Lake Storage Common Data Model Enterprise Security Optimized for Analytics DATA INTEGRATION Analytics Runtimes PROVISIONED ON-DEMAND Form Factors SQL Languages Python .NET Java Scala R Experience Azure Synapse Studio Artificial Intelligence / Machine Learning / Internet of Things Intelligent Apps / Business Intelligence METASTORE SECURITY MANAGEMENT MONITORING
- 7. Synapse SQL Synapse Spark Synapse Pipelines Synapse Studio Azure Synapse Analytics Query and analyze data with T-SQL using both provisioned and serverless models Quickly create notebooks with your choice of Python, Scala, SparkSQL, and .NET for Spark Build end-to-end data-driven workflows for your data movement and data processing scenario Execute all data tasks with a simple UI and unified environment
- 8. Synapse Analytics – Timeline • Today - Azure SQL DW “Azure Synapse” SQL Pools SQL Provisioned • Materialized Views, Result Set Caching, Ordered CCI’s • Next Week – Azure Synapse Analytics (Public Preview) • Azure Synapse Studio – single console • ADF integration – migration considerations • Serverless on-demand query • Big data processing • Embedded Apache Spark with Notebooks • Hybrid data integration: CSV, RCFile, ORC, Parquet • Workspaces – security & mgmt. boundary • End of Summer - SQL Gen 3 • Engine updates – Merge, Update delete with join, multi-column dist, updatable dists… • Multi-cluster support, Online scaling, Cross DB Support, Time Travel Only pay for the capabilities you use!
- 9. Demo
- 10. Q & A ? Jim Boriotti – Data & AI Cloud Solution Architect [email protected] Link to me at: www.linkedin.com/in/JimBoriotti
- 11. Azure Synapse Analytics Build announcements GA • Workload Isolation • COPY Data Loading • Updatable Hash Key • Materialized View Improvement Public Preview • PREDICT Scoring • Bulk Load & External Table Wizards • Serverless Query Perf Enhancements • Pay-per-query consumption model • CSV Schema Inference Private Preview • SQL MERGE support, ANSI Joins • Column Encryption • Multi-Column Hash Distribution Public Preview • DeltaLake Tables v0.6 • CDM Support • .NET for Apache Spark 0.11 • Built-in Samples • Templated Code Gen for Notebooks • Statistical Sample Visualization of Data • Spark Job Graph Debugging Public Preview • CosmosDB with Synapse Link • Managed Virtual Networks & Private Endpoints • Improved Notebook Usability • More Granular Workspace RBAC • Getting Started • SQL & Spark Pool Monitoring and Management Public Preview • Trusted Service for Azure Storage and Azure Key Vault • Managed Identity for Mapping Data Flows • Static IP ranges Azure Integration Runtime • Checkpoint and resume for binary file copy Private Preview • Data Flow CDM Support Query and analyze data with T-SQL using both provisioned and serverless models Quickly create notebooks with your choice of Python, Scala, SparkSQL, and .NET for Spark Build end-to-end data-driven workflows for your data movement and data processing scenarios Execute all data tasks with a simple UI and unified workspace environment Synapse SQL Synapse Spark Synapse Pipelines Synapse Studio
- 12. Performance, Performance, Performance • Intelligent data warehouse • Heterogeneous data loading • Azure Synapse Analytics the next version Advanced workload management • • • • Premium Databricks integration • • Smart & auto system tuning • • • Execution models to fit the need • Confidential material – covered by Microsoft NDA
- 13. APACHE SPARKSQL ANALYTICS STUDIO DATA INTEGRATION Synapse Analytics (PREVIEW) Synapse Analytics (GA) (formerly SQL DW) Synapse Analytics (GA) NOV 2019 New GA features • Resultset caching • Materialized Views • Ordered Columnstore • JSON support • Dynamic Data Masking • SSDT support • Read committed snapshot isolation Preview features • Workload Isolation • Simple ingestion with COPY • Share DW data with Azure Data Share • Private LINK support Private preview features • Streaming ingestion & analytics in DW • Native Prediction/Scoring • Fast query over Parquet files • FROM clause with joins NOV 2019 Preview features • Synapse Studio • Collaborative workspaces • Distributed T-SQL Query service • SQL Script editor • Unified security model • Notebooks • Apache Spark • Code-free data flows • Orchestration Pipelines • Data movement