Loading Data into Azure SQL DW (Synapse Analytics)
1 like570 views
This document provides an overview of loading data into Azure SQL DW (Synapse Analytics). It discusses extracting source data into text files, landing the data into Azure Data Lake Store Gen2, preparing the data for loading into staging tables using PolyBase or COPY commands, transforming the data, and inserting it into production tables. It also compares ETL vs ELT approaches and SSIS vs Azure Data Factory for data integration. The presenter then demonstrates loading data in Synapse SQL pool and invites any questions.
Loading Data into Azure SQL DW (Synapse Analytics)
- 2. Loading Data into Azure SQL DW (Synapse Analytics) Global Azure Greece 2020 Apr 25, 2020 Presenter: Antonios Chatzipavlis
- 5. Antonios Chatzipavlis Data Solutions Consultant & Trainer Since 1999 30+Years in a Field 20+ Experience with 60+ Certifications SQLschool.gr Founder
- 6. A community for Greek professionals who use the Microsoft Data Platform Connect / Explore / Learn @antoniosch - @sqlschool ./sqlschoolgr - ./groups/sqlschool ./c/SqlschoolGr SQLschool.gr Group [email protected] Join us Articles SQL Saturday Nights SQL Server in Greek Webcasts News Resources
- 7. Connect / Explore / Learn V.102010-2020
- 9. Azure Synapse Analytics Limitless analytics service with unmatched time to insight Platform Azure Data Lake Storage Common Data Model Enterprise Security Optimized for Analytics METASTORE SECURITY MANAGEMENT MONITORING DATA INTEGRATION Analytics Runtimes PROVISIONED ON-DEMAND Form Factors SQL Languages Python .NET Java Scala R Experience Synapse Analytics Studio Artificial Intelligence / Machine Learning / Internet of Things Intelligent Apps / Business Intelligence METASTORE SECURITY MANAGEMENT MONITORING
- 10. Synapse SQL pool
- 11. • Extract the source data into text files. • Land the data into Azure Data Lake Store Gen2. • Prepare the data for loading. • Load the data into staging tables with PolyBase or the COPY command. • Transform the data. • Insert the data into production tables. Data loading strategy for Synapse SQL pool The fastest and most scalable way to load data
- 12. ETL vs. ELT ETL ELT
- 13. SSIS vs. ADF SSIS ADF
- 14. Demonstration Loading data in Synapse SQL pool
- 15. Any questions
- 16. Thank you! @antoniosch - @sqlschool ./sqlschoolgr - ./groups/sqlschool ./c/SqlschoolGr SQLschool.gr Group Antonios Chatzipavlis Data Solutions Consultant & Trainer
- 17. A community for Greek professionals who use the Microsoft Data Platform Copyright © SQLschool.gr. All right reserved. PRESENTER MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION