Deliver Your Modern Data Warehouse (Microsoft Tech Summit Oslo 2018)
2 likesâ˘1,175 views
The document outlines the components and workflows of a modern data warehouse, incorporating Azure services such as Azure Data Factory, Azure Blob Storage, and Azure Databricks for data ingestion, storage, preparation, and analysis. It emphasizes the scalability and performance benefits of Azure solutions and highlights the use of Power BI for analytics and reporting. The integration of these technologies allows for efficient processing of diverse data at any scale to derive intelligent insights.
Deliver Your Modern Data Warehouse (Microsoft Tech Summit Oslo 2018)
- 1. Deliver Your Modern Data Warehouse Cathrine Wilhelmsen, Inmeta @cathrinew | cathrinew.net
- 3. All Data Any Scale Intelligent Insights
- 5. Ingest Azure Data Factory Store Azure Blob Storage Prep & Train Azure Databricks Model & Serve Azure SQL Data Warehouse Azure Analysis Services Analyze Power BI ADF Blob Databric ks DW AS PBI
- 7. Azure Data Factory Hybrid data integration pipelines Scalable ETL/ELT workflows SSIS lift and shift ADF
- 8. Azure Data Factory ADF
- 9. Azure Data Factory: Data Flows Data transformation at scale Runs on Azure Databricks Visual editor, no-code experience ADF
- 10. Azure Data Factory: Data Flows ADF
- 12. Azure Blob Storage Massively scalable object storage Any type of unstructured data Premium, Hot, Cool, Archive Blob
- 13. Azure Data Lake Storage Gen2 Scale / cost benefits of Azure Blob Storage Reliability / performance benefits of Hadoop File System Optimized for Analytics & AI Blob
- 14. Prep & Train: Azure Databricks Databricks
- 15. Azure Databricks Spark-based analytics platform Collaborative notebook experience From data preparation to machine learning Databric ks
- 17. DW Model & Serve: Azure SQL Data Warehouse
- 18. Azure SQL Data Warehouse Fully managed enterprise cloud data warehouse Scale compute and storage separately Pause and resume when needed DW
- 19. Azure SQL Data Warehouse DW
- 20. AS Model & Serve: Azure Analysis Services
- 21. Azure Analysis Services Enterprise-grade "Analytics as a Service" Fully managed and highly scalable Pause and resume when needed AS
- 23. Power BI Interactive, real-time dashboards and reports Visually explore and analyze data From data to insight to action PBI
- 24. Power BI PBI
- 25. Ingest Azure Data Factory Store Azure Blob Storage Prep & Train Azure Databricks Model & Serve Azure SQL Data Warehouse Azure Analysis Services Analyze Power BI ADF Blob Databric ks DW AS PBI
- 26. ADF Blob Databricks DW AS PBI