Anzo Smart Data Integration
Download as PPTX, PDF0 likes1,367 views
The document describes Anzo Smart Data Integration (ASDI), a semantic data integration product from Cambridge Semantics. ASDI uses common conceptual models to map disparate source systems to targets, which increases the speed and decreases the cost of data integration projects by 10 times or more. It provides capabilities like automatically generating ETL jobs from mappings to conceptual models, exploring data lineage, and creating data marts and extracts on demand. The architecture involves a Smart Data Integrator web application, mapping registry, Anzo semantic EDM server, and ETL engine.
![Ensuring compliance of patient data with big data and bi [bdii 301-m] - (4078)](https://cdn.slidesharecdn.com/ss_thumbnails/ensuringcomplianceofpatientdatawithbigdataandbibdii-301-m-4078-130430231240-phpapp01-thumbnail.jpg?width=560&fit=bounds)
Ad
More Related Content
What's hot (18)
Viewers also liked (20)
Ad
Similar to Anzo Smart Data Integration (20)
Ad
Recently uploaded (20)
Anzo Smart Data Integration
- 1. Anzo Smart Data Integration ©2014 Cambridge Semantics Inc. All rights reserved. Company Confidential. Cambridge Semantics Contact: Marty Loughlin Vice President, Financial Services Cambridge Semantics 141 Tremont St., 6th Floor, Boston, MA www.cambridgesemantics.com [email protected] (o) 617.855.9565
- 2. Anzo Smart Data Integration Overview Anzo Smart Data Integration uses common, conceptual models with existing ETL tools to increase the speed and decrease the cost of completing high-quality, governed data integration projects by 10 times or more. ©2014 Cambridge Semantics Inc. All rights reserved. Company Confidential Page 2
- 3. The Data Integration Challenge Customer 360 Enterprise Warehouse Business Data Marts Compliance and Regulatory Reporting Source Systems Business Analyst Developers QA & Ops Each ETL Project: • Manually coded • Requires source & target SMEs • Many hand-offs ©2014 Cambridge Semantics Inc. All rights reserved. Company Confidential Page 3 Lead (SFA system) Quote (Quote system) Order (OMS system) Contract (CMS system) Target Systems S x T ETL Jobs Each Job Define Mapping Requirements Code ETL Job Test & Deploy
- 4. The Common Model is “Data Glue” ©2014 Cambridge Semantics Inc. All rights reserved. Company Confidential Page 4 Lead (SFA system) Quote (Quote system) Order (OMS system) Contract (CMS system) Common Model (“Data Glue”) Source Systems • Many common concepts across disparate systems • Semantic data science connects these common concepts • Data is “glued” together by its underlying business meaning • Potential to use industry standard models, e.g., FIBO, CDISC, HL7 Business Analysts and IT can use conceptual models to: • Create data services • Understand the data landscape • Track data lineage • Conduct downstream analytics
- 5. Anzo Smart Data Integration Compliance and Regulatory Reporting Common Model (“Data Glue”) Business Analyst Anzo SDI ©2014 Cambridge Semantics Inc. All rights reserved. Company Confidential Page 5 Each ETL Job: • Generated from map • Only source SME required • Hours, not months Customer 360 Enterprise Warehouse Business Data Marts Source Systems Lead (SFA system) Quote (Quote system) Order (OMS system) Contract (CMS system) Target Systems Each Job Map Source to Conceptual Model S + T Maps Automatically Generate ETL
- 6. Anzo Smart Data Integration Capabilities ©2014 Cambridge Semantics Inc. All rights reserved. Company Confidential Page 6 Map to/from conceptual models Combine maps & automatically generate ETL jobs Create data marts and extracts on-demand Explore data provenance
- 7. Anzo Smart Data Integration Components Model Manager Data Connections Schema Manager Project Manager Mapping Manager Provenance Explorer ©2014 Cambridge Semantics Inc. All rights reserved. Company Confidential Page 7
- 8. Anzo Smart Data Integration Demo MySQL Source System ©2014 Cambridge Semantics Inc. All rights reserved. Company Confidential Page 8 Holdings Table Conceptual Target System Asset Model • Map Holdings database to Conceptual Asset Model • Map Conceptual Asset Model to MySQL target database • Publish and run Pentaho job • Demonstrate Lineage Scenario
- 9. Appendix ©2014 Cambridge Semantics Inc. All rights reserved. Company Confidential Page 9
- 10. Enterprise Middleware Applications Data Fabric Anzo Server Reasoning & Rules Workflow Semantic Services Anzo Connect Enterprise Directory Connect Anzo Unstructured Data Marts & Warehouses Enterprise Applications Directory (LDAP, AD) ……… 3rd Party Databases & Applications Anzo Architecture & Capabilities External Sources • User self-serve • Interactive • Conceptual model • Search, filter, BI analytics, forms, alerts,… • Cache or virtualize data based on W3C semantic standards • Based on real-time event based architecture • Embedded graph database • Two-way integration to existing systems • Anzo Unstructured pipeline allows easy plug-in of 3rd Party NLP and crawlers
- 11. Anzo Smart Data Integration Architecture Smart Data Integrator (web application) …includes: • Project manager • Schema manager • Model manager • Data feed manager • Governance dashboards Data Mapper (Excel-based) Mapping Registry ©2014 Cambridge Semantics Inc. All rights reserved. Company Confidential Page 11 Conceptual Model Editor Anzo Smart EDM Server ETL Compiler Conceptual Model Registry Schema & Sample Data Registry Data Source Registry Data Feeds Catalog Services: • Sample data service • Data feed persistence service • Revision & audit service • Access control service ETL Engine • SQL • CSV/TSV • XML • Proprietary • SQL • CSV/TSV • XML • Proprietary
- 12. ASDI User Roles •Defines projects and mappings •Configures data sources & schemas •Publishes projects to ETL tools •Populates Data Catalog with Data Feeds ©2014 Cambridge Semantics Inc. All rights reserved. Company Confidential Page 12 Full User Data Consumer •Search and browse Data Catalog •Creates on-demand data marts and extracts from Data Catalog Governance User •Manage models •Browse and search projects •Browse and search data lineage Administrator •Configures users and roles •Configures dashboards and templates
- 13. ASDI Use Case: Creating a Data Lake Common Conceptual Model Data Lake Self-service Analytics Self-service Data Extracts & Marts ©2014 Cambridge Semantics Inc. All rights reserved. Company Confidential Page 13 Sources Anzo Smart Data Integration Anzo provides a platform –wide common conceptual model Anzo enables end-user self-service using models ASDI streamlines and automates data ingestion
Editor's Notes
- #12: @@ ETL engine logos?