Improve the Health of Your Data
Download as PPTX, PDF•1 like•39,194 views
QuerySurge, founded in 1996, is a leading provider of data quality software that automates testing for data warehouses and big data systems, partnering with companies like IBM and Microsoft. The document highlights the significance of data quality, noting that poor data costs businesses millions annually and that organizations often analyze only a fraction of their available data. QuerySurge offers a comprehensive testing solution that improves data quality, reduces risks, and speeds up testing cycles, ultimately providing a high return on investment.
Improve the Health of Your Data
- 1. Improve the built by Bill Hayduk Founder / CEO Martin Henry-Lester Product Specialist Automate your Data Warehouse & Big Data Testing and Reap the Benefits QuerySurge™
- 2. built by QuerySurge™ About FACTS Founded: 1996 Locations: New York (HQ), Atlanta, Philadelphia, Phoenix Strategic Partners: IBM, Microsoft, HP, Oracle, Teradata, HortonWorks, Cloudera, Amazon Software: QuerySurge RTTS is the leading provider of software & data quality for critical business systems
- 3. built by QuerySurge™ Current Data Trends
- 4. Data Impact in Business Walmart handles > 1 million customer transactions every hour. Facebook handles 40 billion photos from its user base. Google processes 1 Terabyte per hour Twitter processes 85 million tweets per day eBay processes 80 Terabytes per day built by QuerySurge™
- 5. “Data warehouses are more critical than ever to business operations. Their value keeps growing because they represent a company’s crown jewels.” - Forbes built by QuerySurge™ Current Data Trends Data Warehouses Technologies: traditional vendors Oracle, IBM, Microsoft, Teradata, SAP, other
- 6. built by QuerySurge™ Current Data Trends “85% of data is coming from net-new data sources” (mobile, social media, web, etc.) - Hortonworks CEO Rob Bearden “Analysts estimate enterprise data growth of 50x y-o-y through 2020” -Hadoop Summit 2014 Solution: Big Data Technologies: Hadoop, NoSQL, In-Memory DB Large Data growth
- 7. Relational DB & Data Warehousing Source Data @ BI, Analytics & Reporting Ingestion built by QuerySurge™ Sample Use Case: New Data Architecture
- 8. built by QuerySurge™ The Bad Side of Data
- 10. Strategic Decisions based on BI (may) = competitive advantage but… Strategic Decisions based on Bad Data (will) = a loss of $millions$ “Poor data quality cost companies $8.2 million annually…25% reported that bad data was costing them more than $20 million every year…4% put the figure up to $100 million” - Gartner survey built by QuerySurge™ The Business Effect of Data “Most companies estimate they're analyzing a mere 12% of the data they have.” - Forrester Research study these companies are using BI to provide a competitive advantage…
- 11. built by QuerySurge™ The Solution Test & Monitor the Health of Your Data with Surge the Data Testing solution for Big Data
- 12. What is QuerySurge™? the collaborative Data Testing solution that finds bad data & provides a holistic view of your data’s health built by the Data Testing solution for Big Data
- 13. • Reduce your costs & risks • Improve your data quality • Accelerate your testing cycles • Share information with your team with QuerySurge™ you can: built by QuerySurge™ • Provides huge ROI (i.e. 1,300%)* *based on client’s calculation of Return on Investment
- 14. the QuerySurge advantage built by QuerySurge™ Automate the entire testing cycle Automate kickoff, tests, comparison, auto-emailed results Create Tests easily with no SQL programming Query Wizards ensure minimal time & effort to create tests Test across different platforms data warehouse, Hadoop, NoSQL, database, flat file, XML Collaborate with team Data Health dashboard, shared tests & auto-emailed reports Verify more data & do it quickly verifies up to 100% of all data up to 1,000 x faster Integrate for Continuous Delivery Integrates with most Build, ETL & QA management software
- 15. Finding Bad Data SQL HQL SQL HQL SQL SQL QS pulls data from data sources QS pulls data from target data store QS compares data quickly QS generates reports, audit trails How? Reports, Data Health Dashboard built by QuerySurge™ Source Data Target Data
- 16. QuerySurge™ Architecture Web-based… Installs on... Linux Connects to… …or any other JDBC compliant data source built by QuerySurge™ QuerySurge Controller QuerySurge Server QuerySurge Agents Flat Files
- 17. Collaboration Testers - functional testing - regression testing - result analysis Developers / DBAs - unit testing - result analysis Data Analysts - review, analyze data - verify mapping failures Operations teams - monitoring - result analysis Managers - oversight - result analysis Share information on the built by QuerySurge™
- 18. Design Library • Create Query Pairs (source & target SQLs) – Create custom SQLs QuerySurge™ Modules Scheduling Build groups of Query Pairs Schedule Test Runs ‒ Run now ‒ Run every Friday at 11pm ‒ Automatically run from ETL tool, automated build software, test Management software built by QuerySurge™
- 19. Deep-Dive Reporting Examine and automatically email test results Run Dashboard View real-time execution Analyze real-time results QuerySurge™ Modules built by QuerySurge™
- 21. built by QuerySurge™ • view data reliability & pass rate • add, move, filter, zoom-in on any data widget & underlying data • verify build success or failure
- 22. built by QuerySurge™ individual Data Widgets add, drop, move, filter, print, zoom- in, zoom-out on any widget & underlying data
- 23. built by QuerySurge™ Smith, Steve more Data Widgets add, drop, move, filter, zoom-in, zoom-out on any widget & underlying data
- 24. Try QuerySurge for free! (1) a Trial in the Cloud of QuerySurge, including self-learning tutorial that works with sample data for 3 days or (2) a downloaded Trial of QuerySurge, including self-learning tutorial with sample data or your data for 15 days or (3) a Proof of Concept of QuerySurge, including a kickoff & setup meeting and weekly meetings with our team of experts for 30 days http://www.querysurge.com/compare-trial-optionsfor more information, Go here QuerySurge built by QuerySurge™ TRIAL IN THE CLOUD the Data Testing solution
- 25. © 2015 Real-Time Technology Solutions, Inc. 25 To see the video of this Webinar please visit: http://www.querysurge.com/solutions/data-warehouse-testing/improve-data-health Improve the QuerySurge built by QuerySurge™ the Data Testing solution
Editor's Notes
- #13: QuerySurge provides insight into the health of your data throughout your organization through BI dashboards and reporting at your fingertips. It is a collaborative tool that allows for distributed use of the tool throughout your organization and provides for a sharable, holistic view of your data’s health and your organization’s level of maturity of your data management.
- #14: QuerySurge helps your team coordinate your data quality initiatives while speeding up your development and testing cycles and finding your bad data. Why risk having your team identify trends and develop strategic initiatives when the underlying data is incorrect? QuerySurge reduces this risk.
- #16: QuerySurge finds bad data by natively connecting to: any data source, whether it is any type of database, flat file or xml and can connect to any data target, whether it is a db, file, xml, data warehouse or hadoop implementation. QuerySurge pulls data from the source and the target and compares them very quickly (typically in a few minutes) and then produces reports that show every data difference, even if there are millions of rows and hundreds of columns in the test. These reports can be automatically emailed to your team. You can pick from a multitude of reports or export the results so that you can build your own reports.
- #17: Your distributed team from around the world can use any of these web browsers: Internet Explorer, Chrome, Firefox and Safari. Installs on operating systems: Windows & Linux. QS connects to any JDBC-compliant data source. Even if it is not listed here.
- #18: QuerySurge can utilized by active practitioners such as testers & developers to create and launch tests, or by managers, analysts and operations to view data test results and the overall health of the data. QuerySurge facilitates this by providing 2 types of licenses: (1) full user & (2) participant user. (1) Full User – This type of user has unlimited access to create QueryPairs, Suites, and Scenarios. This user can also schedule and run tests, see results, run and export reports, and export data. Perfect for anyone creating and/or running data tests while performing analysis of results. (2) Participant User – This user cannot create or run tests, but has access to all other information - including viewing all query pairs, results, and reports, receiving email notifications, and exporting test results and reports. Perfect for managers, analysts, architects, DBAs, developers, and operations users who need to know the health of their data.