Smart data hub
0 likes676 views
This document provides an overview of the smart data hub service catalogue, which includes offerings around data subscription, data hub, data collection, data analysis, and data consulting. The data subscription service involves regularly scheduled custom data provision for a monthly fee. The data hub is a collaborative platform for sharing, managing, and analyzing data from various sources. Data collection involves scraping and parsing data at scale from external or internal resources. Data analysis includes machine learning, visualization, and interpreting results. Data consulting consists of sessions to help businesses understand best practices for data management and analysis.
Smart data hub
- 1. Smart Data Hub Overviewof service catalogue offer Ali Belcaid© AB Advisory& Consulting 2014 Smart Data Hub
- 2. Data Subscription What: Regular scheduled custom data provision for a monthly fee with a setup charge. This might include pricing data, lead generation data, research data. Monitoring services for social media and websites. Market data collection. How : Scraping/parsingdata, Vertical searchand workflow setup for Data flow Solutions : Nutch, Scrapy, Solr, Elasticsearch… + Hadoop/Hbase/Mongodb/MySQL… for storage
- 3. Data Hub What: A collaborative platform for sharing, managing and analyzing your data. This might be a standalone product where you carry out provision and analysis data yourselves, or a joint endeavor where we source and analyze data with you. How : Single repository to manage data (external & internal) Solution : CKAN open source data repository.
- 4. Data Collection What: Data collection at scale through scraping external or internal resources with transformation to formats for reuse. How : Scraping/parsingdata and storageon targetedformat Solution : Nutch, Scrapy, Solr, Elasticsearch… + Hadoop/Hbase/Mongodb/MySQL… for storage
- 5. Data Analysis What: Analysis, visualization and interpretation of data, either acquired through scraping or ingested via more conventional means. How : Machine learning, NLP, custom models, statistics, algorithms, visualization, stories telling… Solution : Knime, R, python, SQL, Hive, Pig, Spark, BI software (BO, Tableau, Qlikview), Visual JS libraries(D3.js…)
- 6. Data Consulting What: sessions to help businesses understand methods in data collection, analysis and management. How : Consulting services @ customer site or online Solution : Methodologies and best practices on how to gather, transform, analyze, visualize data and interpret results and findings.