How big data is transforming BI
0 likes2,427 views
This document discusses how big data is transforming business intelligence. It outlines some of the pains of traditional BI, including maintaining large data warehouses and only considering structured data. The document advocates for an open source approach using Hadoop as an "extended data warehouse" to address these issues. Examples of recent Solocal Group projects involving real-time business analytics and a search power selector are provided. Advice is given on how companies can activate big data projects and start the BI transformation.
How big data is transforming BI
- 1. FROM BI TO BIG DATA ABED AJRAOU JUNE 5TH 2015 1 How Big Data is transforming Business Intelligence
- 2. WHAT DO YOU ABOUT SOLOCAL GROUP?
- 3. WHAT DO YOU ABOUT FRENCH YELLOW PAGES ?
- 4. 4 AND WHAT ABOUT ME? Still at school, I am Business Intelligence Professor at “Paris Sud” University With over 15 years experience in Business Intelligence Practice, I am the head of Business Intelligence in Solocal group. Sharing knowledge : I am VP Education at DAMA France and author in the media www.decideo.fr.
- 5. THE AIM OF THE BUSINESS INTELLIGENCE 5 Business Intelligence is an complete environment which should create intelligence with the data. Actually, Business Intelligence have to give the right data, to the right person, with the right tool at the right time. Business Intelligence is NOT a tool, is NOT a report, is NOT a database …
- 6. BUSINESS INTELLIGENCE FRAMEWORK 6 Data Sources Business Scope CRM Finance Supply Chain Sales HR Operations Logistics Business Alignement Change Management General Fees Others Business Plan Performance Management Others Strategies Operationnal Alignement Skills Management Progress Strategy Supply Chain FinanceSalesStock Files HR CRM Data Architecture Datamart Cubes Data Transformation ETL/ELT EAI EII Staging Area DWH Data Quality Cleaning Enrichment Detection and Analysis Meta Data Master Data Data Access & Final User Data Access Definition Data Mining Dashboard Weh Access Standard Rapports OLAP Analyses Extractions Search & Navigation Alertes et Notifications Users ServicesUsers Training Help Desk Requirements Management Animation Foundations Methodology Rules & Principals Competency Management Technical Training Technology Watch Others Fonctional Meta Datal Technical Meta Data Repository Access/Roles Compatibility Rules Workflow Business Repository Profiling
- 7. THE PAINS OF THE BUSINESS INTELLIGENCE 7 So what are the pains of the Business Intelligence? Mostly come from the Digital Transformation & Big Data paradigm: We aware that a DataWarehouse with more that 50 Tb is very complicated to maintain We never consider unstructured data, which come from every where (logs, blogs, social network …) The batch treatment is not anymore compatible with business need => we are now educate to have the data quick and in real time
- 8. BUSINESS INTELLIGENCE FRAMEWORK 8 Data Sources Business Scope CRM Finance Supply Chain Sales HR Operations Logistics Business Alignement Change Management General Fees Others Business Plan Performance Management Others Strategies Operationnal Alignement Skills Management Progress Strategy Supply Chain FinanceSalesStock Files HR CRM Data Architecture Datamart Cubes Data Transformation ETL/ELT EAI EII Staging Area DWH Data Quality Cleaning Enrichment Detection and Analysis Meta Data Master Data Data Access & Final User Data Access Definition Data Mining Dashboard Weh Access Standard Rapports OLAP Analyses Extractions Search & Navigation Alertes et Notifications Users ServicesUsers Training Help Desk Requirements Management Animation Foundations Methodology Rules & Principals Competency Management Technical Training Technology Watch Others Fonctional Meta Datal Technical Meta Data Repository Access/Roles Compatibility Rules Workflow Business Repository Profiling
- 9. FROM TRADITIONAL BI TO BIG DATA ARCHITECTURE Traditional BI Enterprise Structured Data ETL Data Transformation ERP FilesCRM SCM Data MartsCubes OLAP Databases Departmental BI In Memory Dashboar ding Predictive analytics Data Warehouse Mobility Data Association Data Visualisation Unstructured Data Exploitation and analysis of all Information Image, VidéoIntranet / Content Management MPP/ Data Integretion Real Time Analytics Column oriented Index Text Agent Mining Text Analytics Native Search Social Network MATURITY LEVEL OF ENTERPRISE DATA ARCHITECTURE 9
- 10. 10 OUR CONVICTION: OPENSOURCE WOULD SOLVE MOST OF BI PAINS The Enterprise Data Hub of Cloudera would be the « Extended DataWarehouse » The NoSql « Column Database » is the simple way to give access to the end user and ensure good performance The end of the Batch, and the welcome of the Streaming and real time data Performance ETL for the data transformation on top of Hadoop New Data Visualization / Data Story Telling, which is very quick to install/deploy, and simple to use
- 11. Functionnal Data Mart / Data Sets 11 Open Data Group (Operational Data) Enterprise Structure Data Web site logs Stock FinanceMobile logs Unstructured Data Image, VidéoIntranet / Content Management Social NetworkRH Supply Chaine CRM Data Visualisation NEW DATA ARCHITECTURE WHICH SUPPORT THE 3V OF BIGDATA
- 12. 12 BIG DATA THE NEW AGE OF THE BUSINESS INTELLIGENCE Data Gathering & Transformation KPI and Business Answers Finance Marketing Supply ChainCRM Which new product will have the biggest chance to be a successful one? Is my supply chain is sufficiently rapid and effective? What are the optimization factors? Which one of key employee is going to leave the company? How to send much more targeted offers based on the opinions and tastes of customers or prospects? What transaction is at risk or fraudulent? Human Resources Enterprise Data External Data
- 13. 13 OUR REALISATION 2014 – REAL TIME BUSINESS Real Time Business
- 14. 14 OUR REALISATION 2014/2015 – POWER SELECTOR Search Power Selector
- 15. HOW IT WORK IN SOLOCAL? Idea Build Test & Learn LET'S PASSIONATE! DARING! INVENTIONS AND SIMPLIFY! STRIVE THE EXCELLENCE! Extract of the « charte de valeur » Where are we in the transformation? The top management is using Hadoop without knowing that! The first application using was: • Sales revenue in real time => refresh very 5 minutes • Solocal is a B2B company, so we are using the external Data to understand what is the growth of our clients … 15
- 16. ADVICES: HOW TO ACTIVATE BIG DATA PROJECT AND HOW START THE BI TRANSFORMATION? Be the data pilgrim: •Explain, •Demonstrate, •Give sense With data, we can find lot of new idea, and business area to explore Find a sponsor with the company with should: • understand the importance of this transformation • highlight your vision • give you some keys within the organization • help you in your approach Get started! We have all the technological maturity to finally realize all our desires in terms of data! 16