EclipseDay Milano 2017 - How to make Data Science appealing with open source software

Sep 22, 20171 like557 views

The presentation supported the speech by Matteo Sartori and Michele Gabusi (Data Scientists, Engineering Group’s Big Data & Analytics Competency Center) at EclipseDay Milano 2017.

How to make Data Science appealing
with open source software
Big Data & Analytics Competency Center
EclipseDay Milano, 22/09/2017
www.eng.it

www.eng.it
REPORTING & VISUALIZATION
A good presentation does not generate any
additional value, but makes the value
accessible and understandable
INSIGHTS
Discovering and understanding the
behaviors, patterns and trends that may
be concealed in the data
Data Science in a nutshell
INFERENCE
Learn from the examples in order to
foresee what is going to happen next
SCALABILITY
Scalable applications and algorithms
are needed to deal with great
amounts of data

www.eng.it
What does the market ask?
CUSTOMIZATION

www.eng.it
What we do
Predictive Maintenance
Anomaly Detection
Text Analytics
Supervised Learning
Recommender Systems
Churn Analysis
Active Learning
Reinforcement Learning
Unsupervised Learning

www.eng.it
Open Source makes Data Science appealing!
reproducibility
standardization
accessibility
no additional costs
ease of integration
no technological lock-in
great variety of visualization tools
huge variety of algorithms

www.eng.it
Big Data Science Lab
Meet us
halfway!
PoC and
demos
Analytics
lifecycle
Overview of the whole lifespan of our applications
Adaptable and modular solutions to many business issues
Aimed at making business solutions accessible and
understandable in every context

www.eng.it
FRONT-END CARE
BDSL gives us a possibility to empower our
communication and visualization tools
VARIETY
BDSL keeps a great number of different
applications under the same roof
Why BDSL?
PARALLELIZATION
BDSL is a useful resource to handle
computationally demanding tasks
CLOUD INFRASTRUCTURE
BDSL is totally based on Engineering
Private Cloud
COLLABORATION
Collaborative development and resource
sharing are at the top of our priorities
TECHNOLOGY SCOUTING
BDSL is a great chance to look for new
technologies and test their performance

www.eng.it
Standalone
PoC & projects
REST services
and Micro-Services
BDSL Components
Big Data RepositoriesSchedulers
Interpreters Distributed Computing Visualization tools
Web Microframework
solutions for
business

www.eng.it
Why Micro-Services?
COMMITTED TO THE MARKET
Aimed at fulfilling what the
market and the company
demand
RE-USABLE SOLUTIONS
Ease of use in completely
different contexts and projects
May be composable according
to one’s needs
CUSTOMIZATION
Among our services:
● Predictive algorithms
● Text tagger
● #Recommender
● Sentiment Analysis
● NE recognizer
● Semantic analysis
● Topic labeller

www.eng.it
Custom
Libraries &
Applications
Web
Microframework
Frontend
REST
services
LDAP
Authentication
Application endpointsREST service endpoint
Micro-Services and Micro-Applications

www.eng.it
Standalone
PoC & projects
REST services
and Micro-Services
BDSL Components
Big Data DBsSchedulers
Interpreters Distributed Computing Visualization tools
Web Microframework
solutions for
business

www.eng.it
Storytelling is a key factor!

www.eng.it
Advanced Visualization and Data integration
BDSL also features:

www.eng.it
Thank you!
Matteo Sartori
Data Scientist
Big Data & Analytics Competency Center
Engineering Group
matteo.sartori@eng.it
https://www.linkedin.com/in/matteosartori/
Michele Gabusi
Data Scientist
Big Data & Analytics Competency Center
Engineering Group
michele.gabusi@eng.it
https://www.linkedin.com/in/michele-gabusi-a2a76427/
Twitter: @michele_gabusi
@EngineeringSpa

Cogito Instruments brings embedded intelligence products to complement National Instruments' ecosystem. Cogito's products offer autonomous analytics capabilities that enable real-time, low-latency intelligence at the edge for industrial applications. Cogito is focused on applications that require small form factor, low power and cost solutions for distributed intelligence. Its key differentiator is massively parallel neural network hardware that can learn and classify patterns in real-time without cloud connectivity.

Cogito Teaser 2Philippe Lambinet

This document describes a new technology called Cogito that can enable truly intelligent machines. Cogito uses a neuromorphic approach to provide real-time learning and analytics with low and predictable latency in a scalable and compact package. It is energy and bandwidth efficient with an optimum cost of ownership. Cogito-enabled machines can learn and think. The technology provides an extremely fast, low power and low cost pattern learning and recognition solution that can be applied to industrial applications like visual inspection and predictive maintenance. It puts the cognitive power of a data center into a credit-card sized module.

Sddc sdn solution testingHappiest Minds Technologies

Ringtail 8 E-Discovery Software By FTI TechnologyFTI Technology

Helping Business Leaders Get Over Their Learning Curve in Advanced AnalyticsIDEAS - Int'l Data Engineering and Science Association

The document discusses some of the challenges business leaders face when adopting advanced analytics, including determining return on investment, trusting technology to make decisions, and managing organizational changes. It notes that ROI can come from both cost savings and revenue generation use cases, but there may be hidden project and lifecycle costs. Advanced analytics requires descriptive, predictive, and prescriptive models to build trust. Finally, the document compares centralizing analytics under a Chief Data Officer versus keeping functions decentralized, noting pros and cons of each approach including potential hidden costs of organizational changes or data management challenges.

Resume_10_2019RiteshSoni8

The document is a resume for Ritesh Soni, a Data Analyst with 3 years of experience in data analytics and machine learning projects. Some of the key projects in the resume include developing anomaly detection models for industrial equipment monitoring using unsupervised machine learning, designing a PowerBI dashboard for real-time data visualization on the Azure cloud platform, and developing computer vision solutions for parking space utilization analysis and advertisement audience analytics. The resume highlights Ritesh's proficiency in Python, TensorFlow, Keras, and skills like exploratory data analysis, machine learning, and Azure IoT.

New opportunities for connected data : Neo4j the graph databaseCédric Fauvet

Customer intelligence - Building stronger relationship with your customersPascal Ly

Gdpr CCPA Why Benchmarks of Billions of rows are as meaningful as compliance ...Steven Meister

GDPR/CCPA …, Fortune C Levels, What has been communicated to you is NO LONGER accurate. Data Compliance with your volumes is now viable! BigDataRevealed’s Architecture and Methodologies combined with the latest Spark & Apache, have broken the Compliance/Scalability Code. Billions of rows can now be processed for Compliance in minutes to hours. Video Benchmarks Spreadsheet & Demo = https://youtu.be/VTZ16LcgLmU

Why is VASmalltalk a great possibility for doing IoT and edge computing?ESUG

VASmalltalk is a good fit for IoT and edge computing for several reasons. It supports true object-oriented programming, easy deployment, and incredible debugging capabilities like binary stack dumping and remote debugging. VASmalltalk also benefits from maturity, uniformity, transparent object-oriented persistency, good support for FFI and ARM, and the ability to access GPIOs and integrate with technologies like MQTT. The presentation provided an overview of why VASmalltalk's features make it a strong possibility for IoT and edge computing applications.

IoT in the Cloud: Build & Unleash the Value in your Renewable Energy SystemMark Heckler

Commercializing Alternative DataDatabricks

Developing medical grade IoT systemsVlad Stirbu

Patient Care is a new health solution offered by Nokia that enables remote monitoring of patients. Biomedical signals collected via smart devices are analysed in the cloud and the results are presented to medical professionals. The session will present our methodology of developing microservices that make the Patient Care backend. We pay special attention on testing during the various phases of the development process, and ending with deployment to production, aiming at ensuring that resulting software is compliant with relevant medical software regulations and standards, such as HIPAA or FHIR respectively.

Al Balqa Applied University Thesis Research GuidancePhD Direction

International journal on soft computingijsc

Soft computing is likely to play an important role in science and engineering in the future. The successful applications of soft computing and the rapid growth suggest that the impact of soft computing will be felt increasingly in coming years. Soft Computing encourages the integration of soft computing techniques and tools into both everyday and advanced applications. This Open access peer-reviewed journal serves as a platform that fosters new applications for all scientists and engineers engaged in research and development in this fast growing field.

International journal on soft computing ijsc

The International Journal on Soft Computing (IJSC) serves as a platform for scientists and engineers to foster new applications in the growing field of soft computing. Soft computing techniques like fuzzy systems, neural networks, machine learning, and evolutionary computing are likely to play an important role in science and engineering. The journal accepts submissions on topics including these techniques as well as applications in areas such as image processing, e-commerce, biomedical engineering, and more.

International journal on soft computing ijsc

International journal on soft computingijsc

International Journal on Soft Computing ( IJSC )ijsc

Soft computing is likely to play an important role in science and engineering in the future. The successful applications of soft computing and the rapid growth suggest that the impact of soft computing will be felt increasingly in coming years. Soft Computing encourages the integration of soft computing techniques and tools into both everyday and advanced applications. This journal serves as a platform that fosters new applications for all scientists and engineers engaged in research and development in this fast growing field

Anatomy of a data science projectAdam Sroka

Slides for the presentation given at the Data Science Scotland Meetup (https://www.meetup.com/Scotland-Data-Science-Technology-Meetup/events/256269263/). This talk aimed to give some general advice, tips, and tricks about how to run a successful data science project. Hosted by: Incremental Group - https://www.linkedin.com/company/incremental-group/ MBN Solutions - https://www.linkedin.com/company/mbn-recruitment-solutions/ The Datalab - https://www.linkedin.com/company/the-data-lab-innovation-centre/

Data science tools of the tradeFangda Wang

This document discusses best practices for developing data science products at Philip Morris International (PMI). It covers: - PMI's data science team of over 40 people across four hubs working on fraud prevention and other problems. - Key principles for PMI's data science work, including being business-driven, investing in people, self-organizing, iterating to improve, and co-creating solutions. - Challenges in data product development involving integrating work between data scientists and other teams, and practices like continuous integration/delivery to overcome these challenges. - The role of data scientists in contributing code that is readable, testable, reusable, reproducible, and usable by other teams to integrate into

#IoTforReal Seminar slidedeck (Codit Belgium - Ghelamco Arena Gent)Codit

You know better than anyone how IoT is transforming your industry. It is a business revolution that offers many opportunities. But let’s be honest, it comes also with its challenges. Time for action! It can be a challenge to figure out which is the best set of services to bring together. Codit knows what you need. We have been building IoT solutions right from the start, for companies just like yours. Understanding business cases and translating them to working solutions is what we do.

Arocom Company - Portfolio Brochure Details.pdfArocom IT Solutions Pvt. Ltd

Arocom is a consulting and solution engineering company with expertise in providing engineering services for AI & Machine Learning, Data Operations & Analytics, MLOps and Cloud Computing. Our clients include companies within biotech, drug discovery, therapeutics, manufacturing, retail and startups. Our consultants are best in their skills and offer hands-on talent to our clients in achieving their goals.

Data Analytics for IoT Muralidhar Somisetty

This document discusses analytics for IoT and making sense of data from sensors. It first provides an overview of Innohabit Technologies' vision and products related to contextual intelligence platforms, machine learning analytics, and predictive network health analytics. It then discusses how analytics can help make sense of the endless sea of data from IoT sensors, highlighting key applications of analytics in areas like industrial IoT, smart retail, autonomous vehicles, and more. The benefits of analytics adoption in industrial IoT contexts include optimized asset maintenance, production operations, supply chain management, and more.

DDDP 2019 - Brown to GreenJohn Archer

From Business Idea to Successful Delivery by Serhiy Haziyev & Olha Hrytsay, S...SoftServe

The document discusses transitioning product development to an open innovation model using outsourcing partners. It provides an overview of SoftServe's capabilities including big data solutions, reference architectures, and case studies. The document also outlines SoftServe's involvement in collaborating with clients throughout the product development lifecycle from envisioning ideas to commercialization. Finally, it provides a checklist for successful delivery when partnering with outsourcing providers for big data and product development.

The Future of Data ScienceDataWorks Summit

OA centre of excellenceObject Automation Software Solutions (P) Ltd.

Nov 2019 kafka with mongo db and confluent sydneyAndrew Blades

This document summarizes a meetup event about architecting for innovation with MongoDB, Kafka, and Confluent. It includes presentations from Sam Harley of MongoDB on powering microservices with Kubernetes, Kafka and MongoDB, and from Brett Randall of Confluent on building consciousness on real time events using KSQL recipes. The meetup concludes with a door prize drawing and announcement of the next meetup in December.

OpenSistemas Corporate PresentationOpenSistemas

Data technology can help companies predict outcomes through simulations, find unexpected relationships in large data sets, and monitor situations in real-time. OpenSistemas is a company that specializes in data management, analysis, storage and visualization using technologies like Apache Spark, machine learning, and cloud integration. They provide services in areas like data processing, analytics, visualization and cloud to help clients strengthen the strategic value of their information.

More Related Content

What's hot (11)

Gdpr CCPA Why Benchmarks of Billions of rows are as meaningful as compliance ...Steven Meister

Why is VASmalltalk a great possibility for doing IoT and edge computing?ESUG

IoT in the Cloud: Build & Unleash the Value in your Renewable Energy SystemMark Heckler

Commercializing Alternative DataDatabricks

Developing medical grade IoT systemsVlad Stirbu

Al Balqa Applied University Thesis Research GuidancePhD Direction

International journal on soft computingijsc

International journal on soft computing ijsc

International journal on soft computingijsc

International Journal on Soft Computing ( IJSC )ijsc

Soft computing is likely to play an important role in science and engineering in the future. The successful applications of soft computing and the rapid growth suggest that the impact of soft computing will be felt increasingly in coming years. Soft Computing encourages the integration of soft computing techniques and tools into both everyday and advanced applications. This journal serves as a platform that fosters new applications for all scientists and engineers engaged in research and development in this fast growing field

Gdpr CCPA Why Benchmarks of Billions of rows are as meaningful as compliance ...Steven Meister

Why is VASmalltalk a great possibility for doing IoT and edge computing?ESUG

IoT in the Cloud: Build & Unleash the Value in your Renewable Energy SystemMark Heckler

Commercializing Alternative DataDatabricks

Developing medical grade IoT systemsVlad Stirbu

Al Balqa Applied University Thesis Research GuidancePhD Direction

International journal on soft computingijsc

International journal on soft computing ijsc

International journal on soft computingijsc

International Journal on Soft Computing ( IJSC )ijsc

Similar to EclipseDay Milano 2017 - How to make Data Science appealing with open source software (20)

Anatomy of a data science projectAdam Sroka

Data science tools of the tradeFangda Wang

#IoTforReal Seminar slidedeck (Codit Belgium - Ghelamco Arena Gent)Codit

Arocom Company - Portfolio Brochure Details.pdfArocom IT Solutions Pvt. Ltd

Data Analytics for IoT Muralidhar Somisetty

DDDP 2019 - Brown to GreenJohn Archer

From Business Idea to Successful Delivery by Serhiy Haziyev & Olha Hrytsay, S...SoftServe

The Future of Data ScienceDataWorks Summit

OA centre of excellenceObject Automation Software Solutions (P) Ltd.

Nov 2019 kafka with mongo db and confluent sydneyAndrew Blades

OpenSistemas Corporate PresentationOpenSistemas

Schnellere Digitalisierung mit einer cloudbasierten DatenstrategieMongoDB

IoTforReal Seminar slidedeckCodit

Dell AI Telecom WebinarBill Wong

This document discusses how telecom companies can leverage artificial intelligence and analytics to drive digital transformation. It identifies key opportunities for AI including improving the customer experience, fraud mitigation, and predictive maintenance. It then outlines the components of a telecom data lake that can support these advanced analytics initiatives. Examples of AI use cases for different telecom business functions like marketing, network operations, and security are also provided. The document argues that a data lake platform optimized for analytics can help telecom companies achieve business and innovation goals through improved operations, new revenue streams, and lower costs.

How Cloud is Affecting Data Scientists CCG

This document discusses how data science models have transitioned to the cloud to take advantage of greater computing resources. It notes that data science models are resource-intensive and traditionally required powerful local machines. The cloud allows data scientists to run models on cloud infrastructure for lower costs than high-end laptops and with access to many GPUs. Several major cloud platforms - Azure, AWS, and Google Cloud - are discussed and compared in terms of their machine learning offerings. The document also introduces Microsoft's Team Data Science Process, which aims to help data science teams collaborate more effectively on projects in the cloud.

201705 neoteric software development introMatt Kurleto

Embedded Systems and IoTDr. Shivananda Koteshwar

IOT_PPT1.pdflaxmikanth45

The document provides an overview of the Internet of Things (IoT). It defines IoT as the network of physical objects embedded with sensors that can collect and exchange data. It describes how IoT works using technologies like RFID sensors, smart technologies, and nanotechnologies to identify things, collect data, and enhance network power. It also discusses current and future applications of IoT in various fields, technological challenges, and criticisms of IoT regarding privacy, security, and control issues.

Extending open source and hybrid cloud to drive OT transformation - Future Oi...John Archer

Data analytics on AzureElena Lopez

Anatomy of a data science projectAdam Sroka

Data science tools of the tradeFangda Wang

#IoTforReal Seminar slidedeck (Codit Belgium - Ghelamco Arena Gent)Codit

Arocom Company - Portfolio Brochure Details.pdfArocom IT Solutions Pvt. Ltd

Data Analytics for IoT Muralidhar Somisetty

DDDP 2019 - Brown to GreenJohn Archer

From Business Idea to Successful Delivery by Serhiy Haziyev & Olha Hrytsay, S...SoftServe

The Future of Data ScienceDataWorks Summit

OA centre of excellenceObject Automation Software Solutions (P) Ltd.

Nov 2019 kafka with mongo db and confluent sydneyAndrew Blades

OpenSistemas Corporate PresentationOpenSistemas

Schnellere Digitalisierung mit einer cloudbasierten DatenstrategieMongoDB

IoTforReal Seminar slidedeckCodit

Dell AI Telecom WebinarBill Wong

How Cloud is Affecting Data Scientists CCG

201705 neoteric software development introMatt Kurleto

Embedded Systems and IoTDr. Shivananda Koteshwar

IOT_PPT1.pdflaxmikanth45

Extending open source and hybrid cloud to drive OT transformation - Future Oi...John Archer

Data analytics on AzureElena Lopez

More from SpagoWorld (20)

[SFScon'17] More than a decade with free open source softwareSpagoWorld

Parametric report slide supportSpagoWorld

My First Report slide supportSpagoWorld

My First Worksheet slide supportSpagoWorld

Starting with SpagoBI Slide SupportSpagoWorld

SpagoBI Suite Slide SupportSpagoWorld

Architectural Evolution Starting from HadoopSpagoWorld

Openness as the Engine for Digital InnovationSpagoWorld

Gabriele Ruffatti discusses openness and digital innovation in a presentation with three main sections. Openness is seen as an engine for digital innovation, driven by complexity, dynamism and a need for trust. Open source is presented as a development model that enables collaboration, transparency and new commercial models. The role of data, people and managers who embrace innovation are key factors for digital transformation.

HUG Italy meet-up with Fabian Wilckens, MapR EMEA Solutions ArchitectSpagoWorld

HUG Italy meet-up with Tugdual Grall, MapR Technical EvangelistSpagoWorld

Data Mining with SpagoBI suiteSpagoWorld

This document describes SpagoBI's new data mining engine that uses the R scripting language. The engine allows users to execute R scripts and display multiple outputs. It features the JRI and Rserve libraries to interface R with Java applications. The engine works with datasets, scripts, commands, outputs, parameters, and variables. Scripts contain R code, datasets provide data, commands execute scripts and outputs display results. The template defines how these components work together in a data mining document.

Webinar: SpagoBI 5 - Self-build your interactive cockpits, get instant insigh...SpagoWorld

Webinar - SpagoBI 5 and what-if analytics: is your business strategy effective?SpagoWorld

Webinar - SpagoBI 5: here comes the Social Network analysis SpagoWorld

Webinar - What's new with SpagoBI 5: presentation and demoSpagoWorld

SpagoBI 5 Demo Day and Workshop : Business Applications and UsesSpagoWorld

SpagoBI 5 Demo Day and Workshop : Technology Applications and UsesSpagoWorld

Engineering and OW2 Big Data Initiative: an open approach to the data-driven ...SpagoWorld

OW2Con’14 – OW2 Big Data initiative: leveraging the data-driven economy with ...SpagoWorld