SlideShare a Scribd company logo
Proactive Process
Adaptation using
Deep Learning
Ensembles
Andreas Metzger, Adrian Neubauer,
Philipp Bohn, and Klaus Pohl
CAiSE 2019, Roma, MMXIX
Bocca della Verità
S. Maria in Cosmedin
A. Metzger, A. Neubauer, P. Bohn, and K. Pohl, “Proactive process adaptation using
deep learning ensembles,” in 31st Int’l Conference on Advanced Information
Systems Engineering (CAiSE 2019), Rome, Italy, June 3-7, 2019, ser. LNCS, P.
Giorgini and B. Weber, Eds., vol. 11483. Springer, 2019. [Online]. Available:
https://doi.org/10.1007/978-3-030-21290-2_34
Process
completiontCheckpoint j
Process
start
Proactive Process Adaptation “in a Nutshell”
BIOC/FAiSE, Roma, MMXIX 2
Monitor
Predict
Proactive
adaptation
planned /
acceptable situations
= Violation
= Non-
Violation

E.g., Delayed
freight delivery
E.g., Schedule air
instead of land
transport
E.g., Freight
delivery within 2
days
Process
Performance
Agenda
1. Problem Statement and State of the Art
2. Deep Learning Approach
3. Experimental Evaluation
4. Summary and Outlook
CAiSE 2019, Roma, MMXIX 3
Problem Statement
Accuracy
• False violations  Unnecessary adaptations
• False non-violations  Missed adaptations
Earliness
• Early predictions  More time for adaptations
But: trade-off between accuracy and earliness
BIOC/FAiSE, Roma, MMXIX 4
[Teinemaa et al., 2019]
BPIC 2017BPIC 2012
[Metzger & Neubauer, 2018]
Cargo 2000
Accuracy[MCC]
Accuracy[AUC]
State of the Art
Improve earliness of accurate process predictions
• Use additional process data [Teinemaa et al., 2016], [Leontjeva et al., 2015]
• Hyper-parameter optimization [Francescomarino et al., 2016]
• Clustering [Francescomarino et al., 2018]
Early time series classification
• Classify with lowest number of data points [Mori et al., 2018], [Petitjean et al., 2014]
• Classify considering probability threshold [Mori et al., 2017]
Reliability estimates to select earliest prediction
• Class probabilities of random forests [Maggi et al., 2014], [Francescomarino et al., 2016]
Limitations / Gaps
• Probabilities of prediction techniques may be poor reliability estimates [Zhou, 2012]
 Deep learning ensembles to estimate individual prediction error
• No analysis on usefulness for proactive process adaptation
 Experimental analysis of cost savings
CAiSE 2019, Roma, MMXIX 5
Agenda
1. Problem Statement and State of the Art
2. Deep Learning Approach
3. Experimental Evaluation
4. Summary and Outlook
CAiSE 2019, Roma, MMXIX 6
Dynamically Deciding on Proactive Adaptation
Deep learning ensembles (RNN) to compute reliability estimates
7CAiSE 2019, Roma, MMXIX
Process
monitoring
data at
Checkpoint j
RNN Model 1
RNN Model m
…
Ensemble
Prediction
[Tj = “non-violation”]
Proactive
Process
Adaptation
No Proactive
Process
Adaptation
Prediction Tj
Reliability
estimate j
[Tj =
“violation”]
[j  threshold]
[j < threshold]
RNNs as Base Learners
RNN = Recurrent Neural Network
Benefits
• High accuracy [Tax et. al. 2017; Evermann et al. 2017, Metzger & Nebauer, 2018]
• Arbitrary length process instances (without sequence encoding)
• Predictions at any checkpoint
Scalability
• Long training time
 Parallelization
 Hardware speedups
8BIOC/FAiSE, Roma, MMXIX
Hardware type Training
time
CPU 25 min
GPU (Nvidia CuDNN) 8 min
Google TPU (Tensorflow) 2 min
Agenda
1. Problem Statement and State of the Art
2. Deep Learning Approach
3. Experimental Evaluation
4. Summary and Outlook
CAiSE 2019, Roma, MMXIX 9
Experimental Variables
Dependent: Cost
Independent
Relative adaptation costs 
• Adaptation cost =  · penalty
Reliability threshold 
Adaptation effectiveness 
•  linearly decreasing over process execution
10CAiSE 2019, Roma, MMXIX
Costs =
Adaptation
Costs
Adaptation
Costs
+ Penalty
0
Penalty
Violation
Non-Violationeffective
not
effective
Violation
Non-Violation
j 
threshold
No Proactive
Process Adaptation
Proactive Process
Adaptation
j <
threshold
Tj = “violation”
Tj = “non-violation”
Prediction
Tj
Data Sets
Four public data sets with different key characteristics
11CAiSE 2019, Roma, MMXIX
Cargo2000BPIC2012
Results
12BIOC/FAiSE, Roma, MMXIX
“Cheap”
adaptation
“Expensive”
adaptation
Static checkpoint
Dynamic approach
No proactive
adaptation
Results
Average cost savings
13CAiSE 2019, Roma, MMXIX
9.2%
27.2% 35.8%
15.1%
27%
Agenda
1. Problem Statement and State of the Art
2. Deep Learning Approach
3. Experimental Evaluation
4. Summary and Outlook
CAiSE 2019, Roma, MMXIX 14
Summary
Cost savings when dynamically balancing earliness and accuracy
Benefits of dynamic deep learning approach
• No need to decide on a fixed checkpoint
• No need for testing phase to compute accurate accuracy
15CAiSE 2019, Roma, MMXIX
Alarm about Delay
Reliability Estimate
Real-World Prototype
Outlook
Extension 1: More complex cost models
• Nonlinear costs
• Regression (instead of classification) models
Extension 2: Advanced reliability estimates
• E.g., exploit variance of ensemble [Bosnic & Kononenko, 2008]
16CAiSE 2019, Roma, MMXIX
Research leading to these results has
received funding from the EU’s Horizon
2020 research and innovation programme
under
Objective ICT-15 ‘Big Data PPP:
Large Scale Pilot Actions ‘
http://www.transformingtransport.eu
Thanks!
Ad

More Related Content

Similar to Proactive Process Adaptation using Deep Learning Ensembles (20)

Survey on Software Data Reduction Techniques Accomplishing Bug Triage
Survey on Software Data Reduction Techniques Accomplishing Bug TriageSurvey on Software Data Reduction Techniques Accomplishing Bug Triage
Survey on Software Data Reduction Techniques Accomplishing Bug Triage
IRJET Journal
 
Insights on Research Techniques towards Cost Estimation in Software Design
Insights on Research Techniques towards Cost Estimation in Software Design Insights on Research Techniques towards Cost Estimation in Software Design
Insights on Research Techniques towards Cost Estimation in Software Design
IJECEIAES
 
ISSUES RELATED TO SUBCONTRACTING PRACTICES IN CONSTRUCTION PROJECTS
ISSUES RELATED TO SUBCONTRACTING PRACTICES IN CONSTRUCTION PROJECTSISSUES RELATED TO SUBCONTRACTING PRACTICES IN CONSTRUCTION PROJECTS
ISSUES RELATED TO SUBCONTRACTING PRACTICES IN CONSTRUCTION PROJECTS
IAEME Publication
 
A KPI-based process monitoring and fault detection framework for large-scale ...
A KPI-based process monitoring and fault detection framework for large-scale ...A KPI-based process monitoring and fault detection framework for large-scale ...
A KPI-based process monitoring and fault detection framework for large-scale ...
ISA Interchange
 
Cost Forecasting of Construction Materials: A review
Cost Forecasting of Construction Materials: A reviewCost Forecasting of Construction Materials: A review
Cost Forecasting of Construction Materials: A review
IRJET Journal
 
IRJET- Daily Updates on Construction Sites Progress
IRJET- Daily Updates on Construction Sites ProgressIRJET- Daily Updates on Construction Sites Progress
IRJET- Daily Updates on Construction Sites Progress
IRJET Journal
 
7Epsilon investment casting case study to satisfy requirements of clause 6-1-...
7Epsilon investment casting case study to satisfy requirements of clause 6-1-...7Epsilon investment casting case study to satisfy requirements of clause 6-1-...
7Epsilon investment casting case study to satisfy requirements of clause 6-1-...
Meghana Ransing
 
Ppt of final thesis
Ppt of final thesisPpt of final thesis
Ppt of final thesis
WU
 
IRJET- Critical Chain Project Management in Construction Projects
IRJET- Critical Chain Project Management in Construction ProjectsIRJET- Critical Chain Project Management in Construction Projects
IRJET- Critical Chain Project Management in Construction Projects
IRJET Journal
 
Nimbus IP10 CJ Workshop
Nimbus IP10 CJ WorkshopNimbus IP10 CJ Workshop
Nimbus IP10 CJ Workshop
Improvement Skills Consulting Ltd.
 
Risk-based Proactive Process Adaptation
Risk-based Proactive Process AdaptationRisk-based Proactive Process Adaptation
Risk-based Proactive Process Adaptation
Andreas Metzger
 
Value Engineering on Bias Munjul Port Project in Nusa Ceningan Bali Indonesia
Value Engineering on Bias Munjul Port Project in Nusa Ceningan Bali IndonesiaValue Engineering on Bias Munjul Port Project in Nusa Ceningan Bali Indonesia
Value Engineering on Bias Munjul Port Project in Nusa Ceningan Bali Indonesia
AI Publications
 
Risk Driven Approach to Test Device Software
Risk Driven Approach to Test Device SoftwareRisk Driven Approach to Test Device Software
Risk Driven Approach to Test Device Software
ijtsrd
 
Effectiveness of Risk Management and Chosen Methods in Construction Sector
Effectiveness of Risk Management and Chosen Methods in Construction SectorEffectiveness of Risk Management and Chosen Methods in Construction Sector
Effectiveness of Risk Management and Chosen Methods in Construction Sector
IRJET Journal
 
COMPARATIVE STUDY OF SOFTWARE ESTIMATION TECHNIQUES
COMPARATIVE STUDY OF SOFTWARE ESTIMATION TECHNIQUES COMPARATIVE STUDY OF SOFTWARE ESTIMATION TECHNIQUES
COMPARATIVE STUDY OF SOFTWARE ESTIMATION TECHNIQUES
ijseajournal
 
Planning and Optimization of Resource Constrained Project Scheduling by using...
Planning and Optimization of Resource Constrained Project Scheduling by using...Planning and Optimization of Resource Constrained Project Scheduling by using...
Planning and Optimization of Resource Constrained Project Scheduling by using...
IRJET Journal
 
Earning Value from Earned Value Management
Earning Value from Earned Value ManagementEarning Value from Earned Value Management
Earning Value from Earned Value Management
Glen Alleman
 
USING IMAGE CLASSIFICATION TO INCENTIVIZE RECYCLING
USING IMAGE CLASSIFICATION TO INCENTIVIZE RECYCLINGUSING IMAGE CLASSIFICATION TO INCENTIVIZE RECYCLING
USING IMAGE CLASSIFICATION TO INCENTIVIZE RECYCLING
IRJET Journal
 
IRJET- Risk Management of Construction Projects by using Primavera Risk Analysis
IRJET- Risk Management of Construction Projects by using Primavera Risk AnalysisIRJET- Risk Management of Construction Projects by using Primavera Risk Analysis
IRJET- Risk Management of Construction Projects by using Primavera Risk Analysis
IRJET Journal
 
Insights of effectivity analysis of learning-based approaches towards softwar...
Insights of effectivity analysis of learning-based approaches towards softwar...Insights of effectivity analysis of learning-based approaches towards softwar...
Insights of effectivity analysis of learning-based approaches towards softwar...
IJECEIAES
 
Survey on Software Data Reduction Techniques Accomplishing Bug Triage
Survey on Software Data Reduction Techniques Accomplishing Bug TriageSurvey on Software Data Reduction Techniques Accomplishing Bug Triage
Survey on Software Data Reduction Techniques Accomplishing Bug Triage
IRJET Journal
 
Insights on Research Techniques towards Cost Estimation in Software Design
Insights on Research Techniques towards Cost Estimation in Software Design Insights on Research Techniques towards Cost Estimation in Software Design
Insights on Research Techniques towards Cost Estimation in Software Design
IJECEIAES
 
ISSUES RELATED TO SUBCONTRACTING PRACTICES IN CONSTRUCTION PROJECTS
ISSUES RELATED TO SUBCONTRACTING PRACTICES IN CONSTRUCTION PROJECTSISSUES RELATED TO SUBCONTRACTING PRACTICES IN CONSTRUCTION PROJECTS
ISSUES RELATED TO SUBCONTRACTING PRACTICES IN CONSTRUCTION PROJECTS
IAEME Publication
 
A KPI-based process monitoring and fault detection framework for large-scale ...
A KPI-based process monitoring and fault detection framework for large-scale ...A KPI-based process monitoring and fault detection framework for large-scale ...
A KPI-based process monitoring and fault detection framework for large-scale ...
ISA Interchange
 
Cost Forecasting of Construction Materials: A review
Cost Forecasting of Construction Materials: A reviewCost Forecasting of Construction Materials: A review
Cost Forecasting of Construction Materials: A review
IRJET Journal
 
IRJET- Daily Updates on Construction Sites Progress
IRJET- Daily Updates on Construction Sites ProgressIRJET- Daily Updates on Construction Sites Progress
IRJET- Daily Updates on Construction Sites Progress
IRJET Journal
 
7Epsilon investment casting case study to satisfy requirements of clause 6-1-...
7Epsilon investment casting case study to satisfy requirements of clause 6-1-...7Epsilon investment casting case study to satisfy requirements of clause 6-1-...
7Epsilon investment casting case study to satisfy requirements of clause 6-1-...
Meghana Ransing
 
Ppt of final thesis
Ppt of final thesisPpt of final thesis
Ppt of final thesis
WU
 
IRJET- Critical Chain Project Management in Construction Projects
IRJET- Critical Chain Project Management in Construction ProjectsIRJET- Critical Chain Project Management in Construction Projects
IRJET- Critical Chain Project Management in Construction Projects
IRJET Journal
 
Risk-based Proactive Process Adaptation
Risk-based Proactive Process AdaptationRisk-based Proactive Process Adaptation
Risk-based Proactive Process Adaptation
Andreas Metzger
 
Value Engineering on Bias Munjul Port Project in Nusa Ceningan Bali Indonesia
Value Engineering on Bias Munjul Port Project in Nusa Ceningan Bali IndonesiaValue Engineering on Bias Munjul Port Project in Nusa Ceningan Bali Indonesia
Value Engineering on Bias Munjul Port Project in Nusa Ceningan Bali Indonesia
AI Publications
 
Risk Driven Approach to Test Device Software
Risk Driven Approach to Test Device SoftwareRisk Driven Approach to Test Device Software
Risk Driven Approach to Test Device Software
ijtsrd
 
Effectiveness of Risk Management and Chosen Methods in Construction Sector
Effectiveness of Risk Management and Chosen Methods in Construction SectorEffectiveness of Risk Management and Chosen Methods in Construction Sector
Effectiveness of Risk Management and Chosen Methods in Construction Sector
IRJET Journal
 
COMPARATIVE STUDY OF SOFTWARE ESTIMATION TECHNIQUES
COMPARATIVE STUDY OF SOFTWARE ESTIMATION TECHNIQUES COMPARATIVE STUDY OF SOFTWARE ESTIMATION TECHNIQUES
COMPARATIVE STUDY OF SOFTWARE ESTIMATION TECHNIQUES
ijseajournal
 
Planning and Optimization of Resource Constrained Project Scheduling by using...
Planning and Optimization of Resource Constrained Project Scheduling by using...Planning and Optimization of Resource Constrained Project Scheduling by using...
Planning and Optimization of Resource Constrained Project Scheduling by using...
IRJET Journal
 
Earning Value from Earned Value Management
Earning Value from Earned Value ManagementEarning Value from Earned Value Management
Earning Value from Earned Value Management
Glen Alleman
 
USING IMAGE CLASSIFICATION TO INCENTIVIZE RECYCLING
USING IMAGE CLASSIFICATION TO INCENTIVIZE RECYCLINGUSING IMAGE CLASSIFICATION TO INCENTIVIZE RECYCLING
USING IMAGE CLASSIFICATION TO INCENTIVIZE RECYCLING
IRJET Journal
 
IRJET- Risk Management of Construction Projects by using Primavera Risk Analysis
IRJET- Risk Management of Construction Projects by using Primavera Risk AnalysisIRJET- Risk Management of Construction Projects by using Primavera Risk Analysis
IRJET- Risk Management of Construction Projects by using Primavera Risk Analysis
IRJET Journal
 
Insights of effectivity analysis of learning-based approaches towards softwar...
Insights of effectivity analysis of learning-based approaches towards softwar...Insights of effectivity analysis of learning-based approaches towards softwar...
Insights of effectivity analysis of learning-based approaches towards softwar...
IJECEIAES
 

More from Andreas Metzger (12)

Explainable Online Reinforcement Learning for Adaptive Systems
Explainable Online Reinforcement Learning for Adaptive SystemsExplainable Online Reinforcement Learning for Adaptive Systems
Explainable Online Reinforcement Learning for Adaptive Systems
Andreas Metzger
 
Data Quality Issues in Online Reinforcement Learning for Self-Adaptive System...
Data Quality Issues in Online Reinforcement Learning for Self-Adaptive System...Data Quality Issues in Online Reinforcement Learning for Self-Adaptive System...
Data Quality Issues in Online Reinforcement Learning for Self-Adaptive System...
Andreas Metzger
 
Explaining Online Reinforcement Learning Decisions of Self-Adaptive Systems
Explaining Online Reinforcement Learning Decisions of Self-Adaptive SystemsExplaining Online Reinforcement Learning Decisions of Self-Adaptive Systems
Explaining Online Reinforcement Learning Decisions of Self-Adaptive Systems
Andreas Metzger
 
Antrittsvorlesung - APL.pptx
Antrittsvorlesung - APL.pptxAntrittsvorlesung - APL.pptx
Antrittsvorlesung - APL.pptx
Andreas Metzger
 
Feature Model-Guided Online Reinforcement Learning for Self-Adaptive Services
Feature Model-Guided Online Reinforcement Learning for Self-Adaptive ServicesFeature Model-Guided Online Reinforcement Learning for Self-Adaptive Services
Feature Model-Guided Online Reinforcement Learning for Self-Adaptive Services
Andreas Metzger
 
Data-driven AI for Self-Adaptive Software Systems
Data-driven AI for Self-Adaptive Software SystemsData-driven AI for Self-Adaptive Software Systems
Data-driven AI for Self-Adaptive Software Systems
Andreas Metzger
 
Data-driven Deep Learning for Proactive Terminal Process Management
Data-driven Deep Learning for Proactive Terminal Process ManagementData-driven Deep Learning for Proactive Terminal Process Management
Data-driven Deep Learning for Proactive Terminal Process Management
Andreas Metzger
 
Big Data Technology Insights
Big Data Technology InsightsBig Data Technology Insights
Big Data Technology Insights
Andreas Metzger
 
Towards an End-to-End Architecture for Run-time Data Protection in the Cloud
Towards an End-to-End Architecture for Run-time Data Protection in the Cloud Towards an End-to-End Architecture for Run-time Data Protection in the Cloud
Towards an End-to-End Architecture for Run-time Data Protection in the Cloud
Andreas Metzger
 
Considering Non-sequential Control Flows for Process Prediction with Recurren...
Considering Non-sequential Control Flows for Process Prediction with Recurren...Considering Non-sequential Control Flows for Process Prediction with Recurren...
Considering Non-sequential Control Flows for Process Prediction with Recurren...
Andreas Metzger
 
Predictive Business Process Monitoring considering Reliability and Risk
Predictive Business Process Monitoring considering Reliability and RiskPredictive Business Process Monitoring considering Reliability and Risk
Predictive Business Process Monitoring considering Reliability and Risk
Andreas Metzger
 
Predictive Process Monitoring Considering Reliability Estimates
Predictive Process Monitoring Considering Reliability EstimatesPredictive Process Monitoring Considering Reliability Estimates
Predictive Process Monitoring Considering Reliability Estimates
Andreas Metzger
 
Explainable Online Reinforcement Learning for Adaptive Systems
Explainable Online Reinforcement Learning for Adaptive SystemsExplainable Online Reinforcement Learning for Adaptive Systems
Explainable Online Reinforcement Learning for Adaptive Systems
Andreas Metzger
 
Data Quality Issues in Online Reinforcement Learning for Self-Adaptive System...
Data Quality Issues in Online Reinforcement Learning for Self-Adaptive System...Data Quality Issues in Online Reinforcement Learning for Self-Adaptive System...
Data Quality Issues in Online Reinforcement Learning for Self-Adaptive System...
Andreas Metzger
 
Explaining Online Reinforcement Learning Decisions of Self-Adaptive Systems
Explaining Online Reinforcement Learning Decisions of Self-Adaptive SystemsExplaining Online Reinforcement Learning Decisions of Self-Adaptive Systems
Explaining Online Reinforcement Learning Decisions of Self-Adaptive Systems
Andreas Metzger
 
Antrittsvorlesung - APL.pptx
Antrittsvorlesung - APL.pptxAntrittsvorlesung - APL.pptx
Antrittsvorlesung - APL.pptx
Andreas Metzger
 
Feature Model-Guided Online Reinforcement Learning for Self-Adaptive Services
Feature Model-Guided Online Reinforcement Learning for Self-Adaptive ServicesFeature Model-Guided Online Reinforcement Learning for Self-Adaptive Services
Feature Model-Guided Online Reinforcement Learning for Self-Adaptive Services
Andreas Metzger
 
Data-driven AI for Self-Adaptive Software Systems
Data-driven AI for Self-Adaptive Software SystemsData-driven AI for Self-Adaptive Software Systems
Data-driven AI for Self-Adaptive Software Systems
Andreas Metzger
 
Data-driven Deep Learning for Proactive Terminal Process Management
Data-driven Deep Learning for Proactive Terminal Process ManagementData-driven Deep Learning for Proactive Terminal Process Management
Data-driven Deep Learning for Proactive Terminal Process Management
Andreas Metzger
 
Big Data Technology Insights
Big Data Technology InsightsBig Data Technology Insights
Big Data Technology Insights
Andreas Metzger
 
Towards an End-to-End Architecture for Run-time Data Protection in the Cloud
Towards an End-to-End Architecture for Run-time Data Protection in the Cloud Towards an End-to-End Architecture for Run-time Data Protection in the Cloud
Towards an End-to-End Architecture for Run-time Data Protection in the Cloud
Andreas Metzger
 
Considering Non-sequential Control Flows for Process Prediction with Recurren...
Considering Non-sequential Control Flows for Process Prediction with Recurren...Considering Non-sequential Control Flows for Process Prediction with Recurren...
Considering Non-sequential Control Flows for Process Prediction with Recurren...
Andreas Metzger
 
Predictive Business Process Monitoring considering Reliability and Risk
Predictive Business Process Monitoring considering Reliability and RiskPredictive Business Process Monitoring considering Reliability and Risk
Predictive Business Process Monitoring considering Reliability and Risk
Andreas Metzger
 
Predictive Process Monitoring Considering Reliability Estimates
Predictive Process Monitoring Considering Reliability EstimatesPredictive Process Monitoring Considering Reliability Estimates
Predictive Process Monitoring Considering Reliability Estimates
Andreas Metzger
 
Ad

Recently uploaded (20)

hersh's midterm project.pdf music retail and distribution
hersh's midterm project.pdf music retail and distributionhersh's midterm project.pdf music retail and distribution
hersh's midterm project.pdf music retail and distribution
hershtara1
 
Process Mining as Enabler for Digital Transformations
Process Mining as Enabler for Digital TransformationsProcess Mining as Enabler for Digital Transformations
Process Mining as Enabler for Digital Transformations
Process mining Evangelist
 
Oral Malodor.pptx jsjshdhushehsidjjeiejdhfj
Oral Malodor.pptx jsjshdhushehsidjjeiejdhfjOral Malodor.pptx jsjshdhushehsidjjeiejdhfj
Oral Malodor.pptx jsjshdhushehsidjjeiejdhfj
maitripatel5301
 
Process Mining at Deutsche Bank - Journey
Process Mining at Deutsche Bank - JourneyProcess Mining at Deutsche Bank - Journey
Process Mining at Deutsche Bank - Journey
Process mining Evangelist
 
Controlling Financial Processes at a Municipality
Controlling Financial Processes at a MunicipalityControlling Financial Processes at a Municipality
Controlling Financial Processes at a Municipality
Process mining Evangelist
 
Sets theories and applications that can used to imporve knowledge
Sets theories and applications that can used to imporve knowledgeSets theories and applications that can used to imporve knowledge
Sets theories and applications that can used to imporve knowledge
saumyasl2020
 
Understanding Complex Development Processes
Understanding Complex Development ProcessesUnderstanding Complex Development Processes
Understanding Complex Development Processes
Process mining Evangelist
 
文凭证书美国SDSU文凭圣地亚哥州立大学学生证学历认证查询
文凭证书美国SDSU文凭圣地亚哥州立大学学生证学历认证查询文凭证书美国SDSU文凭圣地亚哥州立大学学生证学历认证查询
文凭证书美国SDSU文凭圣地亚哥州立大学学生证学历认证查询
Taqyea
 
RAG Chatbot using AWS Bedrock and Streamlit Framework
RAG Chatbot using AWS Bedrock and Streamlit FrameworkRAG Chatbot using AWS Bedrock and Streamlit Framework
RAG Chatbot using AWS Bedrock and Streamlit Framework
apanneer
 
Transforming health care with ai powered
Transforming health care with ai poweredTransforming health care with ai powered
Transforming health care with ai powered
gowthamarvj
 
Mining a Global Trade Process with Data Science - Microsoft
Mining a Global Trade Process with Data Science - MicrosoftMining a Global Trade Process with Data Science - Microsoft
Mining a Global Trade Process with Data Science - Microsoft
Process mining Evangelist
 
Process Mining Machine Recoveries to Reduce Downtime
Process Mining Machine Recoveries to Reduce DowntimeProcess Mining Machine Recoveries to Reduce Downtime
Process Mining Machine Recoveries to Reduce Downtime
Process mining Evangelist
 
HershAggregator (2).pdf musicretaildistribution
HershAggregator (2).pdf musicretaildistributionHershAggregator (2).pdf musicretaildistribution
HershAggregator (2).pdf musicretaildistribution
hershtara1
 
Introduction to systems thinking tools_Eng.pdf
Introduction to systems thinking tools_Eng.pdfIntroduction to systems thinking tools_Eng.pdf
Introduction to systems thinking tools_Eng.pdf
AbdurahmanAbd
 
Publication-launch-How-is-Life-for-Children-in-the-Digital-Age-15-May-2025.pdf
Publication-launch-How-is-Life-for-Children-in-the-Digital-Age-15-May-2025.pdfPublication-launch-How-is-Life-for-Children-in-the-Digital-Age-15-May-2025.pdf
Publication-launch-How-is-Life-for-Children-in-the-Digital-Age-15-May-2025.pdf
StatsCommunications
 
Lesson 6-Interviewing in SHRM_updated.pdf
Lesson 6-Interviewing in SHRM_updated.pdfLesson 6-Interviewing in SHRM_updated.pdf
Lesson 6-Interviewing in SHRM_updated.pdf
hemelali11
 
AWS-Certified-ML-Engineer-Associate-Slides.pdf
AWS-Certified-ML-Engineer-Associate-Slides.pdfAWS-Certified-ML-Engineer-Associate-Slides.pdf
AWS-Certified-ML-Engineer-Associate-Slides.pdf
philsparkshome
 
Dr. Robert Krug - Expert In Artificial Intelligence
Dr. Robert Krug - Expert In Artificial IntelligenceDr. Robert Krug - Expert In Artificial Intelligence
Dr. Robert Krug - Expert In Artificial Intelligence
Dr. Robert Krug
 
Dynamics 365 Business Rules Dynamics Dynamics
Dynamics 365 Business Rules Dynamics DynamicsDynamics 365 Business Rules Dynamics Dynamics
Dynamics 365 Business Rules Dynamics Dynamics
heyoubro69
 
AI ------------------------------ W1L2.pptx
AI ------------------------------ W1L2.pptxAI ------------------------------ W1L2.pptx
AI ------------------------------ W1L2.pptx
AyeshaJalil6
 
hersh's midterm project.pdf music retail and distribution
hersh's midterm project.pdf music retail and distributionhersh's midterm project.pdf music retail and distribution
hersh's midterm project.pdf music retail and distribution
hershtara1
 
Process Mining as Enabler for Digital Transformations
Process Mining as Enabler for Digital TransformationsProcess Mining as Enabler for Digital Transformations
Process Mining as Enabler for Digital Transformations
Process mining Evangelist
 
Oral Malodor.pptx jsjshdhushehsidjjeiejdhfj
Oral Malodor.pptx jsjshdhushehsidjjeiejdhfjOral Malodor.pptx jsjshdhushehsidjjeiejdhfj
Oral Malodor.pptx jsjshdhushehsidjjeiejdhfj
maitripatel5301
 
Controlling Financial Processes at a Municipality
Controlling Financial Processes at a MunicipalityControlling Financial Processes at a Municipality
Controlling Financial Processes at a Municipality
Process mining Evangelist
 
Sets theories and applications that can used to imporve knowledge
Sets theories and applications that can used to imporve knowledgeSets theories and applications that can used to imporve knowledge
Sets theories and applications that can used to imporve knowledge
saumyasl2020
 
文凭证书美国SDSU文凭圣地亚哥州立大学学生证学历认证查询
文凭证书美国SDSU文凭圣地亚哥州立大学学生证学历认证查询文凭证书美国SDSU文凭圣地亚哥州立大学学生证学历认证查询
文凭证书美国SDSU文凭圣地亚哥州立大学学生证学历认证查询
Taqyea
 
RAG Chatbot using AWS Bedrock and Streamlit Framework
RAG Chatbot using AWS Bedrock and Streamlit FrameworkRAG Chatbot using AWS Bedrock and Streamlit Framework
RAG Chatbot using AWS Bedrock and Streamlit Framework
apanneer
 
Transforming health care with ai powered
Transforming health care with ai poweredTransforming health care with ai powered
Transforming health care with ai powered
gowthamarvj
 
Mining a Global Trade Process with Data Science - Microsoft
Mining a Global Trade Process with Data Science - MicrosoftMining a Global Trade Process with Data Science - Microsoft
Mining a Global Trade Process with Data Science - Microsoft
Process mining Evangelist
 
Process Mining Machine Recoveries to Reduce Downtime
Process Mining Machine Recoveries to Reduce DowntimeProcess Mining Machine Recoveries to Reduce Downtime
Process Mining Machine Recoveries to Reduce Downtime
Process mining Evangelist
 
HershAggregator (2).pdf musicretaildistribution
HershAggregator (2).pdf musicretaildistributionHershAggregator (2).pdf musicretaildistribution
HershAggregator (2).pdf musicretaildistribution
hershtara1
 
Introduction to systems thinking tools_Eng.pdf
Introduction to systems thinking tools_Eng.pdfIntroduction to systems thinking tools_Eng.pdf
Introduction to systems thinking tools_Eng.pdf
AbdurahmanAbd
 
Publication-launch-How-is-Life-for-Children-in-the-Digital-Age-15-May-2025.pdf
Publication-launch-How-is-Life-for-Children-in-the-Digital-Age-15-May-2025.pdfPublication-launch-How-is-Life-for-Children-in-the-Digital-Age-15-May-2025.pdf
Publication-launch-How-is-Life-for-Children-in-the-Digital-Age-15-May-2025.pdf
StatsCommunications
 
Lesson 6-Interviewing in SHRM_updated.pdf
Lesson 6-Interviewing in SHRM_updated.pdfLesson 6-Interviewing in SHRM_updated.pdf
Lesson 6-Interviewing in SHRM_updated.pdf
hemelali11
 
AWS-Certified-ML-Engineer-Associate-Slides.pdf
AWS-Certified-ML-Engineer-Associate-Slides.pdfAWS-Certified-ML-Engineer-Associate-Slides.pdf
AWS-Certified-ML-Engineer-Associate-Slides.pdf
philsparkshome
 
Dr. Robert Krug - Expert In Artificial Intelligence
Dr. Robert Krug - Expert In Artificial IntelligenceDr. Robert Krug - Expert In Artificial Intelligence
Dr. Robert Krug - Expert In Artificial Intelligence
Dr. Robert Krug
 
Dynamics 365 Business Rules Dynamics Dynamics
Dynamics 365 Business Rules Dynamics DynamicsDynamics 365 Business Rules Dynamics Dynamics
Dynamics 365 Business Rules Dynamics Dynamics
heyoubro69
 
AI ------------------------------ W1L2.pptx
AI ------------------------------ W1L2.pptxAI ------------------------------ W1L2.pptx
AI ------------------------------ W1L2.pptx
AyeshaJalil6
 
Ad

Proactive Process Adaptation using Deep Learning Ensembles

  • 1. Proactive Process Adaptation using Deep Learning Ensembles Andreas Metzger, Adrian Neubauer, Philipp Bohn, and Klaus Pohl CAiSE 2019, Roma, MMXIX Bocca della Verità S. Maria in Cosmedin A. Metzger, A. Neubauer, P. Bohn, and K. Pohl, “Proactive process adaptation using deep learning ensembles,” in 31st Int’l Conference on Advanced Information Systems Engineering (CAiSE 2019), Rome, Italy, June 3-7, 2019, ser. LNCS, P. Giorgini and B. Weber, Eds., vol. 11483. Springer, 2019. [Online]. Available: https://doi.org/10.1007/978-3-030-21290-2_34
  • 2. Process completiontCheckpoint j Process start Proactive Process Adaptation “in a Nutshell” BIOC/FAiSE, Roma, MMXIX 2 Monitor Predict Proactive adaptation planned / acceptable situations = Violation = Non- Violation  E.g., Delayed freight delivery E.g., Schedule air instead of land transport E.g., Freight delivery within 2 days Process Performance
  • 3. Agenda 1. Problem Statement and State of the Art 2. Deep Learning Approach 3. Experimental Evaluation 4. Summary and Outlook CAiSE 2019, Roma, MMXIX 3
  • 4. Problem Statement Accuracy • False violations  Unnecessary adaptations • False non-violations  Missed adaptations Earliness • Early predictions  More time for adaptations But: trade-off between accuracy and earliness BIOC/FAiSE, Roma, MMXIX 4 [Teinemaa et al., 2019] BPIC 2017BPIC 2012 [Metzger & Neubauer, 2018] Cargo 2000 Accuracy[MCC] Accuracy[AUC]
  • 5. State of the Art Improve earliness of accurate process predictions • Use additional process data [Teinemaa et al., 2016], [Leontjeva et al., 2015] • Hyper-parameter optimization [Francescomarino et al., 2016] • Clustering [Francescomarino et al., 2018] Early time series classification • Classify with lowest number of data points [Mori et al., 2018], [Petitjean et al., 2014] • Classify considering probability threshold [Mori et al., 2017] Reliability estimates to select earliest prediction • Class probabilities of random forests [Maggi et al., 2014], [Francescomarino et al., 2016] Limitations / Gaps • Probabilities of prediction techniques may be poor reliability estimates [Zhou, 2012]  Deep learning ensembles to estimate individual prediction error • No analysis on usefulness for proactive process adaptation  Experimental analysis of cost savings CAiSE 2019, Roma, MMXIX 5
  • 6. Agenda 1. Problem Statement and State of the Art 2. Deep Learning Approach 3. Experimental Evaluation 4. Summary and Outlook CAiSE 2019, Roma, MMXIX 6
  • 7. Dynamically Deciding on Proactive Adaptation Deep learning ensembles (RNN) to compute reliability estimates 7CAiSE 2019, Roma, MMXIX Process monitoring data at Checkpoint j RNN Model 1 RNN Model m … Ensemble Prediction [Tj = “non-violation”] Proactive Process Adaptation No Proactive Process Adaptation Prediction Tj Reliability estimate j [Tj = “violation”] [j  threshold] [j < threshold]
  • 8. RNNs as Base Learners RNN = Recurrent Neural Network Benefits • High accuracy [Tax et. al. 2017; Evermann et al. 2017, Metzger & Nebauer, 2018] • Arbitrary length process instances (without sequence encoding) • Predictions at any checkpoint Scalability • Long training time  Parallelization  Hardware speedups 8BIOC/FAiSE, Roma, MMXIX Hardware type Training time CPU 25 min GPU (Nvidia CuDNN) 8 min Google TPU (Tensorflow) 2 min
  • 9. Agenda 1. Problem Statement and State of the Art 2. Deep Learning Approach 3. Experimental Evaluation 4. Summary and Outlook CAiSE 2019, Roma, MMXIX 9
  • 10. Experimental Variables Dependent: Cost Independent Relative adaptation costs  • Adaptation cost =  · penalty Reliability threshold  Adaptation effectiveness  •  linearly decreasing over process execution 10CAiSE 2019, Roma, MMXIX Costs = Adaptation Costs Adaptation Costs + Penalty 0 Penalty Violation Non-Violationeffective not effective Violation Non-Violation j  threshold No Proactive Process Adaptation Proactive Process Adaptation j < threshold Tj = “violation” Tj = “non-violation” Prediction Tj
  • 11. Data Sets Four public data sets with different key characteristics 11CAiSE 2019, Roma, MMXIX Cargo2000BPIC2012
  • 13. Results Average cost savings 13CAiSE 2019, Roma, MMXIX 9.2% 27.2% 35.8% 15.1% 27%
  • 14. Agenda 1. Problem Statement and State of the Art 2. Deep Learning Approach 3. Experimental Evaluation 4. Summary and Outlook CAiSE 2019, Roma, MMXIX 14
  • 15. Summary Cost savings when dynamically balancing earliness and accuracy Benefits of dynamic deep learning approach • No need to decide on a fixed checkpoint • No need for testing phase to compute accurate accuracy 15CAiSE 2019, Roma, MMXIX Alarm about Delay Reliability Estimate Real-World Prototype
  • 16. Outlook Extension 1: More complex cost models • Nonlinear costs • Regression (instead of classification) models Extension 2: Advanced reliability estimates • E.g., exploit variance of ensemble [Bosnic & Kononenko, 2008] 16CAiSE 2019, Roma, MMXIX Research leading to these results has received funding from the EU’s Horizon 2020 research and innovation programme under Objective ICT-15 ‘Big Data PPP: Large Scale Pilot Actions ‘ http://www.transformingtransport.eu Thanks!

Editor's Notes

  • #3: 1,16 MEUR für paluno