SlideShare a Scribd company logo
Ocupar el recuadro oscuro con una imagen, y por
encima de esta poner el logotipo de cliente en
blanco y la línea inferior en blanco.
How to Run a Cost-Efficient
Optimization Program
With a Limited Budget
October 2020
BCN
BER
BOG
BUE
GYE
LIM
LON
LYS
MAD
MDE
MEX
MIA
MXP
PMI
SCL
SFO
Who Is With You Today?
Jan Marks
SVP
Customer Success
David Otero
SVP Growth &
Innovation
Deepak Lamba
CRO Leader & Head of
European Business
Let’s talk about ...
Effective
Prioritization
Lean, Agile
Optimization
Flexibility vs.
Fixed Costs
Affordable
Technology
4
20Years
320Experts
750Clients
3KProjects
We are a group of > 300 digital artisans
who create high-converting user experiences
that drive growth and customer satisfaction.
What do we like to be known for?
We are getting things done.
Who is Multiplica?
AboutMultiplica
5
AboutMultiplica
Our clients
6
AboutVWO
About VWO
Companies run their marketing and product experiments on VWO
because we bring together their entire org to conduct
successful A/B tests across the customer lifecycle.
Visit vwo.com/why-us/product/ to know more.
7
How to
prioritize
experiments
effectively
1
8
Effective prioritization requires data.
To focus your efforts on the most promising
opportunities, take a deep dive into your analytics.
and other data sources.
EffectivePrioritization
9
Deeper analysis helps to avoid testing the wrong things
What the
user says
What the user
perceives
How the
user feels
User Research
Analytics & Testing
What the user
does
What most
impacts
behaviour
Predicting what
the user will do
AboutDigitalExperiences
10
Pain points
Touchpoints
Before During After
Step 1 Step 2 Step 3 Step 4 Step 5 Step 6 Step 7 Step 7 Step 3
Stages
User steps
Opportunity
Experience
Understand your user’s journey to identify important opportunities
EffectivePrioritization
11
VWO Insights offers ...
EffectivePrioritization
… first-hand understanding of your customers’ behavior.
Heatmaps Form AnalyticsSession Recording
12
EffectivePrioritization
VWO Insights offers ...
Funnels On-Page Surveys
13
How to set up a
lean and agile
optimization
process
2
14
Efficient optimization requires organization.
A well-defined workflow enables your company to
launch and run an optimization program
with limited resources.
LeanandAgileOptimizationProcess
15
Monthly Sprints
Cost-efficiency requires a lean, agile optimization process
LeanandAgileOptimizationProcess
A well-defined workflow enables your company to launch and run an optimization program with limited resources.
LEGEND
ST: Strategy
AN: Analytics
PM: Project Manager
DEV: Development
QA: Quality Assurance
UX: User Experience
DS: Design
CL: Client
ANALYSIS
ST AN
IDEATION
ST
IDEA EVALUATION
ST PM QA DEV
IDEA
PRIORITIZATION
ST PM CL
QA
QA
EVENTS
AUDIENCES
METRICS
AN
PRE-LAUNCH
VALIDATION
ST PM QA DEV AN
LAUNCH &
MONITOR
PM CL
DESIGN
DS ST
DEV
DEV ST
UX
UX ST
CL
Approval
CL
Approval
16
Avoid too many meetings with too many participants
LeanandAgileOptimizationProcess
Teamwork doesn’t mean that we are in this together all the time. Stick to ownership of specific tasks.
ANALYSIS
ST AN
IDEATION
ST
IDEA EVALUATION
ST PM QA DEV
IDEA
PRIORITIZATION
ST PM CL
QA
QA
EVENTS
AUDIENCES
METRICS
AN
PRE-LAUNCH
VALIDATION
ST PM QA DEV AN
LAUNCH &
MONITOR
PM CL
DESIGN
DS ST
DEV
DEV ST
UX
UX ST
CL
Approval
CL
Approval
Meeting Meeting
Meeting
Meeting
Meeting
Meeting
17
Use specific briefings to avoid loops and unplanned iterations
LeanandAgileOptimizationProcess
Plan ahead, ask for documented input, stick to existing templates and guidelines
CL
ANALYSIS
ST AN
IDEATION
ST
IDEA EVALUATION
ST PM QA DEV
IDEA
PRIORITIZATION
ST PM CL
QA
QA
EVENTS
AUDIENCES
METRICS
AN
PRE-LAUNCH
VALIDATION
ST PM QA DEV AN
LAUNCH &
MONITOR
PM CL
DEV
DEV ST
CL
DS ST
ApprovalDESIGNApproval UX
UX ST
18
Avoid queues and waiting time and keep the momentum
LeanandAgileOptimizationProcess
Get the buy-in and commitment from all departments that contribute to the optimization process
ANALYSIS
ST AN
IDEATION
ST
IDEA EVALUATION
ST PM QA DEV
IDEA
PRIORITIZATION
ST PM CL
DEV
DEV ST
CL
ApprovalDESIGN
DS ST
CL
Approval
EVENTS
AUDIENCES
METRICS
AN
UX
UX ST
QA
QA
Wait
Wait Wait
19
Have a deeper look into your test’s results and refocus if possible
LeanandAgileOptimizationProcess
Don’t give up too early on tests which didn’t deliver the results that you expected: analyze and refocus
CL
ANALYSIS
ST AN
IDEATION
ST
IDEA EVALUATION
ST PM QA DEV
IDEA
PRIORITIZATION
ST PM CL
QA
QA
DEV
DEV ST
UX
UX ST
DESIGN
CL
DS ST
ApprovalApproval
EVENTS
AUDIENCES
METRICS
AN
PRE-LAUNCH
VALIDATION
ST PM QA DEV AN
LAUNCH &
MONITOR
PM CL
ANALYSIS
ST AN
20
How to reduce
fixed costs and
stay flexible
3
21
Successful optimization requires a team with different skills
Project
Manager
Developer QA
Content
Manager
UX/UI DesignerStrategist
Data
Analyst
StayFlexible
22
Your optimization efforts have to fit into your business
Nov Dez Jan Feb Mar Apr
Test Test Test TestTest Test
Test TestTest Test
Test Test
Test
StayFlexible
Both team and technology for testing and optimization should be flexible and scalable
23
How to choose
affordable
technology and
save costs
4
24
AffordableTechnology
Factors to consider
AFFORDABLE TOOLS
- Crazyegg: for heatmap
snapshots of your landing
pages.
- Hotjar: for heatmaps and
recordings, surveys for
measured as pageviews.
- Survey Monkey: Collecting
feedback both on-page and
off-page
- User Testing: for conducting
usability testing and video
interviews in a cost-effective
manner
FREE TOOLS
- Mixpanel, Kissmetrics, Heap,
Amplitude: for getting deeper
insights into events, free for a
limited number of sessions.
- Google Optimize: for getting
simple experiments live,
limited to 3 objectives per
experiment and 5 concurrent
experiments.
- Optimizely Rollouts: free for
developers for feature
flagging, useful for developers,
limited to 1 experiment
ALL-in-ONE Platform
- VWO Insights and Testing:
Connected platform which
brings Heatmaps, Recordings,
Form Analysis and Surveys along
with Experimentation.
Backward connectivity of Funnel
events with Heatmaps and
Recordings for pre- optimization
analysis.
Experimentation connects back
with Insights for post-campaign
analysis.
VWO Plan helps in connecting
hypothesis with experiments
and maintain a learning
repository.
25
AffordableTechnology
Factors to consider
● Not just about the cost of the software - Design, Dev,
Operations et al. teams are involved.
● Flexibility - Be able to easily make changes on-the-go without
running to dev team every time.
● Support - Experimentation isn’t an easy process. You need
dedicated all-day support to help you out of tricky situations.
● Services - Hire an expert outside your team to recommend
improvements and execute them as well.
26
AffordableTechnology
Benefits
● Gives you the velocity - Moving at speed is okay but velocity
shows you the direction.
Fail/Win fast. Learn immediately. Adapt quickly.
● Platform to manage it all - Disconnected tools can result in
data disparity. Gathering, testing, analysing, and iterating on
data under one roof improves understanding of the customer.
● Happy leadership :)
How to Run a Cost-Efficient Optimization Program With a Limited Budget
Ad

More Related Content

What's hot (20)

Making Your Hypothesis Work Harder to Inform Future Product Strategy
Making Your Hypothesis Work Harder to Inform Future Product StrategyMaking Your Hypothesis Work Harder to Inform Future Product Strategy
Making Your Hypothesis Work Harder to Inform Future Product Strategy
Optimizely
 
Product Experimentation Pitfalls & How to Avoid Them
Product Experimentation Pitfalls & How to Avoid Them Product Experimentation Pitfalls & How to Avoid Them
Product Experimentation Pitfalls & How to Avoid Them
Optimizely
 
The Science of Getting Testing Right
The Science of Getting Testing RightThe Science of Getting Testing Right
The Science of Getting Testing Right
Optimizely
 
[CXL Live 16] SaaS Optimization - Effective Metrics, Process and Hacks by Ste...
[CXL Live 16] SaaS Optimization - Effective Metrics, Process and Hacks by Ste...[CXL Live 16] SaaS Optimization - Effective Metrics, Process and Hacks by Ste...
[CXL Live 16] SaaS Optimization - Effective Metrics, Process and Hacks by Ste...
CXL
 
Digital Gaggle | September 2017 SEO Conference | Stephen Pavlovich 'Applying ...
Digital Gaggle | September 2017 SEO Conference | Stephen Pavlovich 'Applying ...Digital Gaggle | September 2017 SEO Conference | Stephen Pavlovich 'Applying ...
Digital Gaggle | September 2017 SEO Conference | Stephen Pavlovich 'Applying ...
Noisy Little Monkey
 
Introduction
IntroductionIntroduction
Introduction
Jez Humble
 
Continuous Improvement
Continuous ImprovementContinuous Improvement
Continuous Improvement
Jez Humble
 
A/B Testing with Yammer's Product Manager
A/B Testing with Yammer's Product ManagerA/B Testing with Yammer's Product Manager
A/B Testing with Yammer's Product Manager
Product School
 
Better Decisions with Experimentation
Better Decisions with ExperimentationBetter Decisions with Experimentation
Better Decisions with Experimentation
Jill Martay
 
Managing Work
Managing WorkManaging Work
Managing Work
Jez Humble
 
REV UP 360: Rev up your ROI with Conversion Testing - Andy Batten
REV UP 360: Rev up your ROI with Conversion Testing - Andy BattenREV UP 360: Rev up your ROI with Conversion Testing - Andy Batten
REV UP 360: Rev up your ROI with Conversion Testing - Andy Batten
AMA Colorado
 
Move Fast in the Age of Uncertainty
Move Fast in the Age of UncertaintyMove Fast in the Age of Uncertainty
Move Fast in the Age of Uncertainty
Optimizely
 
Better Living Through Analytics - Strategies for Data Decisions
Better Living Through Analytics - Strategies for Data DecisionsBetter Living Through Analytics - Strategies for Data Decisions
Better Living Through Analytics - Strategies for Data Decisions
Product School
 
Experimentation at Blue Apron (webinar)
Experimentation at Blue Apron (webinar)Experimentation at Blue Apron (webinar)
Experimentation at Blue Apron (webinar)
Optimizely
 
Testing Across the Enterprise: How Cox Automotive Scales Experimentation to M...
Testing Across the Enterprise: How Cox Automotive Scales Experimentation to M...Testing Across the Enterprise: How Cox Automotive Scales Experimentation to M...
Testing Across the Enterprise: How Cox Automotive Scales Experimentation to M...
Optimizely
 
Introducing Program Management
Introducing Program ManagementIntroducing Program Management
Introducing Program Management
Optimizely
 
Conducting the Experimentation Orchestra
Conducting the Experimentation OrchestraConducting the Experimentation Orchestra
Conducting the Experimentation Orchestra
Optimizely
 
Intro to A/B Testing by Spark Networks former Sr. Product Manager
Intro to A/B Testing by Spark Networks former Sr. Product ManagerIntro to A/B Testing by Spark Networks former Sr. Product Manager
Intro to A/B Testing by Spark Networks former Sr. Product Manager
Product School
 
How to Build Amazing Products by PayPal Director of Product
How to Build Amazing Products by PayPal Director of ProductHow to Build Amazing Products by PayPal Director of Product
How to Build Amazing Products by PayPal Director of Product
Product School
 
[Webinar] Innovate Faster by Adopting The Modern Growth Stack
[Webinar] Innovate Faster by Adopting The Modern Growth Stack[Webinar] Innovate Faster by Adopting The Modern Growth Stack
[Webinar] Innovate Faster by Adopting The Modern Growth Stack
Optimizely
 
Making Your Hypothesis Work Harder to Inform Future Product Strategy
Making Your Hypothesis Work Harder to Inform Future Product StrategyMaking Your Hypothesis Work Harder to Inform Future Product Strategy
Making Your Hypothesis Work Harder to Inform Future Product Strategy
Optimizely
 
Product Experimentation Pitfalls & How to Avoid Them
Product Experimentation Pitfalls & How to Avoid Them Product Experimentation Pitfalls & How to Avoid Them
Product Experimentation Pitfalls & How to Avoid Them
Optimizely
 
The Science of Getting Testing Right
The Science of Getting Testing RightThe Science of Getting Testing Right
The Science of Getting Testing Right
Optimizely
 
[CXL Live 16] SaaS Optimization - Effective Metrics, Process and Hacks by Ste...
[CXL Live 16] SaaS Optimization - Effective Metrics, Process and Hacks by Ste...[CXL Live 16] SaaS Optimization - Effective Metrics, Process and Hacks by Ste...
[CXL Live 16] SaaS Optimization - Effective Metrics, Process and Hacks by Ste...
CXL
 
Digital Gaggle | September 2017 SEO Conference | Stephen Pavlovich 'Applying ...
Digital Gaggle | September 2017 SEO Conference | Stephen Pavlovich 'Applying ...Digital Gaggle | September 2017 SEO Conference | Stephen Pavlovich 'Applying ...
Digital Gaggle | September 2017 SEO Conference | Stephen Pavlovich 'Applying ...
Noisy Little Monkey
 
Continuous Improvement
Continuous ImprovementContinuous Improvement
Continuous Improvement
Jez Humble
 
A/B Testing with Yammer's Product Manager
A/B Testing with Yammer's Product ManagerA/B Testing with Yammer's Product Manager
A/B Testing with Yammer's Product Manager
Product School
 
Better Decisions with Experimentation
Better Decisions with ExperimentationBetter Decisions with Experimentation
Better Decisions with Experimentation
Jill Martay
 
REV UP 360: Rev up your ROI with Conversion Testing - Andy Batten
REV UP 360: Rev up your ROI with Conversion Testing - Andy BattenREV UP 360: Rev up your ROI with Conversion Testing - Andy Batten
REV UP 360: Rev up your ROI with Conversion Testing - Andy Batten
AMA Colorado
 
Move Fast in the Age of Uncertainty
Move Fast in the Age of UncertaintyMove Fast in the Age of Uncertainty
Move Fast in the Age of Uncertainty
Optimizely
 
Better Living Through Analytics - Strategies for Data Decisions
Better Living Through Analytics - Strategies for Data DecisionsBetter Living Through Analytics - Strategies for Data Decisions
Better Living Through Analytics - Strategies for Data Decisions
Product School
 
Experimentation at Blue Apron (webinar)
Experimentation at Blue Apron (webinar)Experimentation at Blue Apron (webinar)
Experimentation at Blue Apron (webinar)
Optimizely
 
Testing Across the Enterprise: How Cox Automotive Scales Experimentation to M...
Testing Across the Enterprise: How Cox Automotive Scales Experimentation to M...Testing Across the Enterprise: How Cox Automotive Scales Experimentation to M...
Testing Across the Enterprise: How Cox Automotive Scales Experimentation to M...
Optimizely
 
Introducing Program Management
Introducing Program ManagementIntroducing Program Management
Introducing Program Management
Optimizely
 
Conducting the Experimentation Orchestra
Conducting the Experimentation OrchestraConducting the Experimentation Orchestra
Conducting the Experimentation Orchestra
Optimizely
 
Intro to A/B Testing by Spark Networks former Sr. Product Manager
Intro to A/B Testing by Spark Networks former Sr. Product ManagerIntro to A/B Testing by Spark Networks former Sr. Product Manager
Intro to A/B Testing by Spark Networks former Sr. Product Manager
Product School
 
How to Build Amazing Products by PayPal Director of Product
How to Build Amazing Products by PayPal Director of ProductHow to Build Amazing Products by PayPal Director of Product
How to Build Amazing Products by PayPal Director of Product
Product School
 
[Webinar] Innovate Faster by Adopting The Modern Growth Stack
[Webinar] Innovate Faster by Adopting The Modern Growth Stack[Webinar] Innovate Faster by Adopting The Modern Growth Stack
[Webinar] Innovate Faster by Adopting The Modern Growth Stack
Optimizely
 

Similar to How to Run a Cost-Efficient Optimization Program With a Limited Budget (20)

Optimizely Product Vision: The Future of Experimentation
Optimizely Product Vision: The Future of ExperimentationOptimizely Product Vision: The Future of Experimentation
Optimizely Product Vision: The Future of Experimentation
Optimizely
 
Building a Culture of Experimentation at HP
Building a Culture of Experimentation at HPBuilding a Culture of Experimentation at HP
Building a Culture of Experimentation at HP
Optimizely
 
Unifying feature management with experiments - Server Side Webinar (1).pdf
Unifying feature management with experiments - Server Side Webinar (1).pdfUnifying feature management with experiments - Server Side Webinar (1).pdf
Unifying feature management with experiments - Server Side Webinar (1).pdf
VWO
 
Lean Discussions About Agile and MVP
Lean Discussions About Agile and MVPLean Discussions About Agile and MVP
Lean Discussions About Agile and MVP
Aleks Yenin
 
Lean discussions about agile and mvp
Lean discussions about agile and mvpLean discussions about agile and mvp
Lean discussions about agile and mvp
Polontech LLC
 
How We Do It: Proven Website Personalization Strategies
How We Do It: Proven Website Personalization StrategiesHow We Do It: Proven Website Personalization Strategies
How We Do It: Proven Website Personalization Strategies
Optimizely
 
Tech-Talk Tuesday: How to Develop and Grow Your Optimization Efforts Into a S...
Tech-Talk Tuesday: How to Develop and Grow Your Optimization Efforts Into a S...Tech-Talk Tuesday: How to Develop and Grow Your Optimization Efforts Into a S...
Tech-Talk Tuesday: How to Develop and Grow Your Optimization Efforts Into a S...
Daniel Caridi
 
How FOX Tests Everything from Mobile, Web, to Living Room Devices
How FOX Tests Everything from Mobile, Web, to Living Room DevicesHow FOX Tests Everything from Mobile, Web, to Living Room Devices
How FOX Tests Everything from Mobile, Web, to Living Room Devices
Optimizely
 
What is PPC+AUX in 2019 eng
What is PPC+AUX in 2019 engWhat is PPC+AUX in 2019 eng
What is PPC+AUX in 2019 eng
Stratton Analytic Company
 
Acting Like a Top 25 Salesforce ISV: How Appinium Applies Buyer's and Seller'...
Acting Like a Top 25 Salesforce ISV: How Appinium Applies Buyer's and Seller'...Acting Like a Top 25 Salesforce ISV: How Appinium Applies Buyer's and Seller'...
Acting Like a Top 25 Salesforce ISV: How Appinium Applies Buyer's and Seller'...
CodeScience
 
Greetings david cutler inform and connect
Greetings   david cutler inform and connectGreetings   david cutler inform and connect
Greetings david cutler inform and connect
Sales Strategy and Innovation Delivery
 
Greetings david cutler inform and connect
Greetings   david cutler inform and connectGreetings   david cutler inform and connect
Greetings david cutler inform and connect
Sales Strategy and Innovation Delivery
 
Adobe Business.pptx
Adobe Business.pptxAdobe Business.pptx
Adobe Business.pptx
Ankush Kapil
 
Greetings david cutler inform and connect
Greetings   david cutler inform and connectGreetings   david cutler inform and connect
Greetings david cutler inform and connect
Sales Strategy and Innovation Delivery
 
Product Development Demystified: Launching Faster with Confidence through Hum...
Product Development Demystified: Launching Faster with Confidence through Hum...Product Development Demystified: Launching Faster with Confidence through Hum...
Product Development Demystified: Launching Faster with Confidence through Hum...
Aggregage
 
Dataiku tatvic webinar presentation
Dataiku tatvic webinar presentationDataiku tatvic webinar presentation
Dataiku tatvic webinar presentation
Tatvic Analytics
 
Copilot Webinar with product demo videos (1).pdf
Copilot Webinar with product demo videos (1).pdfCopilot Webinar with product demo videos (1).pdf
Copilot Webinar with product demo videos (1).pdf
VWO
 
SAP Process Mining in Action: Hear from Two Customers
SAP Process Mining in Action: Hear from Two CustomersSAP Process Mining in Action: Hear from Two Customers
SAP Process Mining in Action: Hear from Two Customers
Celonis
 
Degordian
DegordianDegordian
Degordian
Dubravko Opašić
 
Agile and data driven product development oleh Dhiku VP Product KMK Online
Agile and data driven product development oleh Dhiku VP Product KMK OnlineAgile and data driven product development oleh Dhiku VP Product KMK Online
Agile and data driven product development oleh Dhiku VP Product KMK Online
Rein Mahatma
 
Optimizely Product Vision: The Future of Experimentation
Optimizely Product Vision: The Future of ExperimentationOptimizely Product Vision: The Future of Experimentation
Optimizely Product Vision: The Future of Experimentation
Optimizely
 
Building a Culture of Experimentation at HP
Building a Culture of Experimentation at HPBuilding a Culture of Experimentation at HP
Building a Culture of Experimentation at HP
Optimizely
 
Unifying feature management with experiments - Server Side Webinar (1).pdf
Unifying feature management with experiments - Server Side Webinar (1).pdfUnifying feature management with experiments - Server Side Webinar (1).pdf
Unifying feature management with experiments - Server Side Webinar (1).pdf
VWO
 
Lean Discussions About Agile and MVP
Lean Discussions About Agile and MVPLean Discussions About Agile and MVP
Lean Discussions About Agile and MVP
Aleks Yenin
 
Lean discussions about agile and mvp
Lean discussions about agile and mvpLean discussions about agile and mvp
Lean discussions about agile and mvp
Polontech LLC
 
How We Do It: Proven Website Personalization Strategies
How We Do It: Proven Website Personalization StrategiesHow We Do It: Proven Website Personalization Strategies
How We Do It: Proven Website Personalization Strategies
Optimizely
 
Tech-Talk Tuesday: How to Develop and Grow Your Optimization Efforts Into a S...
Tech-Talk Tuesday: How to Develop and Grow Your Optimization Efforts Into a S...Tech-Talk Tuesday: How to Develop and Grow Your Optimization Efforts Into a S...
Tech-Talk Tuesday: How to Develop and Grow Your Optimization Efforts Into a S...
Daniel Caridi
 
How FOX Tests Everything from Mobile, Web, to Living Room Devices
How FOX Tests Everything from Mobile, Web, to Living Room DevicesHow FOX Tests Everything from Mobile, Web, to Living Room Devices
How FOX Tests Everything from Mobile, Web, to Living Room Devices
Optimizely
 
Acting Like a Top 25 Salesforce ISV: How Appinium Applies Buyer's and Seller'...
Acting Like a Top 25 Salesforce ISV: How Appinium Applies Buyer's and Seller'...Acting Like a Top 25 Salesforce ISV: How Appinium Applies Buyer's and Seller'...
Acting Like a Top 25 Salesforce ISV: How Appinium Applies Buyer's and Seller'...
CodeScience
 
Adobe Business.pptx
Adobe Business.pptxAdobe Business.pptx
Adobe Business.pptx
Ankush Kapil
 
Product Development Demystified: Launching Faster with Confidence through Hum...
Product Development Demystified: Launching Faster with Confidence through Hum...Product Development Demystified: Launching Faster with Confidence through Hum...
Product Development Demystified: Launching Faster with Confidence through Hum...
Aggregage
 
Dataiku tatvic webinar presentation
Dataiku tatvic webinar presentationDataiku tatvic webinar presentation
Dataiku tatvic webinar presentation
Tatvic Analytics
 
Copilot Webinar with product demo videos (1).pdf
Copilot Webinar with product demo videos (1).pdfCopilot Webinar with product demo videos (1).pdf
Copilot Webinar with product demo videos (1).pdf
VWO
 
SAP Process Mining in Action: Hear from Two Customers
SAP Process Mining in Action: Hear from Two CustomersSAP Process Mining in Action: Hear from Two Customers
SAP Process Mining in Action: Hear from Two Customers
Celonis
 
Agile and data driven product development oleh Dhiku VP Product KMK Online
Agile and data driven product development oleh Dhiku VP Product KMK OnlineAgile and data driven product development oleh Dhiku VP Product KMK Online
Agile and data driven product development oleh Dhiku VP Product KMK Online
Rein Mahatma
 
Ad

More from VWO (20)

2025-04 - VWO Webinar - Alignment and Focus_ The Key to Delivering Business I...
2025-04 - VWO Webinar - Alignment and Focus_ The Key to Delivering Business I...2025-04 - VWO Webinar - Alignment and Focus_ The Key to Delivering Business I...
2025-04 - VWO Webinar - Alignment and Focus_ The Key to Delivering Business I...
VWO
 
The Experimenter’s Guide to eCommerce Growth
The Experimenter’s Guide to eCommerce GrowthThe Experimenter’s Guide to eCommerce Growth
The Experimenter’s Guide to eCommerce Growth
VWO
 
What 10,000 A/B Tests Reveal About Your Online Store
What 10,000 A/B Tests Reveal About Your Online StoreWhat 10,000 A/B Tests Reveal About Your Online Store
What 10,000 A/B Tests Reveal About Your Online Store
VWO
 
From Click to Call: Creating Landing Pages that Actually Convert to Sales Call
From Click to Call: Creating Landing Pages that Actually Convert to Sales CallFrom Click to Call: Creating Landing Pages that Actually Convert to Sales Call
From Click to Call: Creating Landing Pages that Actually Convert to Sales Call
VWO
 
Winners vs. Losers_ The New Rules of eCommerce Success - Webinar (1) (1).pdf
Winners vs. Losers_ The New Rules of eCommerce Success - Webinar (1) (1).pdfWinners vs. Losers_ The New Rules of eCommerce Success - Webinar (1) (1).pdf
Winners vs. Losers_ The New Rules of eCommerce Success - Webinar (1) (1).pdf
VWO
 
Real-time Behavior Prediction: The Missing Link in UX Experimentation
Real-time Behavior Prediction: The Missing Link in UX ExperimentationReal-time Behavior Prediction: The Missing Link in UX Experimentation
Real-time Behavior Prediction: The Missing Link in UX Experimentation
VWO
 
5 Myths that Stop you from running more experiments
5 Myths that Stop you from running more experiments5 Myths that Stop you from running more experiments
5 Myths that Stop you from running more experiments
VWO
 
VWO Webinar: Are You Covering the Basics?
VWO Webinar: Are You Covering the Basics?VWO Webinar: Are You Covering the Basics?
VWO Webinar: Are You Covering the Basics?
VWO
 
Por qué tus tests de e-commerce siguen fallando (y cómo solucionarlo)
Por qué tus tests de e-commerce siguen fallando (y cómo solucionarlo)Por qué tus tests de e-commerce siguen fallando (y cómo solucionarlo)
Por qué tus tests de e-commerce siguen fallando (y cómo solucionarlo)
VWO
 
From Data to Decisions: How AI is Reshaping User Behavior Analysis & Cont...
From Data to Decisions: How AI is Reshaping User Behavior Analysis & Cont...From Data to Decisions: How AI is Reshaping User Behavior Analysis & Cont...
From Data to Decisions: How AI is Reshaping User Behavior Analysis & Cont...
VWO
 
Cómo optimizar el embudo de conversión de tu tienda: Insights y estrategias p...
Cómo optimizar el embudo de conversión de tu tienda: Insights y estrategias p...Cómo optimizar el embudo de conversión de tu tienda: Insights y estrategias p...
Cómo optimizar el embudo de conversión de tu tienda: Insights y estrategias p...
VWO
 
EXT - Intersection Between AB Testing and Incrementality - VWO Webinar Dec 20...
EXT - Intersection Between AB Testing and Incrementality - VWO Webinar Dec 20...EXT - Intersection Between AB Testing and Incrementality - VWO Webinar Dec 20...
EXT - Intersection Between AB Testing and Incrementality - VWO Webinar Dec 20...
VWO
 
Supercharge Your HubSpot CRM: Unlocking Advanced CRO Capabilities with VWO In...
Supercharge Your HubSpot CRM: Unlocking Advanced CRO Capabilities with VWO In...Supercharge Your HubSpot CRM: Unlocking Advanced CRO Capabilities with VWO In...
Supercharge Your HubSpot CRM: Unlocking Advanced CRO Capabilities with VWO In...
VWO
 
La oleada de ventas navideñas: Una guía de experimentación para mayores conve...
La oleada de ventas navideñas: Una guía de experimentación para mayores conve...La oleada de ventas navideñas: Una guía de experimentación para mayores conve...
La oleada de ventas navideñas: Una guía de experimentación para mayores conve...
VWO
 
Maximizing Revenue with A/B Testing During Black Friday & Cyber Monday: O...
Maximizing Revenue with A/B Testing During Black Friday & Cyber Monday: O...Maximizing Revenue with A/B Testing During Black Friday & Cyber Monday: O...
Maximizing Revenue with A/B Testing During Black Friday & Cyber Monday: O...
VWO
 
Use CRO Like the Pros_Modus_VWO_111324 (1).pdf
Use CRO Like the Pros_Modus_VWO_111324 (1).pdfUse CRO Like the Pros_Modus_VWO_111324 (1).pdf
Use CRO Like the Pros_Modus_VWO_111324 (1).pdf
VWO
 
Heatmaps: Visualizing User Engagement for Maximum Conversions | VWO Webinars
Heatmaps: Visualizing User Engagement for Maximum Conversions | VWO WebinarsHeatmaps: Visualizing User Engagement for Maximum Conversions | VWO Webinars
Heatmaps: Visualizing User Engagement for Maximum Conversions | VWO Webinars
VWO
 
Understanding What Your Visitors Truly Want Using VWO Insights - Web _ Webina...
Understanding What Your Visitors Truly Want Using VWO Insights - Web _ Webina...Understanding What Your Visitors Truly Want Using VWO Insights - Web _ Webina...
Understanding What Your Visitors Truly Want Using VWO Insights - Web _ Webina...
VWO
 
From OKRs To Strategic Experimentation - Masters of Conversion 2024 - Bjarn B...
From OKRs To Strategic Experimentation - Masters of Conversion 2024 - Bjarn B...From OKRs To Strategic Experimentation - Masters of Conversion 2024 - Bjarn B...
From OKRs To Strategic Experimentation - Masters of Conversion 2024 - Bjarn B...
VWO
 
The No-Budget Conversion Blueprint: Leveraging What You Already Own
The No-Budget Conversion Blueprint: Leveraging What You Already OwnThe No-Budget Conversion Blueprint: Leveraging What You Already Own
The No-Budget Conversion Blueprint: Leveraging What You Already Own
VWO
 
2025-04 - VWO Webinar - Alignment and Focus_ The Key to Delivering Business I...
2025-04 - VWO Webinar - Alignment and Focus_ The Key to Delivering Business I...2025-04 - VWO Webinar - Alignment and Focus_ The Key to Delivering Business I...
2025-04 - VWO Webinar - Alignment and Focus_ The Key to Delivering Business I...
VWO
 
The Experimenter’s Guide to eCommerce Growth
The Experimenter’s Guide to eCommerce GrowthThe Experimenter’s Guide to eCommerce Growth
The Experimenter’s Guide to eCommerce Growth
VWO
 
What 10,000 A/B Tests Reveal About Your Online Store
What 10,000 A/B Tests Reveal About Your Online StoreWhat 10,000 A/B Tests Reveal About Your Online Store
What 10,000 A/B Tests Reveal About Your Online Store
VWO
 
From Click to Call: Creating Landing Pages that Actually Convert to Sales Call
From Click to Call: Creating Landing Pages that Actually Convert to Sales CallFrom Click to Call: Creating Landing Pages that Actually Convert to Sales Call
From Click to Call: Creating Landing Pages that Actually Convert to Sales Call
VWO
 
Winners vs. Losers_ The New Rules of eCommerce Success - Webinar (1) (1).pdf
Winners vs. Losers_ The New Rules of eCommerce Success - Webinar (1) (1).pdfWinners vs. Losers_ The New Rules of eCommerce Success - Webinar (1) (1).pdf
Winners vs. Losers_ The New Rules of eCommerce Success - Webinar (1) (1).pdf
VWO
 
Real-time Behavior Prediction: The Missing Link in UX Experimentation
Real-time Behavior Prediction: The Missing Link in UX ExperimentationReal-time Behavior Prediction: The Missing Link in UX Experimentation
Real-time Behavior Prediction: The Missing Link in UX Experimentation
VWO
 
5 Myths that Stop you from running more experiments
5 Myths that Stop you from running more experiments5 Myths that Stop you from running more experiments
5 Myths that Stop you from running more experiments
VWO
 
VWO Webinar: Are You Covering the Basics?
VWO Webinar: Are You Covering the Basics?VWO Webinar: Are You Covering the Basics?
VWO Webinar: Are You Covering the Basics?
VWO
 
Por qué tus tests de e-commerce siguen fallando (y cómo solucionarlo)
Por qué tus tests de e-commerce siguen fallando (y cómo solucionarlo)Por qué tus tests de e-commerce siguen fallando (y cómo solucionarlo)
Por qué tus tests de e-commerce siguen fallando (y cómo solucionarlo)
VWO
 
From Data to Decisions: How AI is Reshaping User Behavior Analysis & Cont...
From Data to Decisions: How AI is Reshaping User Behavior Analysis & Cont...From Data to Decisions: How AI is Reshaping User Behavior Analysis & Cont...
From Data to Decisions: How AI is Reshaping User Behavior Analysis & Cont...
VWO
 
Cómo optimizar el embudo de conversión de tu tienda: Insights y estrategias p...
Cómo optimizar el embudo de conversión de tu tienda: Insights y estrategias p...Cómo optimizar el embudo de conversión de tu tienda: Insights y estrategias p...
Cómo optimizar el embudo de conversión de tu tienda: Insights y estrategias p...
VWO
 
EXT - Intersection Between AB Testing and Incrementality - VWO Webinar Dec 20...
EXT - Intersection Between AB Testing and Incrementality - VWO Webinar Dec 20...EXT - Intersection Between AB Testing and Incrementality - VWO Webinar Dec 20...
EXT - Intersection Between AB Testing and Incrementality - VWO Webinar Dec 20...
VWO
 
Supercharge Your HubSpot CRM: Unlocking Advanced CRO Capabilities with VWO In...
Supercharge Your HubSpot CRM: Unlocking Advanced CRO Capabilities with VWO In...Supercharge Your HubSpot CRM: Unlocking Advanced CRO Capabilities with VWO In...
Supercharge Your HubSpot CRM: Unlocking Advanced CRO Capabilities with VWO In...
VWO
 
La oleada de ventas navideñas: Una guía de experimentación para mayores conve...
La oleada de ventas navideñas: Una guía de experimentación para mayores conve...La oleada de ventas navideñas: Una guía de experimentación para mayores conve...
La oleada de ventas navideñas: Una guía de experimentación para mayores conve...
VWO
 
Maximizing Revenue with A/B Testing During Black Friday & Cyber Monday: O...
Maximizing Revenue with A/B Testing During Black Friday & Cyber Monday: O...Maximizing Revenue with A/B Testing During Black Friday & Cyber Monday: O...
Maximizing Revenue with A/B Testing During Black Friday & Cyber Monday: O...
VWO
 
Use CRO Like the Pros_Modus_VWO_111324 (1).pdf
Use CRO Like the Pros_Modus_VWO_111324 (1).pdfUse CRO Like the Pros_Modus_VWO_111324 (1).pdf
Use CRO Like the Pros_Modus_VWO_111324 (1).pdf
VWO
 
Heatmaps: Visualizing User Engagement for Maximum Conversions | VWO Webinars
Heatmaps: Visualizing User Engagement for Maximum Conversions | VWO WebinarsHeatmaps: Visualizing User Engagement for Maximum Conversions | VWO Webinars
Heatmaps: Visualizing User Engagement for Maximum Conversions | VWO Webinars
VWO
 
Understanding What Your Visitors Truly Want Using VWO Insights - Web _ Webina...
Understanding What Your Visitors Truly Want Using VWO Insights - Web _ Webina...Understanding What Your Visitors Truly Want Using VWO Insights - Web _ Webina...
Understanding What Your Visitors Truly Want Using VWO Insights - Web _ Webina...
VWO
 
From OKRs To Strategic Experimentation - Masters of Conversion 2024 - Bjarn B...
From OKRs To Strategic Experimentation - Masters of Conversion 2024 - Bjarn B...From OKRs To Strategic Experimentation - Masters of Conversion 2024 - Bjarn B...
From OKRs To Strategic Experimentation - Masters of Conversion 2024 - Bjarn B...
VWO
 
The No-Budget Conversion Blueprint: Leveraging What You Already Own
The No-Budget Conversion Blueprint: Leveraging What You Already OwnThe No-Budget Conversion Blueprint: Leveraging What You Already Own
The No-Budget Conversion Blueprint: Leveraging What You Already Own
VWO
 
Ad

Recently uploaded (20)

The SEO Lifecycle: Lessons from the Past, Strategies for the Future
The SEO Lifecycle: Lessons from the Past, Strategies for the FutureThe SEO Lifecycle: Lessons from the Past, Strategies for the Future
The SEO Lifecycle: Lessons from the Past, Strategies for the Future
Lily Ray
 
Top 7 eCommerce Marketing Strategies.pdf
Top 7 eCommerce Marketing Strategies.pdfTop 7 eCommerce Marketing Strategies.pdf
Top 7 eCommerce Marketing Strategies.pdf
Zinavo Pvt Ltd
 
Lights, Camera, Market: Mastering Video Marketing for Digital Success
Lights, Camera, Market: Mastering Video Marketing for Digital SuccessLights, Camera, Market: Mastering Video Marketing for Digital Success
Lights, Camera, Market: Mastering Video Marketing for Digital Success
DineshSharma343466
 
📘 Best Email Marketing Service_ Step-by-Step Guide.pdf
📘 Best Email Marketing Service_ Step-by-Step Guide.pdf📘 Best Email Marketing Service_ Step-by-Step Guide.pdf
📘 Best Email Marketing Service_ Step-by-Step Guide.pdf
pckhetal
 
Beyond the Pain Points: A More Meaningful Customer Journey
Beyond the Pain Points: A More Meaningful Customer JourneyBeyond the Pain Points: A More Meaningful Customer Journey
Beyond the Pain Points: A More Meaningful Customer Journey
Odyyc
 
Unlocking Customer Engagement with WhatsApp Business API
Unlocking Customer Engagement with WhatsApp Business APIUnlocking Customer Engagement with WhatsApp Business API
Unlocking Customer Engagement with WhatsApp Business API
G Tech Web Marketing
 
Newsletter Data Breakdown 2025. - AZoNetworkpdf
Newsletter Data Breakdown 2025. - AZoNetworkpdfNewsletter Data Breakdown 2025. - AZoNetworkpdf
Newsletter Data Breakdown 2025. - AZoNetworkpdf
Frank Barker
 
I Can! Kids Marketing Plan - SAMPLE Marketing Plan
I Can! Kids Marketing Plan - SAMPLE Marketing PlanI Can! Kids Marketing Plan - SAMPLE Marketing Plan
I Can! Kids Marketing Plan - SAMPLE Marketing Plan
Wahiba Chair Training & Consulting
 
Digital Reviver - Digital marketing agency in Noida
Digital Reviver - Digital marketing agency in NoidaDigital Reviver - Digital marketing agency in Noida
Digital Reviver - Digital marketing agency in Noida
Digital Reviver
 
The 10 Best Tips to Get SoundCloud Likes & Grow Your Profile Fast.pdf
The 10 Best Tips to Get SoundCloud Likes & Grow Your Profile Fast.pdfThe 10 Best Tips to Get SoundCloud Likes & Grow Your Profile Fast.pdf
The 10 Best Tips to Get SoundCloud Likes & Grow Your Profile Fast.pdf
Sociofire
 
How brands can use memes to connect with younger audiences.pdf
How brands can use memes to connect with younger audiences.pdfHow brands can use memes to connect with younger audiences.pdf
How brands can use memes to connect with younger audiences.pdf
iM4U Digital Marketing Agency
 
Facebook vs. Instagram Ads: What Should You Use In 2025 ?
Facebook vs. Instagram Ads: What Should You Use In 2025 ?Facebook vs. Instagram Ads: What Should You Use In 2025 ?
Facebook vs. Instagram Ads: What Should You Use In 2025 ?
mkarora0303
 
UNIT 4- PH MARKETING( the marketing management process in the drug industry).pdf
UNIT 4- PH MARKETING( the marketing management process in the drug industry).pdfUNIT 4- PH MARKETING( the marketing management process in the drug industry).pdf
UNIT 4- PH MARKETING( the marketing management process in the drug industry).pdf
necklejadeolis
 
Get client sites EAA-ready: Accessibility best practices for agencies
Get client sites EAA-ready: Accessibility best practices for agenciesGet client sites EAA-ready: Accessibility best practices for agencies
Get client sites EAA-ready: Accessibility best practices for agencies
Anton Shulke
 
Get client sites EAA-ready: Accessibility best practices for agencies
Get client sites EAA-ready: Accessibility best practices for agenciesGet client sites EAA-ready: Accessibility best practices for agencies
Get client sites EAA-ready: Accessibility best practices for agencies
Anton Shulke
 
Welcome to the World of Social Media Marketing: A Beginner's Guide to SMM Suc...
Welcome to the World of Social Media Marketing: A Beginner's Guide to SMM Suc...Welcome to the World of Social Media Marketing: A Beginner's Guide to SMM Suc...
Welcome to the World of Social Media Marketing: A Beginner's Guide to SMM Suc...
DineshSharma343466
 
AEC Websites That Recruit & Retain Talent
AEC Websites That Recruit & Retain TalentAEC Websites That Recruit & Retain Talent
AEC Websites That Recruit & Retain Talent
David Lecours
 
SWOT ANALYSIS MARKETING STRATEGY OC FERREL
SWOT ANALYSIS MARKETING STRATEGY OC FERRELSWOT ANALYSIS MARKETING STRATEGY OC FERREL
SWOT ANALYSIS MARKETING STRATEGY OC FERREL
FatimahAzzahro59
 
Super AI Review: The First SuperModel™ Uniting Every AI Model Ever Created in...
Super AI Review: The First SuperModel™ Uniting Every AI Model Ever Created in...Super AI Review: The First SuperModel™ Uniting Every AI Model Ever Created in...
Super AI Review: The First SuperModel™ Uniting Every AI Model Ever Created in...
SOFTTECHHUB
 
Cracking LinkedIn's Algorithm in 2025 to up your content game.
Cracking LinkedIn's Algorithm in 2025 to up your content game.Cracking LinkedIn's Algorithm in 2025 to up your content game.
Cracking LinkedIn's Algorithm in 2025 to up your content game.
Udit Goenka
 
The SEO Lifecycle: Lessons from the Past, Strategies for the Future
The SEO Lifecycle: Lessons from the Past, Strategies for the FutureThe SEO Lifecycle: Lessons from the Past, Strategies for the Future
The SEO Lifecycle: Lessons from the Past, Strategies for the Future
Lily Ray
 
Top 7 eCommerce Marketing Strategies.pdf
Top 7 eCommerce Marketing Strategies.pdfTop 7 eCommerce Marketing Strategies.pdf
Top 7 eCommerce Marketing Strategies.pdf
Zinavo Pvt Ltd
 
Lights, Camera, Market: Mastering Video Marketing for Digital Success
Lights, Camera, Market: Mastering Video Marketing for Digital SuccessLights, Camera, Market: Mastering Video Marketing for Digital Success
Lights, Camera, Market: Mastering Video Marketing for Digital Success
DineshSharma343466
 
📘 Best Email Marketing Service_ Step-by-Step Guide.pdf
📘 Best Email Marketing Service_ Step-by-Step Guide.pdf📘 Best Email Marketing Service_ Step-by-Step Guide.pdf
📘 Best Email Marketing Service_ Step-by-Step Guide.pdf
pckhetal
 
Beyond the Pain Points: A More Meaningful Customer Journey
Beyond the Pain Points: A More Meaningful Customer JourneyBeyond the Pain Points: A More Meaningful Customer Journey
Beyond the Pain Points: A More Meaningful Customer Journey
Odyyc
 
Unlocking Customer Engagement with WhatsApp Business API
Unlocking Customer Engagement with WhatsApp Business APIUnlocking Customer Engagement with WhatsApp Business API
Unlocking Customer Engagement with WhatsApp Business API
G Tech Web Marketing
 
Newsletter Data Breakdown 2025. - AZoNetworkpdf
Newsletter Data Breakdown 2025. - AZoNetworkpdfNewsletter Data Breakdown 2025. - AZoNetworkpdf
Newsletter Data Breakdown 2025. - AZoNetworkpdf
Frank Barker
 
Digital Reviver - Digital marketing agency in Noida
Digital Reviver - Digital marketing agency in NoidaDigital Reviver - Digital marketing agency in Noida
Digital Reviver - Digital marketing agency in Noida
Digital Reviver
 
The 10 Best Tips to Get SoundCloud Likes & Grow Your Profile Fast.pdf
The 10 Best Tips to Get SoundCloud Likes & Grow Your Profile Fast.pdfThe 10 Best Tips to Get SoundCloud Likes & Grow Your Profile Fast.pdf
The 10 Best Tips to Get SoundCloud Likes & Grow Your Profile Fast.pdf
Sociofire
 
How brands can use memes to connect with younger audiences.pdf
How brands can use memes to connect with younger audiences.pdfHow brands can use memes to connect with younger audiences.pdf
How brands can use memes to connect with younger audiences.pdf
iM4U Digital Marketing Agency
 
Facebook vs. Instagram Ads: What Should You Use In 2025 ?
Facebook vs. Instagram Ads: What Should You Use In 2025 ?Facebook vs. Instagram Ads: What Should You Use In 2025 ?
Facebook vs. Instagram Ads: What Should You Use In 2025 ?
mkarora0303
 
UNIT 4- PH MARKETING( the marketing management process in the drug industry).pdf
UNIT 4- PH MARKETING( the marketing management process in the drug industry).pdfUNIT 4- PH MARKETING( the marketing management process in the drug industry).pdf
UNIT 4- PH MARKETING( the marketing management process in the drug industry).pdf
necklejadeolis
 
Get client sites EAA-ready: Accessibility best practices for agencies
Get client sites EAA-ready: Accessibility best practices for agenciesGet client sites EAA-ready: Accessibility best practices for agencies
Get client sites EAA-ready: Accessibility best practices for agencies
Anton Shulke
 
Get client sites EAA-ready: Accessibility best practices for agencies
Get client sites EAA-ready: Accessibility best practices for agenciesGet client sites EAA-ready: Accessibility best practices for agencies
Get client sites EAA-ready: Accessibility best practices for agencies
Anton Shulke
 
Welcome to the World of Social Media Marketing: A Beginner's Guide to SMM Suc...
Welcome to the World of Social Media Marketing: A Beginner's Guide to SMM Suc...Welcome to the World of Social Media Marketing: A Beginner's Guide to SMM Suc...
Welcome to the World of Social Media Marketing: A Beginner's Guide to SMM Suc...
DineshSharma343466
 
AEC Websites That Recruit & Retain Talent
AEC Websites That Recruit & Retain TalentAEC Websites That Recruit & Retain Talent
AEC Websites That Recruit & Retain Talent
David Lecours
 
SWOT ANALYSIS MARKETING STRATEGY OC FERREL
SWOT ANALYSIS MARKETING STRATEGY OC FERRELSWOT ANALYSIS MARKETING STRATEGY OC FERREL
SWOT ANALYSIS MARKETING STRATEGY OC FERREL
FatimahAzzahro59
 
Super AI Review: The First SuperModel™ Uniting Every AI Model Ever Created in...
Super AI Review: The First SuperModel™ Uniting Every AI Model Ever Created in...Super AI Review: The First SuperModel™ Uniting Every AI Model Ever Created in...
Super AI Review: The First SuperModel™ Uniting Every AI Model Ever Created in...
SOFTTECHHUB
 
Cracking LinkedIn's Algorithm in 2025 to up your content game.
Cracking LinkedIn's Algorithm in 2025 to up your content game.Cracking LinkedIn's Algorithm in 2025 to up your content game.
Cracking LinkedIn's Algorithm in 2025 to up your content game.
Udit Goenka
 

How to Run a Cost-Efficient Optimization Program With a Limited Budget

  • 1. Ocupar el recuadro oscuro con una imagen, y por encima de esta poner el logotipo de cliente en blanco y la línea inferior en blanco. How to Run a Cost-Efficient Optimization Program With a Limited Budget October 2020 BCN BER BOG BUE GYE LIM LON LYS MAD MDE MEX MIA MXP PMI SCL SFO
  • 2. Who Is With You Today? Jan Marks SVP Customer Success David Otero SVP Growth & Innovation Deepak Lamba CRO Leader & Head of European Business
  • 3. Let’s talk about ... Effective Prioritization Lean, Agile Optimization Flexibility vs. Fixed Costs Affordable Technology
  • 4. 4 20Years 320Experts 750Clients 3KProjects We are a group of > 300 digital artisans who create high-converting user experiences that drive growth and customer satisfaction. What do we like to be known for? We are getting things done. Who is Multiplica? AboutMultiplica
  • 6. 6 AboutVWO About VWO Companies run their marketing and product experiments on VWO because we bring together their entire org to conduct successful A/B tests across the customer lifecycle. Visit vwo.com/why-us/product/ to know more.
  • 8. 8 Effective prioritization requires data. To focus your efforts on the most promising opportunities, take a deep dive into your analytics. and other data sources. EffectivePrioritization
  • 9. 9 Deeper analysis helps to avoid testing the wrong things What the user says What the user perceives How the user feels User Research Analytics & Testing What the user does What most impacts behaviour Predicting what the user will do AboutDigitalExperiences
  • 10. 10 Pain points Touchpoints Before During After Step 1 Step 2 Step 3 Step 4 Step 5 Step 6 Step 7 Step 7 Step 3 Stages User steps Opportunity Experience Understand your user’s journey to identify important opportunities EffectivePrioritization
  • 11. 11 VWO Insights offers ... EffectivePrioritization … first-hand understanding of your customers’ behavior. Heatmaps Form AnalyticsSession Recording
  • 12. 12 EffectivePrioritization VWO Insights offers ... Funnels On-Page Surveys
  • 13. 13 How to set up a lean and agile optimization process 2
  • 14. 14 Efficient optimization requires organization. A well-defined workflow enables your company to launch and run an optimization program with limited resources. LeanandAgileOptimizationProcess
  • 15. 15 Monthly Sprints Cost-efficiency requires a lean, agile optimization process LeanandAgileOptimizationProcess A well-defined workflow enables your company to launch and run an optimization program with limited resources. LEGEND ST: Strategy AN: Analytics PM: Project Manager DEV: Development QA: Quality Assurance UX: User Experience DS: Design CL: Client ANALYSIS ST AN IDEATION ST IDEA EVALUATION ST PM QA DEV IDEA PRIORITIZATION ST PM CL QA QA EVENTS AUDIENCES METRICS AN PRE-LAUNCH VALIDATION ST PM QA DEV AN LAUNCH & MONITOR PM CL DESIGN DS ST DEV DEV ST UX UX ST CL Approval CL Approval
  • 16. 16 Avoid too many meetings with too many participants LeanandAgileOptimizationProcess Teamwork doesn’t mean that we are in this together all the time. Stick to ownership of specific tasks. ANALYSIS ST AN IDEATION ST IDEA EVALUATION ST PM QA DEV IDEA PRIORITIZATION ST PM CL QA QA EVENTS AUDIENCES METRICS AN PRE-LAUNCH VALIDATION ST PM QA DEV AN LAUNCH & MONITOR PM CL DESIGN DS ST DEV DEV ST UX UX ST CL Approval CL Approval Meeting Meeting Meeting Meeting Meeting Meeting
  • 17. 17 Use specific briefings to avoid loops and unplanned iterations LeanandAgileOptimizationProcess Plan ahead, ask for documented input, stick to existing templates and guidelines CL ANALYSIS ST AN IDEATION ST IDEA EVALUATION ST PM QA DEV IDEA PRIORITIZATION ST PM CL QA QA EVENTS AUDIENCES METRICS AN PRE-LAUNCH VALIDATION ST PM QA DEV AN LAUNCH & MONITOR PM CL DEV DEV ST CL DS ST ApprovalDESIGNApproval UX UX ST
  • 18. 18 Avoid queues and waiting time and keep the momentum LeanandAgileOptimizationProcess Get the buy-in and commitment from all departments that contribute to the optimization process ANALYSIS ST AN IDEATION ST IDEA EVALUATION ST PM QA DEV IDEA PRIORITIZATION ST PM CL DEV DEV ST CL ApprovalDESIGN DS ST CL Approval EVENTS AUDIENCES METRICS AN UX UX ST QA QA Wait Wait Wait
  • 19. 19 Have a deeper look into your test’s results and refocus if possible LeanandAgileOptimizationProcess Don’t give up too early on tests which didn’t deliver the results that you expected: analyze and refocus CL ANALYSIS ST AN IDEATION ST IDEA EVALUATION ST PM QA DEV IDEA PRIORITIZATION ST PM CL QA QA DEV DEV ST UX UX ST DESIGN CL DS ST ApprovalApproval EVENTS AUDIENCES METRICS AN PRE-LAUNCH VALIDATION ST PM QA DEV AN LAUNCH & MONITOR PM CL ANALYSIS ST AN
  • 20. 20 How to reduce fixed costs and stay flexible 3
  • 21. 21 Successful optimization requires a team with different skills Project Manager Developer QA Content Manager UX/UI DesignerStrategist Data Analyst StayFlexible
  • 22. 22 Your optimization efforts have to fit into your business Nov Dez Jan Feb Mar Apr Test Test Test TestTest Test Test TestTest Test Test Test Test StayFlexible Both team and technology for testing and optimization should be flexible and scalable
  • 24. 24 AffordableTechnology Factors to consider AFFORDABLE TOOLS - Crazyegg: for heatmap snapshots of your landing pages. - Hotjar: for heatmaps and recordings, surveys for measured as pageviews. - Survey Monkey: Collecting feedback both on-page and off-page - User Testing: for conducting usability testing and video interviews in a cost-effective manner FREE TOOLS - Mixpanel, Kissmetrics, Heap, Amplitude: for getting deeper insights into events, free for a limited number of sessions. - Google Optimize: for getting simple experiments live, limited to 3 objectives per experiment and 5 concurrent experiments. - Optimizely Rollouts: free for developers for feature flagging, useful for developers, limited to 1 experiment ALL-in-ONE Platform - VWO Insights and Testing: Connected platform which brings Heatmaps, Recordings, Form Analysis and Surveys along with Experimentation. Backward connectivity of Funnel events with Heatmaps and Recordings for pre- optimization analysis. Experimentation connects back with Insights for post-campaign analysis. VWO Plan helps in connecting hypothesis with experiments and maintain a learning repository.
  • 25. 25 AffordableTechnology Factors to consider ● Not just about the cost of the software - Design, Dev, Operations et al. teams are involved. ● Flexibility - Be able to easily make changes on-the-go without running to dev team every time. ● Support - Experimentation isn’t an easy process. You need dedicated all-day support to help you out of tricky situations. ● Services - Hire an expert outside your team to recommend improvements and execute them as well.
  • 26. 26 AffordableTechnology Benefits ● Gives you the velocity - Moving at speed is okay but velocity shows you the direction. Fail/Win fast. Learn immediately. Adapt quickly. ● Platform to manage it all - Disconnected tools can result in data disparity. Gathering, testing, analysing, and iterating on data under one roof improves understanding of the customer. ● Happy leadership :)