SlideShare a Scribd company logo
1
Sara Tresch
SVP, Digital Services
Charles Schwab
Experimentation
through Client Eyes
Charles SchwabInformation classification here (Public for events content)2
“There’s always another new
idea, another convention to
challenge, a million ways to
make investing better. We
just need to do it”
Charles Schwab, Invested 2019
Charles Schwab
Enablers Proof Points Opportunities
Information classification here (Public for events content)3
Today’s Discussion
Charles Schwab
Enablers
Information classification here (Public for events content)4
Charles Schwab
Start with a Holistic Experience
End to End
Clients come to you with a job to do.
They experience your brand thru many
different touchpoints, and an experience
design should start with this in mind.
Front to Back
Front to back experience design can be
a win-win-win. Save time for clients,
higher value rep interactions, and
operational scale.
Charles Schwab
Get it right for the Client
Information classification here (Public for events content)6
Help & Guidance Minutes Saved Client Easy Score Get Invested
A simple, focused approach creates clarity
Learn Fast to Act Fast
Continuous Discovery
Openness to change
Cross functional ideation
Client-centric goals
Continuous Delivery
Understand the hypothesis
Radical Collaboration
Ongoing Experimentation
Continuous Measurement
Deliver a Minimal Viable Solution
Fast response to client needs
Iterations based on client data
Charles Schwab
Proof Points
Information classification here (Public for events content)8
Charles Schwab
Accelerate Quality and Time
9
MVP Launch
70% Client Easy 94%
2 Design sprints 5
8 Dev sprints 2
Old Way New Way
Highly
volatile, lots of
rework
Better design that
clients LOVE
Client
frustration
Charles Schwab10
Unlock Cross Channel
Feedback Fridays
Multi-year build for B2B Experience
Recurring front line and user feedback
=> Ongoing delivery to clients and service team
=> Opportunity backlog
=> Feeds launched software tests
Charles Schwab11
Explore Big Questions…
How do we serve clients better in
digital?
“Our Digital Transformation simply means serving clients better!
That’s it. No Spin. No Complexities.”
- Walt Bettinger, President and CEO, Charles Schwab
Charles Schwab
…And Answer themFidelity&TestingValue
Storyboards
Medium # of variations
Hand Drawn Flows
Very high # of variations
Refined Screen Flows
High # of variations
Low-Fidelity Mockups
Very high # of variations
Medium-Fidelity Screens
High # of variations
Design Prototypes
Medium # of variations
Coded Prototype
Low # of variations
A/B testing
Minor Variations
Prototype Value Curve
Team ‘1’ Continuous Discovery
Charles Schwab
Opportunities
Information classification here (Public for events content)13
14
Opportunities
We are early in this journey
End to end
Experimentation
1
Turn insights into
Action
2
Improve speed
on every team
3
Empathy at Scale
4

More Related Content

PDF
Evolving Experimentation from CRO to Product Development
Optimizely
 
PDF
Run High Impact Experimentation with High-quality Customer Discovery
Optimizely
 
PPTX
Test Everything: TrustRadius Delivers Customer Value with Experimentation
Optimizely
 
PPTX
Making Your Hypothesis Work Harder to Inform Future Product Strategy
Optimizely
 
PPTX
Empowering Agents to Provide Service from Anywhere: Contact Centers in the Ti...
Optimizely
 
PDF
Getting Started with Server-Side Testing
Optimizely
 
PPTX
An Experimentation Framework: How to Position for Triple Digit Growth
Optimizely
 
PPTX
Zillow + Optimizely: Building the Bridge to $20 Billion Revenue
Optimizely
 
Evolving Experimentation from CRO to Product Development
Optimizely
 
Run High Impact Experimentation with High-quality Customer Discovery
Optimizely
 
Test Everything: TrustRadius Delivers Customer Value with Experimentation
Optimizely
 
Making Your Hypothesis Work Harder to Inform Future Product Strategy
Optimizely
 
Empowering Agents to Provide Service from Anywhere: Contact Centers in the Ti...
Optimizely
 
Getting Started with Server-Side Testing
Optimizely
 
An Experimentation Framework: How to Position for Triple Digit Growth
Optimizely
 
Zillow + Optimizely: Building the Bridge to $20 Billion Revenue
Optimizely
 

What's hot (20)

PDF
Introducing Program Management
Optimizely
 
PDF
[Webinar] Innovate Faster by Adopting The Modern Growth Stack
Optimizely
 
PDF
Cultivating a Culture of Experimentation
Optimizely
 
PDF
World Class Optimization: Benchmarking 1,000+ Companies
Optimizely
 
PPTX
How To Build a Winning Experimentation Program & Team | Optimizely ANZ Webinar 8
Optimizely
 
PDF
Opticon 2017 Decisions at Scale
Optimizely
 
PDF
Optimizely for Developers
Optimizely
 
PPTX
Optimizely Demo Deck
Mattharth
 
PPTX
Losing is the New Winning
Optimizely
 
PDF
Definition of A/B testing and Case Studies by Optimizely
RusseWeb
 
PDF
Optimizely x Live Demo
Optimizely
 
PDF
Intuit - How to Scale Your Experimentation Program
Optimizely
 
PDF
Maximizing Optimizely Website Performance
Optimizely
 
PPTX
Make Every Touchpoint Count: How to Drive Revenue in an Increasingly Online W...
Optimizely
 
PDF
How Clorox Experiments Across Brands to Turn Visitors into Consumers
Optimizely
 
PPTX
Triple Your Experiment Velocity by Integrating Optimizely with Your Data Ware...
Optimizely
 
PDF
Under the Hood Webinar Series: B2B Experimentation & Personalization at Optim...
Optimizely
 
PPTX
Optimizely, HEMA & Farfetch - Unlock the Potential of Digital Experimentation...
Optimizely
 
PDF
Content Targeting and Personalization: Improving Engagement at the Account Level
G3 Communications
 
PPTX
Testing Your Testing Program
Jill Martay
 
Introducing Program Management
Optimizely
 
[Webinar] Innovate Faster by Adopting The Modern Growth Stack
Optimizely
 
Cultivating a Culture of Experimentation
Optimizely
 
World Class Optimization: Benchmarking 1,000+ Companies
Optimizely
 
How To Build a Winning Experimentation Program & Team | Optimizely ANZ Webinar 8
Optimizely
 
Opticon 2017 Decisions at Scale
Optimizely
 
Optimizely for Developers
Optimizely
 
Optimizely Demo Deck
Mattharth
 
Losing is the New Winning
Optimizely
 
Definition of A/B testing and Case Studies by Optimizely
RusseWeb
 
Optimizely x Live Demo
Optimizely
 
Intuit - How to Scale Your Experimentation Program
Optimizely
 
Maximizing Optimizely Website Performance
Optimizely
 
Make Every Touchpoint Count: How to Drive Revenue in an Increasingly Online W...
Optimizely
 
How Clorox Experiments Across Brands to Turn Visitors into Consumers
Optimizely
 
Triple Your Experiment Velocity by Integrating Optimizely with Your Data Ware...
Optimizely
 
Under the Hood Webinar Series: B2B Experimentation & Personalization at Optim...
Optimizely
 
Optimizely, HEMA & Farfetch - Unlock the Potential of Digital Experimentation...
Optimizely
 
Content Targeting and Personalization: Improving Engagement at the Account Level
G3 Communications
 
Testing Your Testing Program
Jill Martay
 
Ad

Similar to Experimentation through Clients' Eyes (20)

PDF
Customer Experience Trends - Abstract and Bio
Steve Dorfman
 
PDF
Web Analytics Wednesday April 2020 - Customer Journey Mapping
Jason Packer
 
PPTX
Understanding and Managing the Service Profit Chain | Aegis Global Academy
Aegis Global Academy
 
PDF
Gerent spotlight - Reinventing the Insurance Customer Journey
The Digital Insurer
 
PPTX
Eptica_CCExpo_Workshop_Making the Case for Contact Centre Investment_2013
Eptica UK Ltd
 
PDF
7 CX Lessons For A Successful Digital Transformation
Tata Consultancy Services
 
PDF
7 cx-lessons-final
Swagatika Nanda
 
PPTX
8 User Experiences to Build an Effective Experimentation Program_VWO_Workshop
VWO
 
PDF
UX STRAT 2014: Tim Loo's Workshop - Experience Visioning & Roadmapping
Tim Loo
 
PPTX
The customer journey, digital transformation, and you
Jason Bloomberg
 
PDF
CH&Co - Customer experience in payments - 2015
Ekaterina Diakonova
 
PDF
Harnessing the Value of UX
Jason Ulaszek
 
PPTX
Customer Experience Excellence
Chantel Botha
 
PPT
Scottrade and Understanding the Customer Journey: When Segmentation Isn’t Enough
Effective
 
PDF
Accenture: Bennet Harvey
GamePlanConference
 
PDF
Customer Driven Digital Transformation
cxpartners
 
PPTX
A Blueprint for Customer Value Management in the New Economy | Microsoft & in...
Antony Adelaar
 
PDF
Customer Centric Discovery
Salesforce Partners
 
PDF
customer-centricity-in-insurance-industry
Praveen Manjunath
 
PDF
Building Customer Experience
Harsha MV
 
Customer Experience Trends - Abstract and Bio
Steve Dorfman
 
Web Analytics Wednesday April 2020 - Customer Journey Mapping
Jason Packer
 
Understanding and Managing the Service Profit Chain | Aegis Global Academy
Aegis Global Academy
 
Gerent spotlight - Reinventing the Insurance Customer Journey
The Digital Insurer
 
Eptica_CCExpo_Workshop_Making the Case for Contact Centre Investment_2013
Eptica UK Ltd
 
7 CX Lessons For A Successful Digital Transformation
Tata Consultancy Services
 
7 cx-lessons-final
Swagatika Nanda
 
8 User Experiences to Build an Effective Experimentation Program_VWO_Workshop
VWO
 
UX STRAT 2014: Tim Loo's Workshop - Experience Visioning & Roadmapping
Tim Loo
 
The customer journey, digital transformation, and you
Jason Bloomberg
 
CH&Co - Customer experience in payments - 2015
Ekaterina Diakonova
 
Harnessing the Value of UX
Jason Ulaszek
 
Customer Experience Excellence
Chantel Botha
 
Scottrade and Understanding the Customer Journey: When Segmentation Isn’t Enough
Effective
 
Accenture: Bennet Harvey
GamePlanConference
 
Customer Driven Digital Transformation
cxpartners
 
A Blueprint for Customer Value Management in the New Economy | Microsoft & in...
Antony Adelaar
 
Customer Centric Discovery
Salesforce Partners
 
customer-centricity-in-insurance-industry
Praveen Manjunath
 
Building Customer Experience
Harsha MV
 
Ad

More from Optimizely (20)

PDF
Clover Rings Up Digital Growth to Drive Experimentation
Optimizely
 
PPTX
The Science of Getting Testing Right
Optimizely
 
PDF
Atlassian's Mystique CLI, Minimizing the Experiment Development Cycle
Optimizely
 
PPTX
Autotrader Case Study: Migrating from Home-Grown Testing to Best-in-Class Too...
Optimizely
 
PDF
The Future of Optimizely for Technical Teams
Optimizely
 
PPTX
Experimentation Everywhere: Create Exceptional Online Shopping Experiences an...
Optimizely
 
PDF
Building an Experiment Pipeline for GitHub’s New Free Team Offering
Optimizely
 
PPTX
AMC Networks Experiments Faster on the Server Side
Optimizely
 
PDF
Overcoming the Challenges of Experimentation on a Service Oriented Architecture
Optimizely
 
PPTX
How The Zebra Utilized Feature Experiments To Increase Carrier Card Engagemen...
Optimizely
 
PPTX
Kick Your Assumptions: How Scholl's Test-Everything Culture Drives Revenue
Optimizely
 
PPTX
Shipping to Learn and Accelerate Growth with GitHub
Optimizely
 
PDF
Optimizely Agent: Scaling Resilient Feature Delivery
Optimizely
 
PDF
The Future of Software Development
Optimizely
 
PPTX
Practical Use Case: How Dosh Uses Feature Experiments To Accelerate Mobile De...
Optimizely
 
PDF
Using Empathy to Build Custom Solutions at Scale
Optimizely
 
PPTX
How to find data insights that will drive a 10X impact
Optimizely
 
PPTX
Targeted Rollouts: How to Release Features to Multiple Audiences
Optimizely
 
PDF
Deploying Fearlessly in a Continuous World
Optimizely
 
PPTX
Detecting incorrectly implemented experiments
Optimizely
 
Clover Rings Up Digital Growth to Drive Experimentation
Optimizely
 
The Science of Getting Testing Right
Optimizely
 
Atlassian's Mystique CLI, Minimizing the Experiment Development Cycle
Optimizely
 
Autotrader Case Study: Migrating from Home-Grown Testing to Best-in-Class Too...
Optimizely
 
The Future of Optimizely for Technical Teams
Optimizely
 
Experimentation Everywhere: Create Exceptional Online Shopping Experiences an...
Optimizely
 
Building an Experiment Pipeline for GitHub’s New Free Team Offering
Optimizely
 
AMC Networks Experiments Faster on the Server Side
Optimizely
 
Overcoming the Challenges of Experimentation on a Service Oriented Architecture
Optimizely
 
How The Zebra Utilized Feature Experiments To Increase Carrier Card Engagemen...
Optimizely
 
Kick Your Assumptions: How Scholl's Test-Everything Culture Drives Revenue
Optimizely
 
Shipping to Learn and Accelerate Growth with GitHub
Optimizely
 
Optimizely Agent: Scaling Resilient Feature Delivery
Optimizely
 
The Future of Software Development
Optimizely
 
Practical Use Case: How Dosh Uses Feature Experiments To Accelerate Mobile De...
Optimizely
 
Using Empathy to Build Custom Solutions at Scale
Optimizely
 
How to find data insights that will drive a 10X impact
Optimizely
 
Targeted Rollouts: How to Release Features to Multiple Audiences
Optimizely
 
Deploying Fearlessly in a Continuous World
Optimizely
 
Detecting incorrectly implemented experiments
Optimizely
 

Recently uploaded (20)

PPTX
Presentation of Computer CLASS 2 .pptx
darshilchaudhary558
 
PPTX
Presentation about variables and constant.pptx
safalsingh810
 
PDF
49784907924775488180_LRN2959_Data_Pump_23ai.pdf
Abilash868456
 
PDF
Appium Automation Testing Tutorial PDF: Learn Mobile Testing in 7 Days
jamescantor38
 
PDF
49785682629390197565_LRN3014_Migrating_the_Beast.pdf
Abilash868456
 
DOCX
The Future of Smart Factories Why Embedded Analytics Leads the Way
Varsha Nayak
 
PDF
The Role of Automation and AI in EHS Management for Data Centers.pdf
TECH EHS Solution
 
PPTX
PFAS Reporting Requirements 2026 Are You Submission Ready Certivo.pptx
Certivo Inc
 
PDF
lesson-2-rules-of-netiquette.pdf.bshhsjdj
jasmenrojas249
 
PDF
How to Seamlessly Integrate Salesforce Data Cloud with Marketing Cloud.pdf
NSIQINFOTECH
 
PDF
Become an Agentblazer Champion Challenge
Dele Amefo
 
PPTX
oapresentation.pptx
mehatdhavalrajubhai
 
PDF
advancepresentationskillshdhdhhdhdhdhhfhf
jasmenrojas249
 
PPTX
Odoo Integration Services by Candidroot Solutions
CandidRoot Solutions Private Limited
 
PPTX
ConcordeApp: Engineering Global Impact & Unlocking Billions in Event ROI with AI
chastechaste14
 
PDF
Protecting the Digital World Cyber Securit
dnthakkar16
 
PDF
Jenkins: An open-source automation server powering CI/CD Automation
SaikatBasu37
 
PDF
Multi-factor Authentication (MFA) requirement for Microsoft 365 Admin Center_...
Q-Advise
 
PPTX
Web Testing.pptx528278vshbuqffqhhqiwnwuq
studylike474
 
PPTX
TestNG for Java Testing and Automation testing
ssuser0213cb
 
Presentation of Computer CLASS 2 .pptx
darshilchaudhary558
 
Presentation about variables and constant.pptx
safalsingh810
 
49784907924775488180_LRN2959_Data_Pump_23ai.pdf
Abilash868456
 
Appium Automation Testing Tutorial PDF: Learn Mobile Testing in 7 Days
jamescantor38
 
49785682629390197565_LRN3014_Migrating_the_Beast.pdf
Abilash868456
 
The Future of Smart Factories Why Embedded Analytics Leads the Way
Varsha Nayak
 
The Role of Automation and AI in EHS Management for Data Centers.pdf
TECH EHS Solution
 
PFAS Reporting Requirements 2026 Are You Submission Ready Certivo.pptx
Certivo Inc
 
lesson-2-rules-of-netiquette.pdf.bshhsjdj
jasmenrojas249
 
How to Seamlessly Integrate Salesforce Data Cloud with Marketing Cloud.pdf
NSIQINFOTECH
 
Become an Agentblazer Champion Challenge
Dele Amefo
 
oapresentation.pptx
mehatdhavalrajubhai
 
advancepresentationskillshdhdhhdhdhdhhfhf
jasmenrojas249
 
Odoo Integration Services by Candidroot Solutions
CandidRoot Solutions Private Limited
 
ConcordeApp: Engineering Global Impact & Unlocking Billions in Event ROI with AI
chastechaste14
 
Protecting the Digital World Cyber Securit
dnthakkar16
 
Jenkins: An open-source automation server powering CI/CD Automation
SaikatBasu37
 
Multi-factor Authentication (MFA) requirement for Microsoft 365 Admin Center_...
Q-Advise
 
Web Testing.pptx528278vshbuqffqhhqiwnwuq
studylike474
 
TestNG for Java Testing and Automation testing
ssuser0213cb
 

Experimentation through Clients' Eyes

  • 1. 1 Sara Tresch SVP, Digital Services Charles Schwab Experimentation through Client Eyes
  • 2. Charles SchwabInformation classification here (Public for events content)2 “There’s always another new idea, another convention to challenge, a million ways to make investing better. We just need to do it” Charles Schwab, Invested 2019
  • 3. Charles Schwab Enablers Proof Points Opportunities Information classification here (Public for events content)3 Today’s Discussion
  • 4. Charles Schwab Enablers Information classification here (Public for events content)4
  • 5. Charles Schwab Start with a Holistic Experience End to End Clients come to you with a job to do. They experience your brand thru many different touchpoints, and an experience design should start with this in mind. Front to Back Front to back experience design can be a win-win-win. Save time for clients, higher value rep interactions, and operational scale.
  • 6. Charles Schwab Get it right for the Client Information classification here (Public for events content)6 Help & Guidance Minutes Saved Client Easy Score Get Invested A simple, focused approach creates clarity
  • 7. Learn Fast to Act Fast Continuous Discovery Openness to change Cross functional ideation Client-centric goals Continuous Delivery Understand the hypothesis Radical Collaboration Ongoing Experimentation Continuous Measurement Deliver a Minimal Viable Solution Fast response to client needs Iterations based on client data
  • 8. Charles Schwab Proof Points Information classification here (Public for events content)8
  • 9. Charles Schwab Accelerate Quality and Time 9 MVP Launch 70% Client Easy 94% 2 Design sprints 5 8 Dev sprints 2 Old Way New Way Highly volatile, lots of rework Better design that clients LOVE Client frustration
  • 10. Charles Schwab10 Unlock Cross Channel Feedback Fridays Multi-year build for B2B Experience Recurring front line and user feedback => Ongoing delivery to clients and service team => Opportunity backlog => Feeds launched software tests
  • 11. Charles Schwab11 Explore Big Questions… How do we serve clients better in digital? “Our Digital Transformation simply means serving clients better! That’s it. No Spin. No Complexities.” - Walt Bettinger, President and CEO, Charles Schwab
  • 12. Charles Schwab …And Answer themFidelity&TestingValue Storyboards Medium # of variations Hand Drawn Flows Very high # of variations Refined Screen Flows High # of variations Low-Fidelity Mockups Very high # of variations Medium-Fidelity Screens High # of variations Design Prototypes Medium # of variations Coded Prototype Low # of variations A/B testing Minor Variations Prototype Value Curve Team ‘1’ Continuous Discovery
  • 13. Charles Schwab Opportunities Information classification here (Public for events content)13
  • 14. 14 Opportunities We are early in this journey End to end Experimentation 1 Turn insights into Action 2 Improve speed on every team 3 Empathy at Scale 4