SlideShare a Scribd company logo
Velocity NY

A Short History of
Performance Engineering
Alexander Podelko
alex.podelko@oracle.com
alexanderpodelko.com/blog
@apodelko

October 14, 2013
1
About Me


I have specialized in performance for the last
16 years



Currently performance testing and
optimization of Hyperion products at Oracle



Board director at CMG http://cmg.org, organization
of performance and capacity professionals
– Conference November 4-8, 2013 in La Jolla, CA

Disclaimer: The views expressed here are my personal views only and do not necessarily represent those of my
current or previous employers. All brands and trademarks mentioned are the property of their owners.
2
There Was [Performance]
Life Even Before Web


Some statements referring to history look
incorrect



Performance engineering history is not well
known
– Not much information readily available



So I decided to share a few bits of
information I know / found
3
The Approach


First mature appearances of still relevant
performance notions
– From what I found
– No discussion about further rich history of each
notion



My subjective choices based on very limited
information

4
Computing Paradigms


Looks like a new wave of performance
engineering starts 10+ years after new
computing paradigm



Mainframes
– Late 50s



Distributed Systems
– Late 70s



Web
– Mid 90s



? – Mobile, Cloud
5
1966: Instrumentation


1966 – SMF (System Management
Facilities) released as part of OS/360
– Still in use

Big

Data ?

Deep

Diagnostics ?
IT

Operations
Analytics ?

6
1968: Response Times


1968 - Robert Miller (IBM) in his "Response
Time in Man-Computer Conversational
Transactions" paper described several
threshold levels of human attention
– Widely cited by many later researchers

7
1974: Monitoring


1974 – RMF (Resource Measurement
Facility) released as part of MVS
– Still in use



1975 – OMEGAMON for MVS by Candle
– Claimed to be the first real-time monitor
– Acquired by IBM in 2004

8
1975: Community


1975 – The Computer Measurement Group
(CMG) was created, holding annual
conferences since
– Coming Performance and Capacity 2013 by CMG
November 4-8 in La Jolla, CA
http://cmg.org/conference/cmg2013/
– Proceedings available to public (1976-2010)
http://cmg.org/proceedings/

9
1977: Performance Analysis
Tool


1977 – BEST/1 was released by BGS Systems,
capacity and performance management tool
– the first commercial package for computer
performance analysis to be based on analytic
models.
BGS

Systems
was acquired by
BMC Software in
1998

10
Late 70s - Distributed
Systems


Distributed Systems
– Client/Server, Three-Tier, N-Tier,
etc.



Less control, less
instrumentation



More need for performance
design and testing
11
1990: Software Performance
Engineering


1990 – Dr. Connie Smith's book
Performance Engineering of Software
Systems was published
– 15 pages of bibliography

"Fix-it-later was once a
viable approach, but it is
now inappropriate and
dangerous"
12
Does It Remind You
Anything?


Fix-it-later was a viable approach in the
1970s, but today the original promises no
longer hold, and fix-it-later is archaic and
dangerous. The original premises were:
– Performance problems are rare.
– Hardware is fast and inexpensive.
– It's too expensive to build responsive software.
– You can tune software later, if necessary.
Performance Engineering of Software Systems, 1990.

13
1991: Load Testing Tools


1991 – LoadRunner was released by
Mercury Interactive
– Acquired by HP in 2006 for $4.5B



Performance expertise moves to
performance testing teams

14
1998 ? – End-User Monitoring


1998 – ETEWatch released by Candle
– Application response time monitor
– End-to-End Watch
– Candle acquired by IBM in 2004, then a part of
Tivioli



Anybody know other EUM/RUM roots?

15
Mid 90s - Web
Most of existing expertise from mainframe
and distributed eras still applicable to back
end
 Books by D. Menasce and V. Almeida (1998,
2000, and 2001)


– Applying existing expertise to Web

16
2007: Web Performance
Optimization


2007 – Steve Souders' book High
Performance Web Sites: Essential
Knowledge for Front-End Engineers was
published



New Web-specific expertise

17
2008: WPO Community


2008 – First Velocity conference

18
Takeaways


Check your facts when you refer to history



A lot was done in the past – not always
necessary to re-invent the wheel



The feeling that we are close to solving
performance problems exists last 40+ years
– Probably will stay with us for a while

19
Questions?
Alexander Podelko
alex.podelko@oracle.com
alexanderpodelko.com/blog
@apodelko

20

More Related Content

Viewers also liked (18)

PPT
Web test
Raghu Kiran
 
PPTX
What is Loadrunner ?
Guru99
 
PPTX
How to Get Automatic Analysis for Load Test Results
Clare Avieli
 
PPT
Web performance testing
Patrick Meenan
 
PPT
Analyzing Performance Test Data
Optimus Information Inc.
 
PPSX
Performance testing for web applications – techniques, metrics and profiling
TestCampRO
 
PPTX
Performance Test Automation Framework Presentation
Mikhael Gelezov
 
PPTX
An Introduction to Performance Testing
David Tzemach
 
PPT
Hp Loadrunner
guestb3416f
 
PDF
E commerce Testing
Atul Pant
 
PDF
Performance Requirement Gathering
Atul Pant
 
PDF
Introduction to Performance testing
silviasiqueirahp
 
PPT
Performance testing using hp load runner
Return on Intelligence
 
PPT
Advanced Load Runner
telab
 
PPTX
Introduction to performance testing
Richard Bishop
 
PPT
Gathering performance information overview
Tufail Ahmed
 
PDF
How to start performance testing project
NaveenKumar Namachivayam
 
PDF
LoadRunner Performance Testing
Atul Pant
 
Web test
Raghu Kiran
 
What is Loadrunner ?
Guru99
 
How to Get Automatic Analysis for Load Test Results
Clare Avieli
 
Web performance testing
Patrick Meenan
 
Analyzing Performance Test Data
Optimus Information Inc.
 
Performance testing for web applications – techniques, metrics and profiling
TestCampRO
 
Performance Test Automation Framework Presentation
Mikhael Gelezov
 
An Introduction to Performance Testing
David Tzemach
 
Hp Loadrunner
guestb3416f
 
E commerce Testing
Atul Pant
 
Performance Requirement Gathering
Atul Pant
 
Introduction to Performance testing
silviasiqueirahp
 
Performance testing using hp load runner
Return on Intelligence
 
Advanced Load Runner
telab
 
Introduction to performance testing
Richard Bishop
 
Gathering performance information overview
Tufail Ahmed
 
How to start performance testing project
NaveenKumar Namachivayam
 
LoadRunner Performance Testing
Atul Pant
 

Similar to A Short History of Performance Engineering (20)

PPTX
A Short History of Performance Engineering
Alexander Podelko
 
PPTX
SDLC Smashup
Lester Martin
 
PDF
Recommended Design Considerations for Enterprise Monitoring
Prolifics
 
PDF
Sol linux cmg-t_1_1.pptx
Bob Sneed
 
PDF
GE Capital Legacy Modernization and Mainframe Conversion
guatham
 
PPT
Methods Over Madness 2003 Ver.
Tom Weinberger
 
PPTX
Customer Presentation - Ford Network Operations Adminstration
Splunk
 
PDF
Metrics driven development 10.09.2014
Erno Aapa
 
PPTX
Comp 107cep iii,iv,v
Bala Ganesh
 
PPTX
Creating a Solid EPM Punch List
Datavail
 
PDF
Agile software development
Rajesh Piryani
 
PPTX
Splunk All the Things: Our First 3 Months Monitoring Web Service APIs - Splun...
Dan Cundiff
 
PDF
UberCloud - From Project to Product
The UberCloud
 
PDF
The UberCloud - From Project to Product - From HPC Experiment to HPC Marketpl...
Wolfgang Gentzsch
 
PPTX
Performance: See the Whole Picture
Alexander Podelko
 
PPTX
Tools of the Trade: Load Testing - Ignite session at WebPerfDays NY 14
Alexander Podelko
 
PDF
Agile - Monojit Basu
Roopa Nadkarni
 
PDF
Agile - Monojit basu
Roopa Nadkarni
 
PPTX
Ordina Accelerator program 2019 - DevOps CI-CD
Bert Koorengevel
 
PPT
ERP - Implementation is The Challenge
vinaya.hs
 
A Short History of Performance Engineering
Alexander Podelko
 
SDLC Smashup
Lester Martin
 
Recommended Design Considerations for Enterprise Monitoring
Prolifics
 
Sol linux cmg-t_1_1.pptx
Bob Sneed
 
GE Capital Legacy Modernization and Mainframe Conversion
guatham
 
Methods Over Madness 2003 Ver.
Tom Weinberger
 
Customer Presentation - Ford Network Operations Adminstration
Splunk
 
Metrics driven development 10.09.2014
Erno Aapa
 
Comp 107cep iii,iv,v
Bala Ganesh
 
Creating a Solid EPM Punch List
Datavail
 
Agile software development
Rajesh Piryani
 
Splunk All the Things: Our First 3 Months Monitoring Web Service APIs - Splun...
Dan Cundiff
 
UberCloud - From Project to Product
The UberCloud
 
The UberCloud - From Project to Product - From HPC Experiment to HPC Marketpl...
Wolfgang Gentzsch
 
Performance: See the Whole Picture
Alexander Podelko
 
Tools of the Trade: Load Testing - Ignite session at WebPerfDays NY 14
Alexander Podelko
 
Agile - Monojit Basu
Roopa Nadkarni
 
Agile - Monojit basu
Roopa Nadkarni
 
Ordina Accelerator program 2019 - DevOps CI-CD
Bert Koorengevel
 
ERP - Implementation is The Challenge
vinaya.hs
 
Ad

More from Alexander Podelko (14)

PDF
Continuous Performance Testing: Challenges and Approaches
Alexander Podelko
 
PPTX
Context-Driven Performance Testing
Alexander Podelko
 
PPTX
Multiple Dimensions of Load Testing
Alexander Podelko
 
DOCX
Multiple Dimensions of Load Testing, CMG 2015 paper
Alexander Podelko
 
PPTX
Reinventing Performance Testing, CMG imPACt 2016 slides
Alexander Podelko
 
DOCX
Reinventing Performance Testing. CMG imPACt 2016 paper
Alexander Podelko
 
PDF
Continuous Performance Testing: Myths and Realities
Alexander Podelko
 
PPTX
Load Testing: See a Bigger Picture, ALM Forum, 2014
Alexander Podelko
 
PPT
Performance testing: respect the difference at swqd14
Alexander Podelko
 
PDF
Agile Aspects of Performance Testing
Alexander Podelko
 
PDF
Performance Requirements: CMG'11 slides with notes (pdf)
Alexander Podelko
 
PPTX
Performance Assurance for Packaged Applications
Alexander Podelko
 
PPTX
Load Testing: See a Bigger Picture
Alexander Podelko
 
PPT
Performance Requirements: the Backbone of the Performance Engineering Process
Alexander Podelko
 
Continuous Performance Testing: Challenges and Approaches
Alexander Podelko
 
Context-Driven Performance Testing
Alexander Podelko
 
Multiple Dimensions of Load Testing
Alexander Podelko
 
Multiple Dimensions of Load Testing, CMG 2015 paper
Alexander Podelko
 
Reinventing Performance Testing, CMG imPACt 2016 slides
Alexander Podelko
 
Reinventing Performance Testing. CMG imPACt 2016 paper
Alexander Podelko
 
Continuous Performance Testing: Myths and Realities
Alexander Podelko
 
Load Testing: See a Bigger Picture, ALM Forum, 2014
Alexander Podelko
 
Performance testing: respect the difference at swqd14
Alexander Podelko
 
Agile Aspects of Performance Testing
Alexander Podelko
 
Performance Requirements: CMG'11 slides with notes (pdf)
Alexander Podelko
 
Performance Assurance for Packaged Applications
Alexander Podelko
 
Load Testing: See a Bigger Picture
Alexander Podelko
 
Performance Requirements: the Backbone of the Performance Engineering Process
Alexander Podelko
 
Ad

Recently uploaded (20)

PPTX
Simple and concise overview about Quantum computing..pptx
mughal641
 
PPTX
python advanced data structure dictionary with examples python advanced data ...
sprasanna11
 
PDF
State-Dependent Conformal Perception Bounds for Neuro-Symbolic Verification
Ivan Ruchkin
 
PPTX
Machine Learning Benefits Across Industries
SynapseIndia
 
PDF
Alpha Altcoin Setup : TIA - 19th July 2025
CIFDAQ
 
PDF
NewMind AI Weekly Chronicles – July’25, Week III
NewMind AI
 
PDF
Responsible AI and AI Ethics - By Sylvester Ebhonu
Sylvester Ebhonu
 
PPTX
Dev Dives: Automate, test, and deploy in one place—with Unified Developer Exp...
AndreeaTom
 
PDF
Per Axbom: The spectacular lies of maps
Nexer Digital
 
PDF
GDG Cloud Munich - Intro - Luiz Carneiro - #BuildWithAI - July - Abdel.pdf
Luiz Carneiro
 
PDF
Market Insight : ETH Dominance Returns
CIFDAQ
 
PDF
Brief History of Internet - Early Days of Internet
sutharharshit158
 
PDF
Trying to figure out MCP by actually building an app from scratch with open s...
Julien SIMON
 
PDF
Generative AI vs Predictive AI-The Ultimate Comparison Guide
Lily Clark
 
PDF
Researching The Best Chat SDK Providers in 2025
Ray Fields
 
PPTX
The Future of AI & Machine Learning.pptx
pritsen4700
 
PPTX
IT Runs Better with ThousandEyes AI-driven Assurance
ThousandEyes
 
PDF
Peak of Data & AI Encore - Real-Time Insights & Scalable Editing with ArcGIS
Safe Software
 
PDF
Economic Impact of Data Centres to the Malaysian Economy
flintglobalapac
 
PPTX
Agile Chennai 18-19 July 2025 | Workshop - Enhancing Agile Collaboration with...
AgileNetwork
 
Simple and concise overview about Quantum computing..pptx
mughal641
 
python advanced data structure dictionary with examples python advanced data ...
sprasanna11
 
State-Dependent Conformal Perception Bounds for Neuro-Symbolic Verification
Ivan Ruchkin
 
Machine Learning Benefits Across Industries
SynapseIndia
 
Alpha Altcoin Setup : TIA - 19th July 2025
CIFDAQ
 
NewMind AI Weekly Chronicles – July’25, Week III
NewMind AI
 
Responsible AI and AI Ethics - By Sylvester Ebhonu
Sylvester Ebhonu
 
Dev Dives: Automate, test, and deploy in one place—with Unified Developer Exp...
AndreeaTom
 
Per Axbom: The spectacular lies of maps
Nexer Digital
 
GDG Cloud Munich - Intro - Luiz Carneiro - #BuildWithAI - July - Abdel.pdf
Luiz Carneiro
 
Market Insight : ETH Dominance Returns
CIFDAQ
 
Brief History of Internet - Early Days of Internet
sutharharshit158
 
Trying to figure out MCP by actually building an app from scratch with open s...
Julien SIMON
 
Generative AI vs Predictive AI-The Ultimate Comparison Guide
Lily Clark
 
Researching The Best Chat SDK Providers in 2025
Ray Fields
 
The Future of AI & Machine Learning.pptx
pritsen4700
 
IT Runs Better with ThousandEyes AI-driven Assurance
ThousandEyes
 
Peak of Data & AI Encore - Real-Time Insights & Scalable Editing with ArcGIS
Safe Software
 
Economic Impact of Data Centres to the Malaysian Economy
flintglobalapac
 
Agile Chennai 18-19 July 2025 | Workshop - Enhancing Agile Collaboration with...
AgileNetwork
 

A Short History of Performance Engineering

  • 1. Velocity NY A Short History of Performance Engineering Alexander Podelko [email protected] alexanderpodelko.com/blog @apodelko October 14, 2013 1
  • 2. About Me  I have specialized in performance for the last 16 years  Currently performance testing and optimization of Hyperion products at Oracle  Board director at CMG http://cmg.org, organization of performance and capacity professionals – Conference November 4-8, 2013 in La Jolla, CA Disclaimer: The views expressed here are my personal views only and do not necessarily represent those of my current or previous employers. All brands and trademarks mentioned are the property of their owners. 2
  • 3. There Was [Performance] Life Even Before Web  Some statements referring to history look incorrect  Performance engineering history is not well known – Not much information readily available  So I decided to share a few bits of information I know / found 3
  • 4. The Approach  First mature appearances of still relevant performance notions – From what I found – No discussion about further rich history of each notion  My subjective choices based on very limited information 4
  • 5. Computing Paradigms  Looks like a new wave of performance engineering starts 10+ years after new computing paradigm  Mainframes – Late 50s  Distributed Systems – Late 70s  Web – Mid 90s  ? – Mobile, Cloud 5
  • 6. 1966: Instrumentation  1966 – SMF (System Management Facilities) released as part of OS/360 – Still in use Big Data ? Deep Diagnostics ? IT Operations Analytics ? 6
  • 7. 1968: Response Times  1968 - Robert Miller (IBM) in his "Response Time in Man-Computer Conversational Transactions" paper described several threshold levels of human attention – Widely cited by many later researchers 7
  • 8. 1974: Monitoring  1974 – RMF (Resource Measurement Facility) released as part of MVS – Still in use  1975 – OMEGAMON for MVS by Candle – Claimed to be the first real-time monitor – Acquired by IBM in 2004 8
  • 9. 1975: Community  1975 – The Computer Measurement Group (CMG) was created, holding annual conferences since – Coming Performance and Capacity 2013 by CMG November 4-8 in La Jolla, CA http://cmg.org/conference/cmg2013/ – Proceedings available to public (1976-2010) http://cmg.org/proceedings/ 9
  • 10. 1977: Performance Analysis Tool  1977 – BEST/1 was released by BGS Systems, capacity and performance management tool – the first commercial package for computer performance analysis to be based on analytic models. BGS Systems was acquired by BMC Software in 1998 10
  • 11. Late 70s - Distributed Systems  Distributed Systems – Client/Server, Three-Tier, N-Tier, etc.  Less control, less instrumentation  More need for performance design and testing 11
  • 12. 1990: Software Performance Engineering  1990 – Dr. Connie Smith's book Performance Engineering of Software Systems was published – 15 pages of bibliography "Fix-it-later was once a viable approach, but it is now inappropriate and dangerous" 12
  • 13. Does It Remind You Anything?  Fix-it-later was a viable approach in the 1970s, but today the original promises no longer hold, and fix-it-later is archaic and dangerous. The original premises were: – Performance problems are rare. – Hardware is fast and inexpensive. – It's too expensive to build responsive software. – You can tune software later, if necessary. Performance Engineering of Software Systems, 1990. 13
  • 14. 1991: Load Testing Tools  1991 – LoadRunner was released by Mercury Interactive – Acquired by HP in 2006 for $4.5B  Performance expertise moves to performance testing teams 14
  • 15. 1998 ? – End-User Monitoring  1998 – ETEWatch released by Candle – Application response time monitor – End-to-End Watch – Candle acquired by IBM in 2004, then a part of Tivioli  Anybody know other EUM/RUM roots? 15
  • 16. Mid 90s - Web Most of existing expertise from mainframe and distributed eras still applicable to back end  Books by D. Menasce and V. Almeida (1998, 2000, and 2001)  – Applying existing expertise to Web 16
  • 17. 2007: Web Performance Optimization  2007 – Steve Souders' book High Performance Web Sites: Essential Knowledge for Front-End Engineers was published  New Web-specific expertise 17
  • 18. 2008: WPO Community  2008 – First Velocity conference 18
  • 19. Takeaways  Check your facts when you refer to history  A lot was done in the past – not always necessary to re-invent the wheel  The feeling that we are close to solving performance problems exists last 40+ years – Probably will stay with us for a while 19

Editor's Notes

  • #7: http://www.flickr.com/photos/22221172@N00/2627291590
  • #8: http://www.flickr.com/photos/8543480@N06/5565773185
  • #9: http://www.flickr.com/photos/24205142@N00/2370873167/
  • #12: http://www.flickr.com/photos/65615735@N00/4263449886
  • #15: http://www.flickr.com/photos/99112767@N00/420926118/