SlideShare a Scribd company logo
Infragistics Propietary1
Infragistics Propietary2
Measuring Usability
Infragistics Propietary3
Hi I am Stefan
 Senior UX Architect at Infragistics
 UI controls for desktop, web and mobile
 Developer productivity tools
 Teach and talk about UX
Infragistics Propietary4
UX has taught us a lot
 Are there any User Researchers in the room?
 How many of you have ever prototyped?
 Among these are there some who usually start prototyping early on?
 Are there any “exceptionals” who got feedback on their prototypes from real users, not
stakeholders of colleagues?
“UX is not order taking”
Kevin Richardson
Infragistics Propietary5
Infragistics Propietary6
Infragistics Propietary7
Infragistics Propietary8
Evaluation
 Model extraction
Infragistics Propietary9
Evaluation
 Model extraction
 Silent observation
Infragistics Propietary10
Evaluation
 Model extraction
 Silent observation
 Think aloud
Infragistics Propietary11
Evaluation
 Model extraction
 Silent observation
 Think aloud
 Constructive usage
 Retrospective testing
Infragistics Propietary12
Evaluation
 Model extraction
 Silent observation
 Think aloud
 Constructive usage
 Retrospective testing
 Controlled experiments
Infragistics Propietary13
CONTROLLED
EXPERIMENTS
Infragistics Propietary14
Infragistics Propietary15
Infragistics Propietary16
Synthesizing a hypothesis
 Statement
 Short and specific
 Assuming some kind of relationship
 It should be testable
 Accept it or reject it
 Generalizes over a group of users
 Often uses passive voice
Infragistics Propietary17
Synthesizing a hypothesis - examples
 If leaf color change is related to temperature, then exposing plants
to low temperature will result in changes of leaf color.
 Hyperactivity is unrelated to eating sugar.
 A person’s preference for a shirt is not related to its color.
 If I replace the battery in my car, then my car will get better gas mileage.
 Water levels affect the amount of lice suffered by rainbow trout.
Infragistics Propietary18
Synthesizing a hypothesis
 In the field throughout the day
 Communicate with colleagues and management via various means
 Send status updates for various crops
 Repetitive reports take up quite some time
 Agriculture is error intolerant (direct impact on harvest and profit)
 Communicate with multiple people while at a certain stop
Infragistics Propietary19
Null hypothesis
The accuracy of information and time to gather and send a status
report for the crops are independent of the means of communicating
the report, the crops outlined and the number of people that need to
be informed.
Infragistics Propietary20
Null hypothesis
The accuracy of information and time to gather and send a status
report for the crops are independent of the means of communicating
the report, the crops outlined and the number of people that need to
be informed.
Independent variables
Controlled variables
Dependent variables
Measured variables
Infragistics Propietary21
Experiment concept
 Task 1 …………………………………………………………………….
 Send the following status update “Draught has
affected oats in C012 field” via text to Manoj,
Deepak and Divya
 Send the following status update “Rice in B039
field is robust and healthy” to Rohit by calling him
Infragistics Propietary22
Experiment concept
Means of communicating
Type of crops
Number of people
#Conditions = #Means of communicating * #People
Infragistics Propietary23
Experiment concept
 Error rate
 Rate of corrections
 Task completion time
Accuracy of information
Time to send a status
Infragistics Propietary24
Infragistics Propietary25
Infragistics Propietary26
Executing the study
Infragistics Propietary27
Analyzing the data
Infragistics Propietary28
Further learning
https://www.r-project.org/
http://randomization.com/
https://stats.idre.ucla.edu/other/mult-pkg/whatstat/
What statistical analysis to use cheat sheet
Randomization to avoid learning effects
R-project for running statistical analysis
https://stats.idre.ucla.edu/r/whatstat/what-statistical-
analysis-should-i-usestatistical-analyses-using-r/
https://stats.idre.ucla.edu/stata/whatstat/what-statistical-
analysis-should-i-usestatistical-analyses-using-stata/
Infragistics Propietary29
Remote usability studies
Infragistics Propietary30
Preparation
Create an
account under
indigodesigned
.com
Email sivanov@Infragistics.com
to get an invite to the shared
workspace with the prototype
Create your own usability
study by extending the
prototype and defining
your own tasks
Infragistics Propietary31
Execution
https://indigodesigned.com/study/run/h1170y563x3r/
Infragistics Propietary32
Participation
Infragistics Propietary33
Remote usability studies
Infragistics Propietary34
FEEDBACK
AND
QUESTIONS
sivanov@infragistics.com stefanivanovux

More Related Content

Similar to Measuring usability workshop (20)

PDF
IoT Meets Exhibition Areas: a Modular Architecture to Improve Proximity Inter...
Teodoro Montanaro
 
PDF
Usability Challenges in Cutting-edge Medical Devices and Exoskeleton Robotics
ICS
 
PDF
Applying user requirements for innovative products
User Vision
 
PPTX
PhD Defense of Teodoro Montanaro
Teodoro Montanaro
 
PPTX
iPerfDetector: Characterizing and Detecting Performance Anti-patterns in iOS ...
Concordia University
 
PDF
The Medium of Visualization for Software Comprehension
Leonel Merino
 
PPTX
WCIT 2014 Peter Elkin - Human computer interaction, evaluation, usability tes...
WCIT 2014
 
PDF
Tech Report: On the Effectiveness of Malware Protection on Android
Fraunhofer AISEC
 
PDF
Managing Community Contributions: Lessons Learned from a Case Study on Andro...
Nicolas Bettenburg
 
PPT
Design for Interaction
Evan, Tian Cherng Kong
 
PDF
Role of UX in a Mobile First approach @ NextStep Americas 2014
Gonçalo Veiga
 
PDF
Emerging Experiences - More Personal Computing (MPC) - Tim Huckaby
ITCamp
 
PDF
Offline First in React Native
Josh Warwick
 
DOCX
MKT 230 Module Two Creating Print Advertisements Assignm.docx
raju957290
 
PDF
[WSO2 Integration Summit London 2019] The Composable Enterprise
WSO2
 
PDF
On-Device Bug Reporting for Android Applications
Kevin Moran
 
PDF
UBIQUITOUS COMPUTING Its Paradigm, Systems & Middleware
vivatechijri
 
PDF
iThings-2012, Besançon, France, 20 November, 2012
Charith Perera
 
PDF
“Fabrication Of Unmanned Aerial Vehicle (UAV) For Agricultural Purposes
vivatechijri
 
IoT Meets Exhibition Areas: a Modular Architecture to Improve Proximity Inter...
Teodoro Montanaro
 
Usability Challenges in Cutting-edge Medical Devices and Exoskeleton Robotics
ICS
 
Applying user requirements for innovative products
User Vision
 
PhD Defense of Teodoro Montanaro
Teodoro Montanaro
 
iPerfDetector: Characterizing and Detecting Performance Anti-patterns in iOS ...
Concordia University
 
The Medium of Visualization for Software Comprehension
Leonel Merino
 
WCIT 2014 Peter Elkin - Human computer interaction, evaluation, usability tes...
WCIT 2014
 
Tech Report: On the Effectiveness of Malware Protection on Android
Fraunhofer AISEC
 
Managing Community Contributions: Lessons Learned from a Case Study on Andro...
Nicolas Bettenburg
 
Design for Interaction
Evan, Tian Cherng Kong
 
Role of UX in a Mobile First approach @ NextStep Americas 2014
Gonçalo Veiga
 
Emerging Experiences - More Personal Computing (MPC) - Tim Huckaby
ITCamp
 
Offline First in React Native
Josh Warwick
 
MKT 230 Module Two Creating Print Advertisements Assignm.docx
raju957290
 
[WSO2 Integration Summit London 2019] The Composable Enterprise
WSO2
 
On-Device Bug Reporting for Android Applications
Kevin Moran
 
UBIQUITOUS COMPUTING Its Paradigm, Systems & Middleware
vivatechijri
 
iThings-2012, Besançon, France, 20 November, 2012
Charith Perera
 
“Fabrication Of Unmanned Aerial Vehicle (UAV) For Agricultural Purposes
vivatechijri
 

More from Stefan Ivanov (20)

PDF
Design in the New Normal
Stefan Ivanov
 
PDF
The True Purpose of Design Systems
Stefan Ivanov
 
PDF
One for all and all for one
Stefan Ivanov
 
PDF
Digital Design in Bulgaria
Stefan Ivanov
 
PDF
The True Purpose of Design Systems
Stefan Ivanov
 
PDF
Understanding users without getting bored
Stefan Ivanov
 
PDF
Design in Bulgaria
Stefan Ivanov
 
PDF
The quest for player centrism
Stefan Ivanov
 
PDF
The Case Behind User Experience
Stefan Ivanov
 
PDF
Measuring Usability
Stefan Ivanov
 
PDF
Designing for constrained productivity
Stefan Ivanov
 
PPTX
Design through empathy
Stefan Ivanov
 
PPTX
Storyboards - telling the stories of your users visually
Stefan Ivanov
 
PPTX
Gamification - a player centered design process
Stefan Ivanov
 
PPTX
Emotion and usability
Stefan Ivanov
 
PPTX
Mobile Wireframing with Indigo Studio
Stefan Ivanov
 
PDF
Web Usability Metrics JSNext Bulgaria 2014
Stefan Ivanov
 
PDF
wUX applying UX principles to wearable tech and smart textiles
Stefan Ivanov
 
PDF
Mobile UX - tips and tricks for better apps
Stefan Ivanov
 
PDF
The nine golden rules of interface design
Stefan Ivanov
 
Design in the New Normal
Stefan Ivanov
 
The True Purpose of Design Systems
Stefan Ivanov
 
One for all and all for one
Stefan Ivanov
 
Digital Design in Bulgaria
Stefan Ivanov
 
The True Purpose of Design Systems
Stefan Ivanov
 
Understanding users without getting bored
Stefan Ivanov
 
Design in Bulgaria
Stefan Ivanov
 
The quest for player centrism
Stefan Ivanov
 
The Case Behind User Experience
Stefan Ivanov
 
Measuring Usability
Stefan Ivanov
 
Designing for constrained productivity
Stefan Ivanov
 
Design through empathy
Stefan Ivanov
 
Storyboards - telling the stories of your users visually
Stefan Ivanov
 
Gamification - a player centered design process
Stefan Ivanov
 
Emotion and usability
Stefan Ivanov
 
Mobile Wireframing with Indigo Studio
Stefan Ivanov
 
Web Usability Metrics JSNext Bulgaria 2014
Stefan Ivanov
 
wUX applying UX principles to wearable tech and smart textiles
Stefan Ivanov
 
Mobile UX - tips and tricks for better apps
Stefan Ivanov
 
The nine golden rules of interface design
Stefan Ivanov
 
Ad

Recently uploaded (20)

PPT
UNIT- 2 CARBON FOOT PRINT.ppt yvvuvvvvvvyvy
sriram270905
 
PPTX
Morph Slide Presentation transition.pptx
ArifaAkter10
 
PPTX
Lesson 2 Application of Induced current.pptx
hananmahjoob18
 
PPTX
The Satavahanas.pptx....,......,........
Kritisharma797381
 
PPTX
3. Introduction to Materials and springs.pptx
YESIMSMART
 
PPTX
UIUX-Design-Enhancing-Digital-Experiences.pptx
kapilsolanki439
 
PPTX
Digital Printing presentation-update-26.08.24.pptx
MDFoysalAhmed13
 
PDF
Zidane ben hmida _ Portfolio
Zidane Ben Hmida
 
PDF
Dark Green White Gradient Technology Keynote Presentation.pdf
sharmayakshita0308
 
PPT
Strengthening of an existing reinforced concrete structure.ppt
erdarshanpshah
 
PPTX
Time_Management_Presenuuuuuuutation.pptx
Rajni Goyal
 
PDF
Fashion Design Portfolio Berta Villanueva
BertaVillanueva
 
PDF
Home_Decor_Presentation and idiea with decor
sp1357556
 
PDF
Fashion project1 kebaya reimagined slideshow
reysultane
 
PPTX
Design & Thinking for Engineering graduates
NEELAMRAWAT48
 
PPTX
Web Design: Enhancing User Experience & Brand Value
ashokmakwana0303
 
PPTX
Style and aesthetic about fashion lifestyle
Khushi Bera
 
PPTX
Blended Wing Body y jet engines Aircrafts.pptx
anshul9051
 
PDF
Dunes.pdf, Durable and Seamless Solid Surface Countertops
tranquil01
 
PDF
hees101.pdfyyyyyuywgbzhdtehwytjeyktweyga
pratap1004
 
UNIT- 2 CARBON FOOT PRINT.ppt yvvuvvvvvvyvy
sriram270905
 
Morph Slide Presentation transition.pptx
ArifaAkter10
 
Lesson 2 Application of Induced current.pptx
hananmahjoob18
 
The Satavahanas.pptx....,......,........
Kritisharma797381
 
3. Introduction to Materials and springs.pptx
YESIMSMART
 
UIUX-Design-Enhancing-Digital-Experiences.pptx
kapilsolanki439
 
Digital Printing presentation-update-26.08.24.pptx
MDFoysalAhmed13
 
Zidane ben hmida _ Portfolio
Zidane Ben Hmida
 
Dark Green White Gradient Technology Keynote Presentation.pdf
sharmayakshita0308
 
Strengthening of an existing reinforced concrete structure.ppt
erdarshanpshah
 
Time_Management_Presenuuuuuuutation.pptx
Rajni Goyal
 
Fashion Design Portfolio Berta Villanueva
BertaVillanueva
 
Home_Decor_Presentation and idiea with decor
sp1357556
 
Fashion project1 kebaya reimagined slideshow
reysultane
 
Design & Thinking for Engineering graduates
NEELAMRAWAT48
 
Web Design: Enhancing User Experience & Brand Value
ashokmakwana0303
 
Style and aesthetic about fashion lifestyle
Khushi Bera
 
Blended Wing Body y jet engines Aircrafts.pptx
anshul9051
 
Dunes.pdf, Durable and Seamless Solid Surface Countertops
tranquil01
 
hees101.pdfyyyyyuywgbzhdtehwytjeyktweyga
pratap1004
 
Ad

Measuring usability workshop