SlideShare a Scribd company logo
chapter 12
cognitive models
ARULKUMAR V AP/CSE SECE
Cognitive models
• goal and task hierarchies
• linguistic
• physical and device
• architectural
ARULKUMAR V AP/CSE SECE
Cognitive models
• They model aspects of user:
– understanding
– knowledge
– intentions
– processing
• Common categorisation:
– Competence vs. Performance
– Computational flavour
– No clear divide
ARULKUMAR V AP/CSE SECE
Goal and task hierarchies
• Mental processing as divide-and-conquer
• Example: sales report
produce report
gather data
. find book names
. . do keywords search of names database
. . . … further sub-goals
. . sift through names and abstracts by hand
. . . … further sub-goals
. search sales database - further sub-goals
layout tables and histograms - further sub-goals
write description - further sub-goals
ARULKUMAR V AP/CSE SECE
goals vs. tasks
• goals – intentions
what you would like to be true
• tasks – actions
how to achieve it
• GOMS – goals are internal
• HTA – actions external
– tasks are abstractions
ARULKUMAR V AP/CSE SECE
Issues for goal hierarchies
• Granularity
– Where do we start?
– Where do we stop?
• Routine learned behaviour, not problem
solving
– The unit task
• Conflict
– More than one way to achieve a goal
• Error
ARULKUMAR V AP/CSE SECE
Techniques
• Goals, Operators, Methods and
Selection (GOMS)
• Cognitive Complexity Theory (CCT)
• Hierarchical Task Analysis (HTA) -
Chapter 15
ARULKUMAR V AP/CSE SECE
GOMS
Goals
– what the user wants to achieve
Operators
– basic actions user performs
Methods
– decomposition of a goal into subgoals/operators
Selection
– means of choosing between competing methods
ARULKUMAR V AP/CSE SECE
GOMS example
GOAL: CLOSE-WINDOW
. [select GOAL: USE-MENU-METHOD
. MOVE-MOUSE-TO-FILE-MENU
. PULL-DOWN-FILE-MENU
. CLICK-OVER-CLOSE-OPTION
GOAL: USE-CTRL-W-METHOD
. PRESS-CONTROL-W-KEYS]
For a particular user:
Rule 1: Select USE-MENU-METHOD unless another
rule applies
Rule 2: If the application is GAME,
select CTRL-W-METHOD
ARULKUMAR V AP/CSE SECE
Cognitive Complexity Theory
• Two parallel descriptions:
– User production rules
– Device generalised transition networks
• Production rules are of the form:
– if condition then action
• Transition networks covered under
dialogue models
ARULKUMAR V AP/CSE SECE
Example: editing with vi
• Production rules are in long-term memory
• Model working memory as attribute-value
mapping:
(GOAL perform unit task)
(TEXT task is insert space)
(TEXT task is at 5 23)
(CURSOR 8 7)
• Rules are pattern-matched to working
memory,
e.g., LOOK-TEXT task is at %LINE %COLUMN
is true, with LINE = 5 COLUMN = 23.
ARULKUMAR V AP/CSE SECE
Active rules:
SELECT-INSERT-SPACE
INSERT-SPACE-MOVE-FIRST
INSERT-SPACE-DOIT
INSERT-SPACE-DONE
Four rules to model inserting
a space
New working memory
(GOAL insert space)
(NOTE executing insert space)
(LINE 5) (COLUMN 23)
SELECT-INSERT-SPACE
matches current working memory
(SELECT-INSERT-SPACE
IF (AND (TEST-GOAL perform unit task)
(TEST-TEXT task is insert space)
(NOT (TEST-GOAL insert space))
(NOT (TEST-NOTE executing insert space)))
THEN ( (ADD-GOAL insert space)
(ADD-NOTE executing insert space)
(LOOK-TEXT task is at %LINE %COLUMN)))ARULKUMAR V AP/CSE SECE
Notes on CCT
• Parallel model
• Proceduralisation of actions
• Novice versus expert style rules
• Error behaviour can be represented
• Measures
– depth of goal structure
– number of rules
– comparison with device description
ARULKUMAR V AP/CSE SECE
Problems with goal hierarchies
• a post hoc technique
• expert versus novice
• How cognitive are they?
ARULKUMAR V AP/CSE SECE
Linguistic notations
• Understanding the user's behaviour and
cognitive difficulty based on analysis of
language between user and system.
• Similar in emphasis to dialogue models
• Backus–Naur Form (BNF)
• Task–Action Grammar (TAG)
ARULKUMAR V AP/CSE SECE
Backus-Naur Form (BNF)
• Very common notation from computer science
• A purely syntactic view of the dialogue
• Terminals
– lowest level of user behaviour
– e.g. CLICK-MOUSE, MOVE-MOUSE
• Nonterminals
– ordering of terminals
– higher level of abstraction
– e.g. select-menu, position-mouse
ARULKUMAR V AP/CSE SECE
Example of BNF
• Basic syntax:
– nonterminal ::= expression
• An expression
– contains terminals and nonterminals
– combined in sequence (+) or as alternatives (|)
draw line ::= select line + choose points + last point
select line ::= pos mouse + CLICK MOUSE
choose points ::= choose one | choose one + choose points
choose one ::= pos mouse + CLICK MOUSE
last point ::= pos mouse + DBL CLICK MOUSE
pos mouse ::= NULL | MOVE MOUSE+ pos mouse
ARULKUMAR V AP/CSE SECE
Measurements with BNF
• Number of rules (not so good)
• Number of + and | operators
• Complications
– same syntax for different semantics
– no reflection of user's perception
– minimal consistency checking
ARULKUMAR V AP/CSE SECE
Task Action Grammar (TAG)
• Making consistency more explicit
• Encoding user's world knowledge
• Parameterised grammar rules
• Nonterminals are modified to include
additional semantic features
ARULKUMAR V AP/CSE SECE
Consistency in TAG
• In BNF, three UNIX commands would be described as:
copy ::= cp + filename + filename | cp + filenames + directory
move ::= mv + filename + filename | mv + filenames + directory
link ::= ln + filename + filename | ln + filenames + directory
• No BNF measure could distinguish between this and a
less consistent grammar in which
link ::= ln + filename + filename | ln + directory + filenames
ARULKUMAR V AP/CSE SECE
Consistency in TAG (cont'd)
• consistency of argument order made explicit
using a parameter, or semantic feature for file
operations
• Feature Possible values
Op = copy; move; link
• Rules
file-op[Op] ::= command[Op] + filename + filename
| command[Op] + filenames + directory
command[Op = copy] ::= cp
command[Op = move] ::= mv
command[Op = link] ::= ln
ARULKUMAR V AP/CSE SECE
Other uses of TAG
• User’s existing knowledge
• Congruence between features and
commands
• These are modelled as derived rules
ARULKUMAR V AP/CSE SECE
Physical and device models
• The Keystroke Level Model (KLM)
• Buxton's 3-state model
• Based on empirical knowledge of human
motor system
• User's task: acquisition then execution.
– these only address execution
• Complementary with goal hierarchies
ARULKUMAR V AP/CSE SECE
Keystroke Level Model (KLM)
• lowest level of (original) GOMS
• six execution phase operators
– Physical motor: K - keystroking
P - pointing
H - homing
D - drawing
– Mental M - mental preparation
– System R - response
• times are empirically determined.
Texecute = TK + TP + TH + TD + TM + TR
ARULKUMAR V AP/CSE SECE
KLM example
GOAL: ICONISE-WINDOW
[select
GOAL: USE-CLOSE-METHOD
. MOVE-MOUSE-TO- FILE-MENU
. PULL-DOWN-FILE-MENU
. CLICK-OVER-CLOSE-OPTION
GOAL: USE-CTRL-W-METHOD
PRESS-CONTROL-W-KEY]
• compare alternatives:
• USE-CTRL-W-METHOD vs.
• USE-CLOSE-METHOD
• assume hand starts on mouse
USE-CLOSE-METHOD
P[to menu] 1.1
B[LEFT down] 0.1
M 1.35
P[to option] 1.1
B[LEFT up] 0.1
Total 3.75 s
USE-CTRL-W-METHOD
H[to kbd] 0.40
M 1.35
K[ctrlW key] 0.28
Total 2.03 s
ARULKUMAR V AP/CSE SECE
Architectural models
• All of these cognitive models make
assumptions about the architecture of
the human mind.
• Long-term/Short-term memory
• Problem spaces
• Interacting Cognitive Subsystems
• Connectionist
• ACT
ARULKUMAR V AP/CSE SECE
Display-based interaction
• Most cognitive models do not deal with
user observation and perception
• Some techniques have been extended
to handle system output
(e.g., BNF with sensing terminals, Display-TAG)
but problems persist
• Exploratory interaction versus planning
ARULKUMAR V AP/CSE SECE

More Related Content

What's hot (20)

PPT
Interactive design basics
PhD Research Scholar
 
PPT
HCI 3e - Ch 4 (extra):
Alan Dix
 
PPTX
Human computer interaction-Memory, Reasoning and Problem solving
N.Jagadish Kumar
 
PPTX
Unit2 hci
pradeepgupta266
 
PPT
HCI - Chapter 3
Alan Dix
 
PPT
HCI 3e - Ch 17: Models of the system
Alan Dix
 
PPT
Hypertext, multimedia and www
PhD Research Scholar
 
PPTX
WEB INTERFACE DESIGN
PhD Research Scholar
 
PPT
HCI 3e - Ch 10: Universal design
Alan Dix
 
PPT
HCI 3e - Ch 1: The human
Alan Dix
 
PPT
HCI - Chapter 2
Alan Dix
 
PPTX
Human Computer Interaction HCI
Gaditek
 
PDF
Mobile Information Architecture
Lifna C.S
 
PPT
HCI 3e - Ch 3: The interaction
Alan Dix
 
PPT
HCI 3e - Ch 9: Evaluation techniques
Alan Dix
 
PPT
HCI 3e - Ch 8: Implementation support
Alan Dix
 
PPTX
Evaluation in hci
sajid rao
 
PPT
Human Computer Interaction
Jitu Choudhary
 
PPT
HCI 3e - Ch 6: HCI in the software process
Alan Dix
 
PPT
HCI 3e - Ch 14: Communication and collaboration models
Alan Dix
 
Interactive design basics
PhD Research Scholar
 
HCI 3e - Ch 4 (extra):
Alan Dix
 
Human computer interaction-Memory, Reasoning and Problem solving
N.Jagadish Kumar
 
Unit2 hci
pradeepgupta266
 
HCI - Chapter 3
Alan Dix
 
HCI 3e - Ch 17: Models of the system
Alan Dix
 
Hypertext, multimedia and www
PhD Research Scholar
 
WEB INTERFACE DESIGN
PhD Research Scholar
 
HCI 3e - Ch 10: Universal design
Alan Dix
 
HCI 3e - Ch 1: The human
Alan Dix
 
HCI - Chapter 2
Alan Dix
 
Human Computer Interaction HCI
Gaditek
 
Mobile Information Architecture
Lifna C.S
 
HCI 3e - Ch 3: The interaction
Alan Dix
 
HCI 3e - Ch 9: Evaluation techniques
Alan Dix
 
HCI 3e - Ch 8: Implementation support
Alan Dix
 
Evaluation in hci
sajid rao
 
Human Computer Interaction
Jitu Choudhary
 
HCI 3e - Ch 6: HCI in the software process
Alan Dix
 
HCI 3e - Ch 14: Communication and collaboration models
Alan Dix
 

Similar to Cognitive models unit 3 (20)

PPT
e3-chap-12b vgggggggggggggggggggggggggggggggg.ppt
abdullahamjadtv
 
PPT
E3 chap-12
Welly Dian Astika
 
PPT
Cognitive Models
ahmad bassiouny
 
PPTX
Unit iii ppt
tamizh arthanari
 
PPT
HCI Cognitive models.ppt
YuvashriV
 
PPTX
Session 3.1 HCI (1).pptx
raghuinfo
 
PPTX
IFI7159 M2
David Lamas
 
PPT
E3 chap-18
Welly Dian Astika
 
PPTX
PS3103 Cognitive Psy Lecture 1.pptx
UneezaRajpoot
 
PPTX
PS3103 Cognitive Psy Lecture 1.pptx
ahmadbhattim005
 
PDF
Chapter 3 memory and learning
Nuraini Mohd Ghani
 
PPT
The interaction HCI
PhD Research Scholar
 
PDF
HCI Information Processing.pdf
XanGwaps
 
PDF
Hci and psychology
Dr. Shaukat Wasi
 
PPT
Lecture1
chandsek666
 
PPTX
Chapter two (1)hci
yihunie ayalew
 
PPTX
Human factors in human computer interaction.pptx
ndunachantelle77
 
PPTX
Unit 1- Part 1.pptx about basic of Artificial intelligence
AbdeAli17
 
PDF
Searching and Sorting Algorithms-An Introduction from Object Automation
Object Automation
 
PDF
10 1 planning, acting, learning
Tianlu Wang
 
e3-chap-12b vgggggggggggggggggggggggggggggggg.ppt
abdullahamjadtv
 
E3 chap-12
Welly Dian Astika
 
Cognitive Models
ahmad bassiouny
 
Unit iii ppt
tamizh arthanari
 
HCI Cognitive models.ppt
YuvashriV
 
Session 3.1 HCI (1).pptx
raghuinfo
 
IFI7159 M2
David Lamas
 
E3 chap-18
Welly Dian Astika
 
PS3103 Cognitive Psy Lecture 1.pptx
UneezaRajpoot
 
PS3103 Cognitive Psy Lecture 1.pptx
ahmadbhattim005
 
Chapter 3 memory and learning
Nuraini Mohd Ghani
 
The interaction HCI
PhD Research Scholar
 
HCI Information Processing.pdf
XanGwaps
 
Hci and psychology
Dr. Shaukat Wasi
 
Lecture1
chandsek666
 
Chapter two (1)hci
yihunie ayalew
 
Human factors in human computer interaction.pptx
ndunachantelle77
 
Unit 1- Part 1.pptx about basic of Artificial intelligence
AbdeAli17
 
Searching and Sorting Algorithms-An Introduction from Object Automation
Object Automation
 
10 1 planning, acting, learning
Tianlu Wang
 
Ad

More from PhD Research Scholar (20)

PPTX
Quiz servlet
PhD Research Scholar
 
PPTX
servlet db connectivity
PhD Research Scholar
 
PPTX
2.java script dom
PhD Research Scholar
 
PPTX
1.java script
PhD Research Scholar
 
PPTX
Quiz javascript
PhD Research Scholar
 
PPTX
Thread&multithread
PhD Research Scholar
 
PPTX
Streams&io
PhD Research Scholar
 
PPTX
Packages
PhD Research Scholar
 
PPTX
Interface in java
PhD Research Scholar
 
PPTX
Inner classes in java
PhD Research Scholar
 
PPTX
Inheritance
PhD Research Scholar
 
PPTX
Exception handling
PhD Research Scholar
 
PPTX
Abstract class
PhD Research Scholar
 
PPTX
7. tuples, set & dictionary
PhD Research Scholar
 
PPTX
5. string
PhD Research Scholar
 
Quiz servlet
PhD Research Scholar
 
servlet db connectivity
PhD Research Scholar
 
2.java script dom
PhD Research Scholar
 
1.java script
PhD Research Scholar
 
Quiz javascript
PhD Research Scholar
 
Thread&multithread
PhD Research Scholar
 
Streams&io
PhD Research Scholar
 
Interface in java
PhD Research Scholar
 
Inner classes in java
PhD Research Scholar
 
Exception handling
PhD Research Scholar
 
Abstract class
PhD Research Scholar
 
7. tuples, set & dictionary
PhD Research Scholar
 
Ad

Recently uploaded (20)

PPTX
PPT on the Development of Education in the Victorian England
Beena E S
 
PPTX
Gall bladder, Small intestine and Large intestine.pptx
rekhapositivity
 
PPTX
HIRSCHSPRUNG'S DISEASE(MEGACOLON): NURSING MANAGMENT.pptx
PRADEEP ABOTHU
 
PPTX
CLEFT LIP AND PALATE: NURSING MANAGEMENT.pptx
PRADEEP ABOTHU
 
PPTX
Constitutional Design Civics Class 9.pptx
bikesh692
 
PDF
FULL DOCUMENT: Read the full Deloitte and Touche audit report on the National...
Kweku Zurek
 
PPTX
Optimizing Cancer Screening With MCED Technologies: From Science to Practical...
i3 Health
 
PPTX
PYLORIC STENOSIS: NURSING MANAGEMENT.pptx
PRADEEP ABOTHU
 
PPTX
How to Configure Storno Accounting in Odoo 18 Accounting
Celine George
 
PPTX
ROLE OF ANTIOXIDANT IN EYE HEALTH MANAGEMENT.pptx
Subham Panja
 
PPT
digestive system for Pharm d I year HAP
rekhapositivity
 
PPTX
national medicinal plants board mpharm.pptx
SHAHEEN SHABBIR
 
PDF
A guide to responding to Section C essay tasks for the VCE English Language E...
jpinnuck
 
PDF
IMP NAAC REFORMS 2024 - 10 Attributes.pdf
BHARTIWADEKAR
 
PDF
Living Systems Unveiled: Simplified Life Processes for Exam Success
omaiyairshad
 
PPTX
ANORECTAL MALFORMATIONS: NURSING MANAGEMENT.pptx
PRADEEP ABOTHU
 
PPTX
Optimizing Cancer Screening With MCED Technologies: From Science to Practical...
i3 Health
 
PPTX
ENGLISH LEARNING ACTIVITY SHE W5Q1.pptxY
CHERIEANNAPRILSULIT1
 
PPTX
Modern analytical techniques used to characterize organic compounds. Birbhum ...
AyanHossain
 
PPTX
LEGAL ASPECTS OF PSYCHIATRUC NURSING.pptx
PoojaSen20
 
PPT on the Development of Education in the Victorian England
Beena E S
 
Gall bladder, Small intestine and Large intestine.pptx
rekhapositivity
 
HIRSCHSPRUNG'S DISEASE(MEGACOLON): NURSING MANAGMENT.pptx
PRADEEP ABOTHU
 
CLEFT LIP AND PALATE: NURSING MANAGEMENT.pptx
PRADEEP ABOTHU
 
Constitutional Design Civics Class 9.pptx
bikesh692
 
FULL DOCUMENT: Read the full Deloitte and Touche audit report on the National...
Kweku Zurek
 
Optimizing Cancer Screening With MCED Technologies: From Science to Practical...
i3 Health
 
PYLORIC STENOSIS: NURSING MANAGEMENT.pptx
PRADEEP ABOTHU
 
How to Configure Storno Accounting in Odoo 18 Accounting
Celine George
 
ROLE OF ANTIOXIDANT IN EYE HEALTH MANAGEMENT.pptx
Subham Panja
 
digestive system for Pharm d I year HAP
rekhapositivity
 
national medicinal plants board mpharm.pptx
SHAHEEN SHABBIR
 
A guide to responding to Section C essay tasks for the VCE English Language E...
jpinnuck
 
IMP NAAC REFORMS 2024 - 10 Attributes.pdf
BHARTIWADEKAR
 
Living Systems Unveiled: Simplified Life Processes for Exam Success
omaiyairshad
 
ANORECTAL MALFORMATIONS: NURSING MANAGEMENT.pptx
PRADEEP ABOTHU
 
Optimizing Cancer Screening With MCED Technologies: From Science to Practical...
i3 Health
 
ENGLISH LEARNING ACTIVITY SHE W5Q1.pptxY
CHERIEANNAPRILSULIT1
 
Modern analytical techniques used to characterize organic compounds. Birbhum ...
AyanHossain
 
LEGAL ASPECTS OF PSYCHIATRUC NURSING.pptx
PoojaSen20
 

Cognitive models unit 3

  • 2. Cognitive models • goal and task hierarchies • linguistic • physical and device • architectural ARULKUMAR V AP/CSE SECE
  • 3. Cognitive models • They model aspects of user: – understanding – knowledge – intentions – processing • Common categorisation: – Competence vs. Performance – Computational flavour – No clear divide ARULKUMAR V AP/CSE SECE
  • 4. Goal and task hierarchies • Mental processing as divide-and-conquer • Example: sales report produce report gather data . find book names . . do keywords search of names database . . . … further sub-goals . . sift through names and abstracts by hand . . . … further sub-goals . search sales database - further sub-goals layout tables and histograms - further sub-goals write description - further sub-goals ARULKUMAR V AP/CSE SECE
  • 5. goals vs. tasks • goals – intentions what you would like to be true • tasks – actions how to achieve it • GOMS – goals are internal • HTA – actions external – tasks are abstractions ARULKUMAR V AP/CSE SECE
  • 6. Issues for goal hierarchies • Granularity – Where do we start? – Where do we stop? • Routine learned behaviour, not problem solving – The unit task • Conflict – More than one way to achieve a goal • Error ARULKUMAR V AP/CSE SECE
  • 7. Techniques • Goals, Operators, Methods and Selection (GOMS) • Cognitive Complexity Theory (CCT) • Hierarchical Task Analysis (HTA) - Chapter 15 ARULKUMAR V AP/CSE SECE
  • 8. GOMS Goals – what the user wants to achieve Operators – basic actions user performs Methods – decomposition of a goal into subgoals/operators Selection – means of choosing between competing methods ARULKUMAR V AP/CSE SECE
  • 9. GOMS example GOAL: CLOSE-WINDOW . [select GOAL: USE-MENU-METHOD . MOVE-MOUSE-TO-FILE-MENU . PULL-DOWN-FILE-MENU . CLICK-OVER-CLOSE-OPTION GOAL: USE-CTRL-W-METHOD . PRESS-CONTROL-W-KEYS] For a particular user: Rule 1: Select USE-MENU-METHOD unless another rule applies Rule 2: If the application is GAME, select CTRL-W-METHOD ARULKUMAR V AP/CSE SECE
  • 10. Cognitive Complexity Theory • Two parallel descriptions: – User production rules – Device generalised transition networks • Production rules are of the form: – if condition then action • Transition networks covered under dialogue models ARULKUMAR V AP/CSE SECE
  • 11. Example: editing with vi • Production rules are in long-term memory • Model working memory as attribute-value mapping: (GOAL perform unit task) (TEXT task is insert space) (TEXT task is at 5 23) (CURSOR 8 7) • Rules are pattern-matched to working memory, e.g., LOOK-TEXT task is at %LINE %COLUMN is true, with LINE = 5 COLUMN = 23. ARULKUMAR V AP/CSE SECE
  • 12. Active rules: SELECT-INSERT-SPACE INSERT-SPACE-MOVE-FIRST INSERT-SPACE-DOIT INSERT-SPACE-DONE Four rules to model inserting a space New working memory (GOAL insert space) (NOTE executing insert space) (LINE 5) (COLUMN 23) SELECT-INSERT-SPACE matches current working memory (SELECT-INSERT-SPACE IF (AND (TEST-GOAL perform unit task) (TEST-TEXT task is insert space) (NOT (TEST-GOAL insert space)) (NOT (TEST-NOTE executing insert space))) THEN ( (ADD-GOAL insert space) (ADD-NOTE executing insert space) (LOOK-TEXT task is at %LINE %COLUMN)))ARULKUMAR V AP/CSE SECE
  • 13. Notes on CCT • Parallel model • Proceduralisation of actions • Novice versus expert style rules • Error behaviour can be represented • Measures – depth of goal structure – number of rules – comparison with device description ARULKUMAR V AP/CSE SECE
  • 14. Problems with goal hierarchies • a post hoc technique • expert versus novice • How cognitive are they? ARULKUMAR V AP/CSE SECE
  • 15. Linguistic notations • Understanding the user's behaviour and cognitive difficulty based on analysis of language between user and system. • Similar in emphasis to dialogue models • Backus–Naur Form (BNF) • Task–Action Grammar (TAG) ARULKUMAR V AP/CSE SECE
  • 16. Backus-Naur Form (BNF) • Very common notation from computer science • A purely syntactic view of the dialogue • Terminals – lowest level of user behaviour – e.g. CLICK-MOUSE, MOVE-MOUSE • Nonterminals – ordering of terminals – higher level of abstraction – e.g. select-menu, position-mouse ARULKUMAR V AP/CSE SECE
  • 17. Example of BNF • Basic syntax: – nonterminal ::= expression • An expression – contains terminals and nonterminals – combined in sequence (+) or as alternatives (|) draw line ::= select line + choose points + last point select line ::= pos mouse + CLICK MOUSE choose points ::= choose one | choose one + choose points choose one ::= pos mouse + CLICK MOUSE last point ::= pos mouse + DBL CLICK MOUSE pos mouse ::= NULL | MOVE MOUSE+ pos mouse ARULKUMAR V AP/CSE SECE
  • 18. Measurements with BNF • Number of rules (not so good) • Number of + and | operators • Complications – same syntax for different semantics – no reflection of user's perception – minimal consistency checking ARULKUMAR V AP/CSE SECE
  • 19. Task Action Grammar (TAG) • Making consistency more explicit • Encoding user's world knowledge • Parameterised grammar rules • Nonterminals are modified to include additional semantic features ARULKUMAR V AP/CSE SECE
  • 20. Consistency in TAG • In BNF, three UNIX commands would be described as: copy ::= cp + filename + filename | cp + filenames + directory move ::= mv + filename + filename | mv + filenames + directory link ::= ln + filename + filename | ln + filenames + directory • No BNF measure could distinguish between this and a less consistent grammar in which link ::= ln + filename + filename | ln + directory + filenames ARULKUMAR V AP/CSE SECE
  • 21. Consistency in TAG (cont'd) • consistency of argument order made explicit using a parameter, or semantic feature for file operations • Feature Possible values Op = copy; move; link • Rules file-op[Op] ::= command[Op] + filename + filename | command[Op] + filenames + directory command[Op = copy] ::= cp command[Op = move] ::= mv command[Op = link] ::= ln ARULKUMAR V AP/CSE SECE
  • 22. Other uses of TAG • User’s existing knowledge • Congruence between features and commands • These are modelled as derived rules ARULKUMAR V AP/CSE SECE
  • 23. Physical and device models • The Keystroke Level Model (KLM) • Buxton's 3-state model • Based on empirical knowledge of human motor system • User's task: acquisition then execution. – these only address execution • Complementary with goal hierarchies ARULKUMAR V AP/CSE SECE
  • 24. Keystroke Level Model (KLM) • lowest level of (original) GOMS • six execution phase operators – Physical motor: K - keystroking P - pointing H - homing D - drawing – Mental M - mental preparation – System R - response • times are empirically determined. Texecute = TK + TP + TH + TD + TM + TR ARULKUMAR V AP/CSE SECE
  • 25. KLM example GOAL: ICONISE-WINDOW [select GOAL: USE-CLOSE-METHOD . MOVE-MOUSE-TO- FILE-MENU . PULL-DOWN-FILE-MENU . CLICK-OVER-CLOSE-OPTION GOAL: USE-CTRL-W-METHOD PRESS-CONTROL-W-KEY] • compare alternatives: • USE-CTRL-W-METHOD vs. • USE-CLOSE-METHOD • assume hand starts on mouse USE-CLOSE-METHOD P[to menu] 1.1 B[LEFT down] 0.1 M 1.35 P[to option] 1.1 B[LEFT up] 0.1 Total 3.75 s USE-CTRL-W-METHOD H[to kbd] 0.40 M 1.35 K[ctrlW key] 0.28 Total 2.03 s ARULKUMAR V AP/CSE SECE
  • 26. Architectural models • All of these cognitive models make assumptions about the architecture of the human mind. • Long-term/Short-term memory • Problem spaces • Interacting Cognitive Subsystems • Connectionist • ACT ARULKUMAR V AP/CSE SECE
  • 27. Display-based interaction • Most cognitive models do not deal with user observation and perception • Some techniques have been extended to handle system output (e.g., BNF with sensing terminals, Display-TAG) but problems persist • Exploratory interaction versus planning ARULKUMAR V AP/CSE SECE