Поможем написать учебную работу
Если у вас возникли сложности с курсовой, контрольной, дипломной, рефератом, отчетом по практике, научно-исследовательской и любой другой работой - мы готовы помочь.
Если у вас возникли сложности с курсовой, контрольной, дипломной, рефератом, отчетом по практике, научно-исследовательской и любой другой работой - мы готовы помочь.
Agenda
Online lecture from Stanford HCI Group.
Scott Klemmer in Section with discussion.
In coming episodes
p.s. any questions on affinity diagramming or competitive analysis ?
What is usability?
A usable product:
• Supports routine performance
• Supports non-routine performance
• Reduces or prevents human error
• Prevents or recovers from system error
• Pleasant to use
usable ≠ useful
We want to improve usability!
If you cannot measure it,
you cannot improve it.
Usability Evaluation Methods
Empirical methods $ $ $
Observation
Experimentation
Analytical methods $
Derived from physical, psychological, sociological, or design theories
Heuristics derived from experience
Empirical (testing) methods
• Contextual inquiry > done
• Web analytics > coming
• Think aloud > coming
• Remote testing
• Log analysis
• Eye tracking
• “Wizard of Oz” studies
• Surveys and questionnaires
• Diary studies
Analytical (inspection) methods
• Heuristic evaluation (UIM1 Ch2)
• The GOMS (Goals, Operators, Methods, and Selection rules) family
Keystroke-Level Model (KLM)
• Cognitive walkthrough (UIM1 Ch5)
• Pluralistic walkthrough (UIM1 Ch3)
1UIM = Usability Inspection Methods, Nielsen &
Mack
Analytical (inspection) methods
“Discount usability engineering methods” Jakob Nielsen (not so much of $$)
Usually a small team of evaluators using analytical methods to review an interface based on recognized usability principles
Heuristic evaluation
Brief the group
Evaluate individually
Aggregate issues
Apply severity ratings
Summarize findings
Step 0: Brief the group
Heuristic evaluation methodology (this)
Domain briefing
Important if evaluators are unfamiliar with the products domain
Scenario briefing
Can optionally include specific tasks or scenarios or allow evaluators to explore on their own
Step 1: Evaluate individually
Two passes
1. Inspect flow (and optional tasks/scenarios)
2. Inspect each element against heuristics
Recognized usability principles
10 Nielsen heuristics (UIM Ch2, p.30)
Nielsens Heuristics
H1: Visibility of system status
H2: Match between system and real world
H3: User control and freedom
H4: Consistency and standards
H5: Error prevention
H6: Recognition rather than recall
H7: Flexibility and efficiency of use
H8: Aesthetic and minimalist design
H9: Error recovery
H10: Help and documentation
Step 3: Apply severity ratings
4 Catastrophic
Product cannot be released
3 Major
High-priority issue
2 Minor
Good to fix when theres a lull
1 Cosmetic
Icing on the cake (these rarely get done)
0 Not a problem
I dont agree that this is a problem at all
Justification:
Frequency: Common or rare occurrence?
Impact: How bad is it? How hard to recover?
Persistence: One-time problem users can work around or unavoidable problem?
For each issue, average the rating from each evaluator
Step 4: Summarize findings:
Executive summary
What are the important take-aways for people who do not read the individual Usability Aspect Reports?
Look for the forest in the trees
Consider affinity diagramming
Audience: Project managers, team leads
Heuristic evaluation advantages
“Discount usability engineering”
Low intimidation
Dont need to identify tasks, activities
Can identify obvious fixes
Can expose problems user testing doesnt
Provides a shared language for talking
about usability recommendations
Heuristic evaluation disadvantages
Un-validated
Inconsistent
False alarms -- problems unconnected with tasks
May be hard to apply to new technology
What is a competitive analysis?
A comparison between
two or more products
that meet similar user
needs.
Why perform a competitive analysis?
Understand the marketplace
Products become successful for a reason
Provide direction to management
Exploit strengths and weaknesses
Build domain knowledge
Learn best practices
Identify common patterns, language
When should you perform a competitive analysis?
Research phase
Study existing products to get the lay of the land
Evaluation phase
See how your product/prototype compares to existing products
Who is your audience?
Design team
Management
External stakeholders
What is your deliverable?
Presentation
Walkthroughs
Executive summary
What if you dont find competitors?
A: others tried and failed
B: you didnt look hard enough
C: its a blue ocean
Metrics
Feature checklist
Walkthrough
Expert review
User testing
Dependent on time, budget, access to competing products, and goals
Feature checklist
A high-level inventory of the features, content, and other attributes provided by each product
The point is not an exhaustive list but to highlight meaningful differences
Dont forget about attributes like
Price, license, availability
OS, hardware requirements
Popularity
Navigation tools, search
As you evaluate you may uncover new attributes you wish to evaluate
Walkthrough
Define tasks
For each product, perform tasks while taking screenshots (requires access!)
Assemble screenshots into a slideshow and provide captions describing user actions and system animations, feedback, and delays
Expert review
Heuristic evaluation (Nielson) holistic
Cognitive walkthrough task specific
User testing
Time on task
Think aloud protocol
Surveys, questionnaires
Step 3: Summarize products
Brief summary highlighting strengths, weaknesses, and unique features of each product
Include illuminating quotes, screenshots, and/or videos
Step 4: Recommend courses of action
Executive summary
If your product was analyzed, how did it compare?
Your audience will recall only a couple of recommendations and takeaways; make sure theyre the right ones
Executive summary
Executive summary
First we looked at twelve different chat clients and discovered that they basically do the same things but some of them have a lot of more customization options than our chat client does. Also, audio and video are popular.
Executive summary
While all chat clients offer similar core functionality, most offer more customization
options than ours. We recommend working
with users to determine whether additional
customization options would be useful. In
addition, several of the most popular chat
clients now offer audio and video
communication. We recommend considering
these features for future releases.
How might we improve the
measuring cup?
How might we improve the
measuring cup? (solution)
HCD Lessons:
Two Gulfs
The making of gulfs. How easily can someone:
To reduce gulfs, provide …
Bu using you know look at this:
Direct manipulation
Eye to the Future: Gestures
To learn more …
Mental Models
The goal: design beacons the right model
Conceptual model mismatch
Direct manipulation provides
“If technology is to provide an advantage, the correspondence to the real world must break down at some point.”
- Jonathan Grudin
To learn more …
H <-> H. How to interview people?
Possibly your most important skill
• hear about peoples experiences
• learn their meaning & feelings
• discover design opportunities
Interviewing skills a basis for more advanced methods--survey design, contextual inquiry, think-aloud, task analysis, and so forth
What and why?
An interview is a method of asking questions and listening
Uses a planned interview protocol a set of questions
Ask what you cant observe
I know you are a nursing supervisor. If I followed you through a typical day, what would I see you doing?
Types of questions
Close-ended (“forced choice”)
Open-ended
Question options
Behavioral questions
“Can you describe a recent occasion when
a patient alert was sounded, and tell me
what you did?”
Feeling questions
Knowledge questions
“If a patient says she is in pain, what do
you look for?”
Background; ratings (leave for last, or even better, a private questionnaire)
Planning
Decide whom you will interview
Plan your interview protocol
Ethical checklist:
Test your protocol and revise
Starting the interview
Everything depends on trust and rapport. So what do you do first?
[Rapport occurs when two or more people feel that they are in sync or on the same wavelength because they feel similar or relate well to each other.] by Wikipedia
Good and poor follow ups
Interview with John, a student in a drug treatment program.
I. Does anything in the program stand out for you?
J. Yeah, the hot seat
I. The hot seat is where someone is the focus of attention?
J. Right
I. So what was it like? Is it different with different people?
J. Yeah, it depends
Clear language
Interview with low-income mother who has been given an iPad for a research project on energy-saving practices
I. So, how do you like your iPad?
M. My son is using it.
I. What apps is he running?
M. Im not sure.
I. What about your Internet connectivity; is your wireless working ok?
Other good question types
Illustrative questions
Some nurses hate working at night, but others like the flexibility. Whats your experience?
Role-playing questions
Suppose I were a new nurse just coming to this hospital, and I asked you what I should do to succeed. What would you tell me?
Preparatory questions
Weve been talking about your job. Now I want to ask you about how you got to be where you are today.
Encourage your interviewee
That was really helpful.
We are about halfway through the interview. Its going really well. Hows it going for you?
I realize this is a sensitive issue for you. You should decide how comfortable you are talking about it.
Embodied cognition
• The idea is that we don't just think with our minds, we also think with our bodies
• A good posture to empathize with your interviewee is. . . their posture
• Best posture to understand your interviewee is. . their posture
• Mimicry works but NOT if the other is socially incompetent or resistant
The final interview question
What should I have asked you that I didnt think to ask?
Thats all I wanted to ask you. Anything you want to add?
(or)
How did the interview go for you? Keep the recorder on!
Lessons: Strategic interviewing
Information gathering not accusatory or blame-finding
I asked Scott, oh, where did everyone live?
“How did you get into the city when they blocked it off? “Who else was with you?”
Ask some unanticipated questions (less boring & less likely to be rehearsed) and dont be afraid to probe for examples or “tell me more”
Can you show me your wines?
Would you introduce me to your manager?
Lessons: Coding
• Trick is to get the right level, not replicate what the interviewee says but not so abstract as to be useless
• Think about themes that are actionablesomething you could improve through design
• Be sure to hit feelings, goals and subgoals, interactions with others, context
Design for people
Prototyping
Getting feedback not just making artifact
Communicate with other stakeholders
Prototyping is a efficient strategy for dealing with things that are hard to predict
focus on GOALS
evolve the DESIGNS
Right prototype
What prototypes prototype?
Feel |
What it might look like? |
Implementation |
What it might work like? |
role |
What might the experience be? |
“The best way to have good idea is to have a lot of ideas.” Linus Pauling
Class structure
Storyboards isnt about “pretty pictures”
Its about communicating ideas
Storyboards Should Convey
Benefits of Storyboarding
6 paper prototyping tips and tricks
Get Creative with Materials
More materials
Wizard of Oz technique
Wizard-of-Oz prototyping . . .
simulates machine behavior with human operators
Aardvark
“Why start-ups Must Pay Attention to Whats Behind The Curtain”
Venture Capital Dispatch WSJ
Making a Wizard powered prototype
Running Wizard powered prototypes
Advantages of Wizards
Disadvantages of Wizards
Benefits of Video Prototyping
What should the video show?
What are the steps?
Considerations
Creating and comparing alternatives
“The works of highest quality were all produced by the group being graded for quantity. It seems that while the “quantity” group was busily churning out piles of work - and learning from their mistakes - the “quality” group had sat theorizing about perfection, and in the end had little more to show for their efforts than grandiose theories and a pile of dead clay.” (Bayles and Orland, 2001)
Benefits of sharing multiple
Alignment guides the eye, reducing clutter
A brief word on color
Grids: to learn more …
How can you detect poor scent?
Low-scent navigation
Icons help when …
Improving scent: multi-word links
Prime real estate
Whitespace conveys grouping
“Some space might be narrow so that other space may be wide, and some space must be emptied so that other space may be filled.”
Use size contrasts to indicate hierarchy
“Information consists of differences that make a difference.”
Three basic tools of visual design
“Minute to learn and lifetime to master”
Challenges
“Legibility, in practice, amounts simply to what one is accustomed to” Eric Gill, 1931
No Robust Evidence for Serif Hypothesis
“What initially a neat dichotomous question of serif vs sans serif has resulted in a body of research consisting of weak claims and counter-claims, and study after study with findings of no difference. Is it the case that more than one hundred years of research has marred by repeated methodological flaws, or are serifs simply a typographical red herring?”
To improve typographical eye
Multiple ways to evaluate
When to get design critique?
Heuristic Evaluation
Nielsens Ten Heuristics
Evaluators Process
Why Multiple Evaluators?
Heuristic Eval: Cost-effective
Heuristics vs User Testing
Phases of Heuristic Evaluation
How-to: Heuristic Evaluation
How-to: Heuristic Evaluation
Severity Rating
Severity ratings
Severity Ratings Example
Debriefing
HEURISTICS
Show system status: Time
Show: space
Show: change
Show: next steps
Problem Solving as Representation
“Solving a problem simply means representing it so as to make the solution transparent”
- Herbert Simon, The Sciences of the Artificial
Working memory
Getting Things Done
When interfaces help people distribute cognition, it can . . .
A good representation
. . . shows all of the relevant information, and nothing else.
Should enable: