Будь умным!


У вас вопросы?
У нас ответы:) SamZan.net

Routine performnce Reduces or prevents humn error Prevents or recovers from system error Plesnt to use usble useful We wnt to improve usbility If you cnnot mesu

Работа добавлена на сайт samzan.net:


Agenda

  1.  Evaluation overview
  2.  Usability evaluation methods
  3.  Heuristic evaluation

Online lecture from Stanford HCI Group.

Scott Klemmer in Section with discussion.

In coming episodes

  1.  Web analytics
  2.  Think aloud protocol
  3.  Clients: Reports

p.s. any questions on affinity diagramming or competitive analysis ?

What is usability?

A usable product:

• Supports routine performance

• Supports non-routine performance

• Reduces or prevents human error

• Prevents or recovers from system error

• Pleasant to use

usable ≠ useful

We want to improve usability!

If you cannot measure it,

you cannot improve it.

Usability Evaluation Methods

Empirical methods  $ $ $

– Observation

– Experimentation

Analytical methods $

– Derived from physical, psychological, sociological, or design theories

– Heuristics derived from experience

Empirical (testing) methods

• Contextual inquiry  > done

• Web analytics > coming

• Think aloud  > coming

• Remote testing

• Log analysis

• Eye tracking

• “Wizard of Oz” studies

• Surveys and questionnaires

• Diary studies

Analytical (inspection) methods

• Heuristic evaluation (UIM1 Ch2)

• The GOMS (Goals, Operators, Methods, and Selection rules) family

– Keystroke-Level Model (KLM)

• Cognitive walkthrough (UIM1 Ch5)

• Pluralistic walkthrough (UIM1 Ch3)

1UIM = Usability Inspection Methods, Nielsen &

Mack

Analytical (inspection) methods

“Discount usability engineering methods” –Jakob Nielsen (not so much of $$)

Usually a small team of evaluators using analytical methods to review an interface based on recognized usability principles

Heuristic evaluation

Brief the group

Evaluate individually

Aggregate issues

Apply severity ratings

Summarize findings

Step 0: Brief the group

Heuristic evaluation methodology (this)

Domain briefing

– Important if evaluators are unfamiliar  with the product’s domain

Scenario briefing  

– Can optionally include specific tasks or scenarios or allow evaluators to explore on their own

Step 1: Evaluate individually

Two passes

1. Inspect flow (and optional tasks/scenarios)

2. Inspect each element against  heuristics

Recognized usability principles

– 10 Nielsen heuristics (UIM Ch2, p.30) 

Nielsen’s Heuristics

H1: Visibility of system status

H2: Match between system and real world

H3: User control and freedom

H4: Consistency and standards

H5: Error prevention

H6: Recognition rather than recall

H7: Flexibility and efficiency of use

H8: Aesthetic and minimalist design

H9: Error recovery

H10: Help and documentation

Step 3: Apply severity ratings

4 Catastrophic

– Product cannot be released

3 Major

– High-priority issue

2 Minor

– Good to fix when there’s a lull

1 Cosmetic

– Icing on the cake (these rarely get done)

0 Not a problem

– I don’t agree that this is a problem at all

Justification:

– Frequency: Common or rare occurrence?

– Impact: How bad is it? How hard to recover?

– Persistence: One-time problem users can work around or unavoidable problem?

For each issue, average the rating from each evaluator

Step 4: Summarize findings:
Executive summary

What are the important take-aways for people who do not read the individual Usability Aspect Reports?

Look for the forest in the trees

– Consider affinity diagramming

Audience: Project managers, team leads

Heuristic evaluation advantages

“Discount usability engineering”

Low intimidation

Don’t need to identify tasks, activities

Can identify obvious fixes

Can expose problems user testing doesn’t

Provides a shared language for talking

about usability recommendations

Heuristic evaluation disadvantages

Un-validated

Inconsistent

False alarms -- problems unconnected with tasks

May be hard to apply to new technology

What is a competitive analysis?

A comparison between

two or more products

that meet similar user

needs.

Why perform a competitive analysis?

Understand the marketplace

– Products become successful for a reason

– Provide direction to management

– Exploit strengths and weaknesses

Build domain knowledge

– Learn best practices

– Identify common patterns, language

When should you perform a competitive analysis?

Research phase

– Study existing products to get the lay of the land

Evaluation phase

– See how your product/prototype compares to existing products

Who is your audience?

– Design team

– Management

– External stakeholders

What is your deliverable?

– Presentation

– Walkthroughs

– Executive summary

What if you don’t find competitors?

A: others tried and failed

B: you didn’t look hard enough

C: it’s a blue ocean

Metrics

– Feature checklist

– Walkthrough

– Expert review

– User testing

Dependent on time, budget, access to competing products, and goals

Feature checklist

A high-level inventory of the features, content, and other attributes provided by each product

The point is not an exhaustive list but to highlight meaningful differences 

Don’t forget about attributes like

– Price, license, availability

– OS, hardware requirements

– Popularity

– Navigation tools, search

As you evaluate you may uncover new  attributes you wish to evaluate

Walkthrough

Define tasks

For each product, perform tasks while taking screenshots (requires access!)

Assemble screenshots into a slideshow and provide captions describing user actions and system animations, feedback, and delays

Expert review

Heuristic evaluation (Nielson) – holistic

Cognitive walkthrough – task specific

User testing

Time on task

Think aloud protocol

Surveys, questionnaires

Step 3: Summarize products

Brief summary highlighting strengths, weaknesses, and unique features of each product

Include illuminating quotes, screenshots, and/or videos

Step 4: Recommend courses of action

Executive summary

If your product was analyzed, how did it compare?

Your audience will recall only a couple of recommendations and takeaways; make sure they’re the right ones

Executive summary

  1.  Lead with something interesting
  2.  Provide recommendations or conclusions and justify them
  3.  Use proper grammar (see Strunk & White)
  4.  If you can remove a word, do it
  5.  <10% overall length of the report

Executive summary

First we looked at twelve different chat clients and discovered that they basically do the same things but some of them have a lot of more customization options than our chat client does. Also, audio and video are popular.

Executive summary

While all chat clients offer similar core functionality, most offer more customization

options than ours. We recommend working

with users to determine whether additional

customization options would be useful. In

addition, several of the most popular chat

clients now offer audio and video

communication. We recommend  considering

these features for future releases.

How might we improve the
measuring cup?

  1.  It sometimes slippery
  2.  Handles get hot
  3.  Nobody complained about measuring part
  4.  But how do you measure the liquid level?

How might we improve the
measuring cup? (solution)

  1.  Numbers are visible from above
  2.  Elegant solution by OXO’s Alex Lee.
  3.  Still improvements: looks like medical device.

HCD Lessons:

  1.  I he asked people what they wanted, they would have said faster horses. Remember?
  2.  FOR User Interfaces:
  3.  Observing actions
  4.  Evaluating outcomes

Two Gulfs

  1.  First step to cross: The Gulf of Execution
  2.  How the user know what to do?
  3.  Second step to cross: The Gulf of Evaluation
  4.  How the user know what happened?

The making of gulfs. How easily can someone:

  1.  Determine the function of the device?
  2.  Tell what actions are possible?
  3.  Determine mapping from intention to physical movement?
  4.  Perform the action?
  5.  Tell what state the system is in? / if its in desired state?
  6.  Determine mapping from state to interpretation

To reduce gulfs, provide …

  1.  Visibility (perceived affordances or signifiers)
  2.  Feedback
  3.  Consistency (also known as standards)
  4.  Non-destructive operations (hence the importance of undo)
  5.  Discoverability: All operations can be discovered by systematic  exploration of menus
  6.  Reliability. Operations should work. Period. And events should not happen suddenly.

Bu using you know look at this:

  1.  video

Direct manipulation

  1.  Immediate feedback on actions
  2.  Continuous representation  of objects
  3.  Leverage metaphor

Eye to the Future: Gestures

  1.  The solution to menu creep?
  2.  Even more direct?

To learn more …

  1.  Don Norman, The Design of Everyday Things
  2.  Hutchins, Hollan, Norman, Direct manipulation interfaces, 1985

Mental Models

  1.  Key to good design:
  2.  What makes an interface learnable?
  3.  What leads to errors?

The goal: design beacons the right model

  1.  User’s model develops through interaction with the system
  2.  Designers often expects user’s model to be the same as theirs
  3.  But often it isn’t!

Conceptual model mismatch

  1.  Mismatch between designer’s & user’s conceptual models leads to …
  2.  Slow performance
  3.  Errors
  4.  Frustration
  5.  

  1.  Mental models arise from experience, metaphor; and analogical reasoning
  2.  “A text processor is a typewriter”
  3.  We have models (beliefs) about our own behavior, of others, of objects, software …
  4.  Our models are incomplete, inconsistent, unstable in time, and often rife with superstition

Direct manipulation provides

  1.  Leverages real-world metaphors
  2.  Good idea of how each object works and how to control it.
  3.  Interface discloses how to use it.

If technology is to provide an advantage, the correspondence to the real world must break down at some point.”
- Jonathan Grudin

To learn more …

  1.  JM Carroll, JR Olson, Mental models in human-computer interaction: Research issues, 1987
  2.  Don Norman, Design of Everyday Things
  3.  James Reason, Human Error

H <-> H. How to interview people?

Possibly your most important skill

• hear about people’s experiences

• learn their meaning & feelings

• discover design opportunities

Interviewing skills a basis for more advanced  methods--survey design, contextual inquiry, think-aloud, task analysis, and so forth

What and why?

An interview is a method of asking questions and listening

– Uses a planned interview protocol – a set of questions

– Ask what you can’t observe

I know you are a nursing supervisor. If I followed you through a typical day, what would I see you doing? 

Types of questions

Close-ended (“forced choice”)

  1.  In what year were you born?
  2.  Are you satisfied with your hospital?
  3.  On a scale from 1 to 10, how much do you like your job?

Open-ended

  1.  What is the most enjoyable part of your job?
  2.  If I were in the emergency room of your hospital, what would I notice first? 

Question options

Behavioral questions

“Can you describe a recent occasion when

a patient alert was sounded, and tell me

what you did?”

Feeling questions

Knowledge questions

“If a patient says she is in pain, what do

you look for?”

Background; ratings (leave for last, or even better, a private questionnaire) 

Planning

Decide whom you will interview

Plan your interview protocol

Ethical checklist:

  1.  How will you explain your purpose?
  2.  What promises will you make?
  3.  Any risks, psychological or otherwise?
  4.  How will you achieve confidentiality and data security?
  5.  How will you get informed consent?
  6.  How will you record and take notes?

Test your protocol and revise

Starting the interview

Everything depends on trust and rapport. So what do you do first?

[Rapport occurs when two or more people feel that they are in sync or on the same wavelength because they feel similar or relate well to each other.] by Wikipedia

Good and poor follow ups

Interview with John, a student in a drug treatment program.

I. Does anything in the program stand out for you?

J. Yeah, the hot seat

I. The hot seat is where someone is the focus of attention?

J. Right

I. So what was it like? Is it different with different people?

J. Yeah, it depends 

Clear language

Interview with low-income mother who has been given an iPad for a research project on energy-saving practices

I. So, how do you like your iPad?

M. My son is using it.

I. What apps is he running?

M. I’m not sure.

I. What about your Internet connectivity; is your wireless working ok? 

Other good question types

Illustrative questions

Some nurses hate working at night, but others like the flexibility. What’s your experience?

Role-playing questions

Suppose I were a new nurse just coming to this hospital, and I asked you what I should do to succeed. What would you tell me?

Preparatory questions

We’ve been talking about your job. Now I want to ask you about how you got to be where you are today. 

Encourage your interviewee

That was really helpful.

We are about halfway through the interview. It’s going really well. How’s it going for you?

I realize this is a sensitive issue for you. You should decide how comfortable you are talking about it. 

Embodied cognition

• The idea is that we don't just think with our minds, we also think with our bodies

• A good posture to empathize with your interviewee is. . . their posture

• Best posture to understand your interviewee is. . their posture

• Mimicry works but NOT if the other is socially incompetent or resistant

The final interview question

What should I have asked you that I didn’t think to ask?

That’s all I wanted to ask you. Anything you want to add?

(or)

How did the interview go for you? Keep the recorder on!

Lessons: Strategic interviewing

Information gathering not accusatory or blame-finding

– I asked Scott, oh, where did everyone live?

– “How did you get into the city when they blocked it off? “Who else was with you?”

Ask some unanticipated questions (less boring & less likely to be rehearsed) and don’t be afraid to probe for examples or “tell me more”

– Can you show me your wines?

– Would you introduce me to your manager?

Lessons: Coding

• Trick is to get the right level, not replicate what the interviewee says but not so abstract as to be useless

• Think about themes that are actionable—something you could improve through design

• Be sure to hit feelings, goals and subgoals, interactions with others, context

Design for people

  1.  People’s tasks, goals and values drive development
  2.  Work processes of the users within the work
  3.  Access decisions from the user’s point of view
  4.  Context awareness.
  5.  Talk to the actual experts.
  6.  “Users are the only one of the stakeholders (decision makers) in the process” Jh. Zimmerman

Prototyping

  1.  Tremendously valuable strategy (one of the biggest skills you will get from the class)
  2.  Rapid creation of the approximation of design idea

Getting feedback not just making artifact

Communicate with other stakeholders

Prototyping is a efficient strategy for dealing with things that are hard to predict

focus on GOALS

evolve the DESIGNS

Right prototype

  1.  Not complete (in strategic way)
  2.  Easy to change
  3.  Ready for retire

What prototypes prototype?

Feel

What it might look like?

Implementation

What it might work like?

role

What might the experience be?

“The best way to have good idea is to have a lot of ideas.” Linus Pauling

Class structure

  1.  Lab hours (2 hrs):
  2.  1st hour: group presentations, weekly milestones
  3.  2nd hour: workshops
  4.  Practice hours (1 hr):
  5.  Article discussions, case-studies
  6.  Lectures (1 hr):
  7.  First half – emphasis on the main concepts
  8.  Second half – class activity on the given material

Storyboards isn’t about “pretty pictures”

It’s about communicating ideas

Storyboards Should Convey

  1.  Setting
  2.  People involved
  3.  Environment
  4.  Task being accomplished
  5.  Sequence
  6.  What steps are involved?
  7.  What leads someone to use the app?
  8.  What task being illustrated?
  9.  Satisfaction
  10.  What’s motivates people to use this system?
  11.  What does it enable people to accomplish?
  12.  What need does the system fill?
  13.  

Benefits of Storyboarding

  1.  Holistic focus: Helps emphasize how an interface accomplishes a task
  2.  Avoids commitment to a particular user interface (no buttons yet)
  3.  Helps get all stakeholders on the same page in terms of the goal

6 paper prototyping tips and tricks

  1.  Keep all your materials in one place! Small interface widgets tend to get lost or damaged easily
  2.  Work quickly and make reusable components (buttons, etc)
  3.  If something is difficult to simulate (progress indicators, right mouse menus, hyperlinks), have user ask if it is available and then verbally describe interaction.
  4.  Backgrounds (25cm x 29cm poster board) can be useful to contain
  5.  Don’t be afraid to mix and match hardware and software! For instance, if size constraints are important, you might want to make a blinder using a photograph of the device that would be used and manipulate the prototype within the frame.
  6.  When appropriate, add context by including familiar operating system components.

Get Creative with Materials

  1.  Widgets: Paper, Cardboards, Transparencies
  2.  Connectors: Tape, Glue, Rubber Cement
  3.  Drawing: Pens, Pencils, Markers
  4.  … and more

More materials

  1.  Poster board, unlined index cards, a foam core are all useful depending on the size of your prototype
  2.  Removable tape or restickable glue is useful for changing components quickly
  3.  Transparency pens allow the user to input content – use a sheet of transparency paper for the input field
  4.  Use wide-tipped pens and markers (think Sharpie) – smaller line widths can be difficult to see
  5.  Use stacks of index cards to simulate tabbed dialog boxes.

Wizard of Oz technique

  1.  Make an interactive app without (much) code
  2.  Front end interface
  3.  (remote) wizard controls user interface
  4.  Makes sense when it’s faster/cheaper/easier than making real thing
  5.  Get feedback from users people
  6.  Hi-fidelity: users think it’s more real
  7.  Low-fidelity: more license to suggest changes

Wizard-of-Oz prototyping . . .

simulates machine behavior with human operators

Aardvark

“Why start-ups Must Pay Attention to What’s Behind The Curtain”

– Venture Capital Dispatch WSJ

Making a Wizard powered prototype

  1.  Map out scenarios and application flow
  2.  What should happen in response to user behavior?
  3.  Put together interface “skeleton”
  4.  Develop “hooks” for wizard input
  5.  Where and how the wizard will provide input?
  6.  Selecting the next screen, entering text, entering a zone, recognizing speech, etc.
  7.  Remember that later you’ll need to replace with computer
  8.  Rehearse Wizard with a colleague

Running Wizard powered prototypes

  1.  Practice with friends first
  2.  Once you’re comfortable recruit ‘users’
  3.  Two roles: facilitator and wizard
  4.  Facilitator provides tasks (paper) and takes notes
  5.  Wizard operates interface (more authentic if hidden or remote)
  6.  User feedback can be:
  7.  Think Aloud (speak freely as performing tasks)
  8.  Retrospective (best when think aloud distracts)
  9.  Heuristic evaluation (works with experts too)
  10.  Debrief users (reveal wizard if needed)

Advantages of Wizards

  1.  Fast and thus, cheaper and more iterative prototypes
  2.  Creating multiple variations is easy
  3.  More “real” than paper prototyping
  4.  Identifies bugs and problems with current design
  5.  Places the user at the center of development
  6.  Can envision challenging-to-build application
  7.  Designer learn by playing wizard

Disadvantages of Wizards

  1.  Simulations may represent otherwise imperfect tech
  2.  May simulate tech that doesn’t exist yet (and may never)
  3.  Wizard require training and may be inconsistent
  4.  Playing wizard can be exhausting
  5.  Some features (and limitations) are difficult/impossible to simulate effectively
  6.  May be inappropriate in some venues (e.g. home)

Benefits of Video Prototyping

  1.  Cheap and Fast
  2.  Great communication tools
  3.  Helps achieve common ground
  4.  Ideally portable and self-explanatory
  5.  Can serve as a ‘spec’ for developers
  6.  Ties interface designs to tasks
  7.  Aligns and orients interface choices
  8.  Makes sure you have a complete interface
  9.  And that there’s nothing extra

What should the video show?

  1.  Like a storyboard, the whole task, including motivation and success
  2.  Establishing shots and narrative help
  3.  Draw on tasks you’ve observed
  4.  Illustrate important tasks your system enables
  5.  Can help scope a minimum-viable-product
  6.  Changes what design teams argue about (in a good way)

What are the steps?

  1.  Start with an outline (or your storyboards)
  2.  Fine to extemporize
  3.  Equipment
  4.  A camera. Could be a phone. Built-in laptop camera
  5.  People
  6.  a realistic location
  7.  In general, focus on message more than production values

Considerations

  1.  Can use audio or a silent movie with title cards (audio can be too wordy)
  2.  Interface can paper, mockups, code or invisible (just showing the task)
  3.  Can show both success and failure (of your interface and others)
  4.  Edit as little as possible because editing is hugely time-consuming (in camera/pause editing is most efficient)
  5.  

Creating and comparing alternatives

  1.  Quantity or Quality?

“The works of highest quality were all produced by the group being graded for quantity. It seems that while the “quantity” group was busily churning out piles of work - and learning from their mistakes - the “quality” group had sat theorizing about perfection, and in the end had little more to show for their efforts than grandiose theories and a pile of dead clay.” (Bayles and Orland, 2001)

Benefits of sharing multiple

  1.  More individual exploration
  2.  More features sharing
  3.  More conversational turns
  4.  Better consensus
  5.  Increase in group rapport

Alignment guides the eye, reducing clutter

  1.  Avoid slight misalignments 
  2.  they undermine your ability to beacon organization.
  3.  We ‘automatically’ notice patterns
  4.  and deviations
  5.  So when you deviate from a pattern
  6.  do so strategically
  7.  And use visual proximity and scale
  8.  to convey semantic information

A brief word on color

  1.  Pay attention to it
  2.  Design in grayscale first
  3.  Keep luminance values from grayscale when moving to color

Grids: to learn more …

  1.  Kevin Mullet and Darrel Sano, Designing Visual Interfaces
  2.  Luke Wroblewski, Web Form Design
  3.  Jan Tschichold, The New Typography

How can you detect poor scent?

  1.  Flailing
  2.  Low confidence
  3.  Back button

Low-scent navigation

  1.  Surprising categories
  2.  Short links
  3.  Hidden navigation
  4.  Icons provide little additional information.

Icons help when …

  1.  They facilitate repeat recognition
  2.  When you know what something looks like but not what it’s called
  3.  Good redundant coding can help

Improving scent: multi-word links

  1.  With specific, recognizable terms
  2.  Trigger words, not “clever” terms
  3.  This also helps accessibility

Prime real estate

  1.  Above the fold
  2.  Where people expect
  3.  Where other pages put similar content
  4.  Not where ads usually

Whitespace conveys grouping

“Some space might be narrow so that other space may be wide, and some space must be  emptied so that other space may be filled.”

Use size contrasts to indicate hierarchy

“Information consists of differences that make a difference.”

Three basic tools of visual design

  1.  Typography
  2.  Layout
  3.  Color

Minute to learn and lifetime to master

Challenges

  1.  Individual differences dwarf manipulation effects
  2.  i.e. some people read faster than others. If there is an effect, it’s very small.
  3.  Confound: Reading requires familiarity
  4.  Dependent Variable? Speed? Comprehension?

“Legibility, in practice, amounts simply to what one is accustomed to” – Eric Gill, 1931

No Robust Evidence for Serif Hypothesis

“What initially a neat dichotomous question of serif vs sans serif has resulted in a body of research consisting of weak claims and counter-claims, and study after study with findings of ‘no difference’. Is it the case that more than one hundred years of research has marred by repeated methodological flaws, or are serifs simply a typographical ‘red herring’?”

To improve typographical eye

  1.  Use typefaces in multiple places to see its range
  2.  Display the same text with different typefaces to change its effect

Multiple ways to evaluate

  1.  Empirical assess with real users
  2.  Formal methods and formulas to calculate measures
  3.  Automated software measures
  4.  Critique: expertise and heuristic feedback

When to get design critique?

  1.  Before user testing: Don’t waste users on the small stuff. Critique can identify minor issues that can be resolved before testing, allowing users to focus on big issues.
  2.  Before redesigning: Don’t throw out the baby with the bathwater: critique can help you learn what works and what should change.
  3.  When you know there are problems, but you need evidence. Perhaps you’ve received complaints from customers or found yourself stumbling around your site. Critique can help you articulate problems and provide you with ammunition for redesign.
  4.  Before release: smooth off rough edges.

Heuristic Evaluation

  1.  Developed by Jacob Nielsen
  2.  Helps find usability problems in a design
  3.  Small set (3-5) of evaluators to examine UI
  4.  Independently check for compliance with usability principles (“heuristics”)
  5.  Different evaluators will find different problems
  6.  Evaluators only communicate afterwards:
    1.  Finding are then aggregated
  7.  Can perform on working UI or sketches

Nielsen’s Ten Heuristics

  1.  Visibility of System Status
  2.  Match between System and World
  3.  User Control & Freedom
  4.  Consistency & Standards
  5.  Error Prevention
  6.  Recognition Rather than Recall
  7.  Flexibility & Efficiency of Use
  8.  Aesthetic & Minimalist Design
  9.  Help Users Recognize, Diagnose, & Recover from Errors
  10.  Help and Documentation

Evaluators’ Process

  1.  Step through design several times
  2.  Examine details, flow and architecture
  3.  Consult list of usability principles
  4.  … and everything else that comes to mind
  5.  Which principles?
  6.  Nielsen’s “heuristics”
  7.  Category-specific heuristics from
    1.  E.g. Design goals, competitive analysis, existing design
  8.  User violations to redesign/fix problems

Why Multiple Evaluators?

  1.  No evaluator finds everything
  2.  Some find more than others

Heuristic Eval: Cost-effective

  1.  In one case: benefit-cost ratio of 48
  2.  Estimated benefit $500,000; cost $10,500
  3.  Value of each problem ~15K
  4.  How might we calculate this value?
    1.  In-house -> productivity; open market -> sales
  5.  Severe problems found more often
  6.  Single evaluator achieves poor results
    1.  Only finds 35% of usability problems
    2.  5 evaluators find ~75% of problems

Heuristics vs User Testing

  1.  Heuristic Evaluation often faster:
  2.  1-2 hours each evaluator
  3.  HE presets come pre-interpreted
  4.  User testing is more accurate (by def.)
  5.  Takes into account actual users and tasks
  6.  HE may miss problems & find “false positives”
  7.  Valuable to alternate methods
  8.  Find different problems
  9.  Don’t waste participants

Phases of Heuristic Evaluation

  1.  1. Pre-evaluation training: give evaluators needed domain knowledge and information on the scenario
  2.  2. Evaluation: individuals evaluate and then aggregate results
  3.  3. Severity rating: determine how severe each problem is (priority). Can do first individually and the as a group.
  4.  4. Debriefing: review with design team

How-to: Heuristic Evaluation

  1.  At least two passes for each evaluator
  2.  First to get feel for flow and scope of system
  3.  Second to focus on specific elements
  4.  If system is walk-up-and-use or evaluators are domain experts, no assistance needed
  5.  Otherwise might supply evaluators with scenarios
  6.   Each evaluator produces list of problems
  7.  Explain why with reference to heuristic or other information
  8.  Be specific and list each problem separately

How-to: Heuristic Evaluation

  1.  Why separate listings for each violation?
  2.  Risk of repeating problems aspect
  3.  May not be possible to fix all problems
  4.  Where problems may be found
  5.  Single location in UI
  6.  Two or more locations that need to be compared
  7.  Problem with overall structure of UI
  8.  Something is missing
    1.  Ambiguous with early prototypes; clarify in advance
    2.  Sometimes features are implied by design docs and just haven’t been “implemented” – relax on those.

Severity Rating

  1.  Independently estimate after review
  2.  Allocate resources to fix problems
  3.  Estimate need for more usability efforts
  4.  Severity combines
  5.  Frequency
  6.  Impact
  7.  Persistence

Severity ratings

  1.  0 – don’t agree that this is a usability problem
  2.  1 – cosmetic problem
  3.  2 – minor usability problem
  4.  3 – major usability problem; important to fix
  5.  4 – usability catastrophe; imperative to fix;

Severity Ratings Example

  1.  Issue: unable to edit one’s weight
  2.  Severity: 2
  3.  Heuristic violated: User control and freedom
  4.  Description: when you open the app for the first time, you have to enter your weight, but you cannot update it. It could be useful if you mistyped your weight, or if one year or two after the first use of the app, your weight has changed.

Debriefing

  1.  Conduct with evaluators, observers, and development team members
  2.  Discuss general characteristics of UI
  3.  Suggest potential improvements to address major usability problems
  4.  Dev. team rates effort to fix
  5.  Brainstorm solutions

HEURISTICS

  1.  Show system status
  2.  Familiar metaphors and language
  3.  Control and freedom
  4.  Consistency
  5.  Error prevention
  6.  Recognition over recall
  7.  Flexibility and efficiency
  8.  Aesthetic & minimalistic design
  9.  Recognize, diagnose & recover errors
  10.  Help

Show system status: Time

  1.  Feedback depends on response time:
  2.  < 1s: just show outcome
  3.  ~ 1s: feedback that activity is underway
  4.  >> 1s: show functional progress; time

Show: space

  1.  Feedback above is telling I’m out of space in Gmail account.

Show: change

  1.  You’ve changed doc, want to save?

Show: next steps

  1.  It’s important for user to know what is actionable for the next. They don’t see the problem, but have a solution provided already.
  2.  Answers already in the message.

Problem Solving as Representation

“Solving a problem simply means representing it so as to make the solution transparent”

- Herbert Simon, The Sciences of the Artificial

Working memory

  1.  Capacity: 2 +/- 2 (don’t require your users to remember)

Getting Things Done

  1.  Task management system
  2.  Whenever something comes to mind, just write it down immediately.

When interfaces help people distribute cognition, it can . . .

  1.  Encourage experimentation
  2.  Scaffold learning and reduce errors through redundancy
  3.  Show (only) differences that matter
  4.  Convert slow calculation into fast perception
  5.  Support chunking, especially by experts
  6.  Increase efficiency
  7.  Facilitate collaboration

A good representation

. . . shows all of the relevant information, and nothing else.

Should enable:

  1.  Comparison
  2.  Exploration
  3.  Problem solving



1. ПО ТЕМЕ 23- Патогенное действие факторов внешней и внутренней среды
2. Недавно я вернул те потерянные воспоминания линию фактов за сделанным желанием мое обещание в моего старше
3. контрольна робота 1 з дисципліни Сучасна теорія управління Варіант 2 Виконав-
4. Курсовая работа- Статистика предприятия
5. реферат дисертації на здобуття наукового ступеня кандидата технічних наук ОДЕСА ~ 2001 Дисертаці
6. Сибирское правительство упорные бои развернулись в Уральске и в Семиречье
7. го століття голодомор 193233 років був другим масовим голодом на території України.
8. IV За'ы 'олданушылар назарына 'олданушылар'а ы'айлы болуы 'шін Р'АО мазм'нды жасады
9. Лекція 1 Екологія як галузь науки та практичної діяльності людини
10. Технологическое оборудование отрасли Специальное технологическое оборудование и Технологическое обо
11. Современная разговорная речь
12. головная боль При сборе анамнеза установлено что все они накануне в магазине купили алычовую пастилу
13. темам а также к психике атлета
14. 2Р Р 894 Составитель- ст
15. криминологические проблемы совершенствования законодательства о борьбе с преступностью
16. реферата 1 Вступление 2
17. РЕФЕРАТ дисертації на здобуття наукового ступеня кандидата медичних наук Запоріжжя ~ Ди
18. Водень як альтернативний вид палив
19. А на 23 ммГраница протеза на нижней челюсти с вестибулярной стороны проходит по переходной складке захват
20. Контрольная работа.html