SE365 · Lecture 13 · Annotated SlidesInspections, Heuristics and Walkthroughs
Original
Overview

Inspections, Heuristics and Walkthroughs

Inspection methods without users: heuristic evaluation with Nielsen’s revised heuristics, number of evaluators, the three stages, advantages and problems, cognitive and pluralistic walkthroughs, and A/B testing.

How to read this page

Every original slide is shown unchanged. Yellow marks on a slide point to a numbered note: hover or tap a mark to jump to its note, and hover a note to see its marks. Questions tagged Past exam appeared on a real paper; Prediction questions are likely angles, not confirmed. Pick an answer to each question: a wrong pick tells you why it is wrong, so you can try again.

All 24 slides
  1. 1 Slide 1
  2. 2 Recap
  3. 3 Overview
  4. 4 Learning Outcomes
  5. 5 Introduction
  6. 6 Inspections
  7. 7 Heuristic evaluation
  8. 8 Revised version (2014) of Nielsen’s original heuristics
  9. 9 Revised version (2014) of Nielsen’s original heuristics
  10. 10 Revised version (2014) of Nielsen’s original heuristics
  11. 11 Revised version (2014) of Nielsen’s original heuristics
  12. 12 No. of evaluators & problems
  13. 13 Heuristics for websites focus on key criteria (Budd, 2007)
  14. 14 3 stages for doing heuristic evaluation
  15. 15 Activity
  16. 16 Discussion
  17. 17 Advantages and problems
  18. 18 Turning design guidelines and golden rules into heuristics
  19. 19 Cognitive walkthroughs
  20. 20 The 3 questions
  21. 21 The 3 questions
  22. 22 Pluralistic walkthrough
  23. 23 A/B Testing
  24. 24 Key points
Slide 1 / 24

Slide 1

Slide 1: Slide 1
Slide 2 / 24

Recap

Slide 2: Recap
Slide 3 / 24

Overview

Slide 3: Overview
Slide 4 / 24

Learning Outcomes

Slide 4: Learning Outcomes
Slide 5 / 24

Introduction

Slide 5: Introduction
Slide 6 / 24

Inspections

Slide 6: Inspections

Notes

  1. Inspections: experts role-play users to find problems (no users needed).

Slide 7 / 24

Heuristic evaluation

Slide 7: Heuristic evaluation

Notes

  1. Heuristic evaluation: experts check the interface against usability principles (heuristics).

Slide 8 / 24

Revised version (2014) of Nielsen’s original heuristics

Slide 8: Revised version (2014) of Nielsen’s original heuristics

Notes

  1. Tip Nielsen’s 10: visibility of system status · match with the real world · user control and freedom · consistency and standards · error prevention · recognition rather than recall · flexibility and efficiency · aesthetic and minimalist design · help users recognize, diagnose and recover from errors · help and documentation.

Exam angle

PredictionQ1

A progress bar while uploading supports which heuristic?

PredictionQ2

An "Undo" button supports:

Slide 9 / 24

Revised version (2014) of Nielsen’s original heuristics

Slide 9: Revised version (2014) of Nielsen’s original heuristics
Slide 10 / 24

Revised version (2014) of Nielsen’s original heuristics

Slide 10: Revised version (2014) of Nielsen’s original heuristics
Slide 11 / 24

Revised version (2014) of Nielsen’s original heuristics

Slide 11: Revised version (2014) of Nielsen’s original heuristics
Slide 12 / 24

No. of evaluators & problems

Slide 12: No. of evaluators & problems

Notes

  1. One evaluator finds ~35% of problems; 3–5 evaluators find ~75%.

Exam angle

PredictionQ1

How many evaluators are typically recommended for heuristic evaluation?

Slide 13 / 24

Heuristics for websites focus on key criteria (Budd, 2007)

Slide 13: Heuristics for websites focus on key criteria (Budd, 2007)
Slide 14 / 24

3 stages for doing heuristic evaluation

Slide 14: 3 stages for doing heuristic evaluation

Notes

  1. Three stages: briefing session → evaluation period (each expert alone, two passes) → debriefing session (prioritize problems).

Slide 15 / 24

Activity

Slide 15: Activity
Slide 16 / 24

Discussion

Slide 16: Discussion
Slide 17 / 24

Advantages and problems

Slide 17: Advantages and problems

Notes

  1. Advantages: cheap, quick, no users. Problems: false alarms, misses, experts aren’t real users.

Slide 18 / 24

Turning design guidelines and golden rules into heuristics

Slide 18: Turning design guidelines and golden rules into heuristics
Slide 19 / 24

Cognitive walkthroughs

Slide 19: Cognitive walkthroughs

Notes

  1. Cognitive walkthrough: simulate a user’s problem solving step by step; focuses on LEARNABILITY (ease of learning).

  2. Memory trick Three questions: Will the user know what to do? Will they see how to do it? Will they understand from the feedback whether it worked?

Exam angle

PredictionQ1

Cognitive walkthroughs mainly evaluate:

Slide 20 / 24

The 3 questions

Slide 20: The 3 questions
Slide 21 / 24

The 3 questions

Slide 21: The 3 questions
Slide 22 / 24

Pluralistic walkthrough

Slide 22: Pluralistic walkthrough

Notes

  1. Pluralistic walkthrough: users, developers and usability experts step through a scenario together.

Slide 23 / 24

A/B Testing

Slide 23: A/B Testing

Notes

  1. A/B testing: show two versions to different groups of real users online and compare a metric (clicks, conversions).

Exam angle

PredictionQ1

Showing half of visitors a green button and half a blue one, then comparing clicks, is:

Slide 24 / 24

Key points

Slide 24: Key points