SE401 · Software Quality · Annotated SlidesSoftware Quality
Original
Overview

Software Quality

Factors in project success and failure (Chaos report), the HealthCare.gov launch case study, reliability metrics (MTTF, MTTR, MTBF, availability), the spectrum of quality attributes (correctness, reliability, robustness, safety…), the cost of quality and of defects, verification and validation, the V-model and the levels of testing.

How to read this page

Every original slide is shown unchanged. Yellow marks on a slide point to a numbered note: hover or tap a mark to jump to its note, and hover a note to see its marks. Questions tagged Past exam appeared on a real paper; Prediction questions are likely angles, not confirmed. Pick an answer to each question: a wrong pick tells you why it is wrong, so you can try again.

All 79 slides
  1. 1 Slide 1
  2. 2 • ƒ –‘”•‹”‘Œ‡ –— ‡•• ƒ‹Ž—”‡
  3. 3 Slide 3
  4. 4 • ƒ›•‘ˆ–™ƒ”‡”‡Žƒ–‡†ˆƒ‹Ž—”‡•ƒ—–‘’‹Ž‘–•›•–‡•ƒ‹”–”ƒˆˆ‹  ‘–”‘Ž•›•–‡• „ƒ‹‰•›•–‡• 
  5. 5 ‘ˆ–™ƒ”‡”‘Œ‡ –•Šƒ˜‡ƒ–‡””‹„Ž‡–”ƒ ”‡ ‘”†
  6. 6 ”‘Œ‡ –— ‡•• ›’‡Š‡’”‘Œ‡ –‹• ‘’Ž‡–‡†‘–‹‡ƒ†‘„—†‰‡– ™‹–ŠƒŽŽˆ‡ƒ–—”‡•ƒ†ˆ— –‹‘•ƒ•‹‹–‹ƒŽŽ›•’‡ ‹ˆ‹‡† 
  7. 7 ɎɖɖɏŏɏɍɎɔ
  8. 8 ƒ•‡–—†› Š‡ ‹–‹ƒŽƒ— Š‘ˆ ‡ƒŽ–Šƒ”‡‰‘˜
  9. 9 Š ‡ƒŽ–Šƒ”‡ō‰‘˜
  10. 10 • ‡”ˆ‘”ƒ ‡”‡•’‘•‡–‹‡Žƒ†‹‰’ƒ‰‡•
  11. 11 ‡ƒŽ–Šƒ”‡ō‰‘˜ŠŠ‡‘–”ƒ –‘”•ĖŠ‡‘•–
  12. 12 ‡ƒŽ–Šƒ”‡ō‰‘˜ŠŠ‡ ƒ‹Ž—”‡•Š‘ˆ–™ƒ”‡‰ō
  13. 13 • ˜‘Ž˜‹‰‘ŽŽ‹‰‡“—‹”‡‡–•
  14. 14 ƒ•‡–—†›Ō ‡ƒŽ–Šƒ”‡ō‰‘˜Š ‹•‡›Ŗ‡†‡ƒŗ••‡••‡–
  15. 15 • ƒƒ‰‡‡–‡š’‡”–‹•‡‹•‹‰‡––‹‰ ‘–”ƒ –•‘–†‡Ž‹˜‡”‹‰ ’”‘Œ‡ –•
  16. 16 • ‘˜‡”‡– ’”‘Œ‡ –•
  17. 17 • „—‰ˆ‹š‡•„›–Š‡‡†‘ˆ‘˜
  18. 18 • ••—‡•‘†ƒ–ƒƒ —”ƒ ›ƒ† ‘’Ž‡–‡‡••
  19. 19 •  ‡–—”‡ –‘‘‘˜‡”‹ ƒƒ•–Š‡Ž‡ƒ† ‘–”ƒ –‘”ˆ‘”†‡˜‡Ž‘’‡– ƒ†ƒ‹–‡ƒ ‡
  20. 20 • ”‘ŽŽ‡–ˆ‘”•–ƒ–‡•
  21. 21 • †‘’–•‘ˆ–™ƒ”‡‡‰‹‡‡”‹‰„‡•–’”ƒ –‹ ‡•
  22. 22 Slide 22
  23. 23 • ‡”ˆ‘”ƒ ‡
  24. 24 • ™‘‡›‡–”‹ •ˆ‘”‹–”‹•‹ ’”‘†— –“—ƒŽ‹–›ƒ”‡‡ƒ‹‡‘ ƒ‹Ž—”‡  ƒ†ƒ˜ƒ‹Žƒ„‹Ž‹–›
  25. 25 • ‡ƒ–‹‡„‡–™‡‡ˆƒ‹Ž—”‡•
  26. 26 • ˜ƒ‹Žƒ„‹Ž‹–›
  27. 27 • ‘ˆ–™ƒ”‡ƒ˜ƒ‹Žƒ„‹Ž‹–›‹•–Š‡’”‘„ƒ„‹Ž‹–›–Šƒ–ƒ’”‘‰”ƒ‹•‘’‡”ƒ–‹‰ ƒ ‘”†‹‰–‘”‡“—‹”‡‡–•ƒ–ƒ‰‹˜‡’‘‹–‹–‹‡ƒ†‹•†‡ˆ‹‡†ƒ•
  28. 28 • ‡Ž‹ƒ„‹Ž‹–›†‡’‡†•‘–Š‡ —‹– ‘ˆ‘’‡”ƒ–‹‘
  29. 29 • –‡‰”ƒ–‹‘–‡•–‹‰
  30. 30 •  ‡’–ƒ ‡–‡•–‹‰
  31. 31 Slide 31
  32. 32 ‘‡’‘••‹„Ž‡†‡ˆ‹‹–‹‘• • —ƒŽ‹–›œ‡”‘†‡ˆ‡ –•”‘•„›
  33. 33 ‘ˆ–™ƒ”‡›•–‡—ƒŽ‹–‹‡•
  34. 34 • ‘””‡ –‡••
  35. 35 • ƒˆ‡–›
  36. 36 • ‘””‡ –‡••‹•ƒƒŽŽ‘”‘–Š‹‰’”‘’‘•‹–‹‘
  37. 37 • ˆ‘”ƒŽŽ›•‘ˆ–™ƒ”‡‹•”‡Ž‹ƒ„Ž‡‹ˆ–Š‡—•‡” ƒ†‡’‡†‘‹–Š‡ •’‡ ‹ƒŽ‹œ‡†Ž‹–‡”ƒ–—”‡‘•‘ˆ–™ƒ”‡”‡Ž‹ƒ„‹Ž‹–›†‡ˆ‹‡•”‡Ž‹ƒ„‹Ž‹–›‹–‡”•
  38. 38 • ’”‘‰”ƒ‹•”‘„—•–‹ˆ‹–„‡Šƒ˜‡•”‡ƒ•‘ƒ„Ž›‡˜‡‹ ‹” —•–ƒ ‡•–Šƒ–™‡”‡‘–ƒ–‹ ‹’ƒ–‡†‹–Š‡
  39. 39 • ‘””‡ –‡••ƒ†”‡Ž‹ƒ„‹Ž‹–›ƒ”‡ ‘–‹‰‡–‘‘”ƒŽ‘’‡”ƒ–‹‰ ‘†‹–‹‘•
  40. 40 ‘ —•‹‰‘Š‹ˆˆ‡”‡– ƒ ‡–•‘ˆ–Š‡›•–‡
  41. 41 SFMJBCMFCVU SPCVTUCVUOPU OPUDPSSFDU TBGFDBUBTUSPQIJD
  42. 42 ‡Žƒ–‹‘•Š‹’‘‰–Š‡—ƒŽ‹–‹‡•
  43. 43 • ‡”ˆ‘”ƒ ‡
  44. 44 • •ƒ„‹Ž‹–›
  45. 45 • ƒ‹–ƒ‹ƒ„‹Ž‹–›
  46. 46 Slide 46
  47. 47 • ‘”•‘ˆ–™ƒ”‡–™‘‹†•‘ˆ“—ƒŽ‹–›ƒ›„‡‡ ‘—–‡”‡†
  48. 48 • ”‡˜‡–‹‘ ‘•–•‹ Ž—†‡
  49. 49 • Šƒ– ’ •™”‘‰™‹–Š ’‡”ˆ‘”ƒ ‡–‘ —•–‘‡”• ‡š’‡ –ƒ–‹‘• ”ƒ–Š‡”–Šƒ “ ’ ” ”‡“—‹”‡‡–•
  50. 50 explains
  51. 51 • ‹’Ž‹•–‹ ƒŽŽ›•‘ˆ–™ƒ”‡’”‘†— –“—ƒŽ‹–›‹•Žƒ ‘ˆ “ „—‰• ‹–Š‡’”‘†— – ” • Š›‹•–Š‹•’”‘„Ž‡ƒ–‹ ƒŽˆ‘”•‘ˆ–™ƒ”‡•›•–‡•
  52. 52 Slide 52
  53. 53 • ˜‡‡š’‡”‹‡ ‡†•‘ˆ–™ƒ”‡‡‰‹‡‡”•‹Œ‡ –ƒ†‡ˆ‡ –ƒ„‘—–‡˜‡”›–‡Ž‹‡• ‘ˆ ‘†‡
  54. 54 ‘•–‘ˆ‘ˆ–™ƒ”‡‡ˆ‡ –•
  55. 55 •–‹ƒ–‡†‘•–‘ˆ ‹š‹‰‡ˆ‡ –•
  56. 56 ‹•–”‹„—–‹‘‘ˆ‡ˆ‡ –•Š‹‡ –”‘†— ‡†ƒ† ‹š‡†
  57. 57 ‘•–„›‡˜‡Ž‘’‡–Šƒ•‡•
  58. 58 Slide 58
  59. 59 the
  60. 60 ƒŽ‹†ƒ–‹‘˜•ō‡”‹ˆ‹ ƒ–‹‘
  61. 61 ƒŽ‹†ƒ–‹‘˜•ō‡”‹ˆ‹ ƒ–‹‘
  62. 62 • ‡•–‹‰ ƒ„‡†‘‡ˆ‘”˜‡”‹ˆ‹ ƒ–‹‘ƒ†˜ƒŽ‹†ƒ–‹‘ • ‡”‹ˆ‹ ƒ–‹‘
  63. 63 Slide 63
  64. 64 • —ƒŽ‹–‹‡• ƒ‘–„‡ƒ††‡†ƒˆ–‡”†‡˜‡Ž‘’‡–
  65. 65 • —ƒŽ‹–›’”‘ ‡•••‡–‘ˆƒ –‹˜‹–‹‡•ƒ†”‡•’‘•‹„‹Ž‹–‹‡•
  66. 66 • ‘”‡˜‡”›†‡˜‡Ž‘’‡–ƒ –‹˜‹–›–Š‡”‡‹•ƒ ‘””‡•’‘†‹‰–‡•–‹‰ ƒ –‹˜‹–›
  67. 67 • ‹– ‘’‘‡–‘†—Ž‡–‡•–‹‰ • –‡‰”ƒ–‹‘–‡•–‹‰
  68. 68  –—ƒŽ‡‡†• ƒ† ‡Ž‹˜‡”‡†ƒ ƒ‰‡ •‡” ‡’–ƒ ‡Ž’Šƒ‡–ƒ‡•–• ‘•–”ƒ‹–•
  69. 69 • ‡•–‹‰‘ˆ‹†‹˜‹†—ƒŽ•‘ˆ–™ƒ”‡—‹–‘†—Ž‡ ‘’‘‡–•
  70. 70 • ‡•–‹‰’‡”ˆ‘”‡†–‘‡š’‘•‡†‡ˆ‡ –•‹–Š‡ ‹–‡”ˆƒ ‡• ƒ†‹–Š‡ ‹–‡”ƒ –‹‘•„‡–™‡‡ ‹–‡‰”ƒ–‡† ‘’‘‡–•‘”•—„•›•–‡•
  71. 71 • •‡†™Š‡ƒŽƒ”‰‡ƒ‘—–‘ˆ–‡•–‹‰‹•‡‡†‡†ƒ†–Š‡ Šƒ‰‡•™Š‹Ž‡ •ƒŽŽ ƒƒˆˆ‡ –ƒ›’ƒ”–•‘ˆ–Š‡•›•–‡
  72. 72 • ‡•–‹‰‘ˆƒ‹–‡‰”ƒ–‡†•›•–‡–‘˜‡”‹ˆ›–Šƒ–‹–‡‡–•–Š‡ •’‡ ‹ˆ‹ ƒ–‹‘
  73. 73 • ‡•––Š‡™Š‘Ž‡•›•–‡–‘‡•—”‡–Šƒ–‹–‡‡–•–Š‡ ”‡“—‹”‡‡–• • ‘ —•‘ —•–‘‡”ƒ ‡’–ƒ ‡
  74. 74 •  ‡’–ƒ ‡–‡•–‹‰
  75. 75 • ƒ†‘•–ƒ–‹•–‹ ƒŽ–‡•–‹‰ • Ž’Šƒ–‡•–‹‰
  76. 76 • ƒ†‘–‡•–•–ƒ–‹•–‹ ƒŽ–‡•–
  77. 77 • ‹—Žƒ–‡†‘’‡”ƒ–‹‘ƒŽ–‡•–‹‰ • ‡”ˆ‘”‡†„›’‡”•‘‡Ž ƒ –‹‰ƒ• ’‘–‡–‹ƒŽ—•‡”• —•–‘‡”•
  78. 78 • ’‡”ƒ–‹‘ƒŽ–‡•–‹‰–‘†‡–‡”‹‡™Š‡–Š‡”‘”‘–ƒ ‘’‘‡– ‘”•›•–‡•ƒ–‹•ˆ‹‡•–Š‡—•‡” —•–‘‡”‡‡†•ƒ†ˆ‹–•™‹–Š‹–Š‡
  79. 79 • ’‡ –”—‘ˆ•‘ˆ–™ƒ”‡“—ƒŽ‹–‹‡• • ‡–”‹ •‘ˆ“—ƒŽ‹–›ƒ––”‹„—–‡•
Slide 1 / 79

Slide 1

Slide 1: Slide 1
Slide 2 / 79

• ƒ –‘”•‹”‘Œ‡ –— ‡•• ƒ‹Ž—”‡

Slide 2: • ƒ –‘”•‹”‘Œ‡ –— ‡•• ƒ‹Ž—”‡
Slide 3 / 79

Slide 3

Slide 3: Slide 3
Slide 4 / 79

• ƒ›•‘ˆ–™ƒ”‡”‡Žƒ–‡†ˆƒ‹Ž—”‡•ƒ—–‘’‹Ž‘–•›•–‡•ƒ‹”–”ƒˆˆ‹  ‘–”‘Ž•›•–‡• „ƒ‹‰•›•–‡• 

Slide 4: • ƒ›•‘ˆ–™ƒ”‡”‡Žƒ–‡†ˆƒ‹Ž—”‡•ƒ—–‘’‹Ž‘–•›•–‡•ƒ‹”–”ƒˆˆ‹  ‘–”‘Ž•›•–‡• „ƒ‹‰•›•–‡• 
Slide 5 / 79

‘ˆ–™ƒ”‡”‘Œ‡ –•Šƒ˜‡ƒ–‡””‹„Ž‡–”ƒ ”‡ ‘”†

Slide 5: ‘ˆ–™ƒ”‡”‘Œ‡ –•Šƒ˜‡ƒ–‡””‹„Ž‡–”ƒ ”‡ ‘”†
Slide 6 / 79

”‘Œ‡ –— ‡•• ›’‡Š‡’”‘Œ‡ –‹• ‘’Ž‡–‡†‘–‹‡ƒ†‘„—†‰‡– ™‹–ŠƒŽŽˆ‡ƒ–—”‡•ƒ†ˆ— –‹‘•ƒ•‹‹–‹ƒŽŽ›•’‡ ‹ˆ‹‡† 

Slide 6: ”‘Œ‡ –— ‡•• ›’‡Š‡’”‘Œ‡ –‹• ‘’Ž‡–‡†‘–‹‡ƒ†‘„—†‰‡– ™‹–ŠƒŽŽˆ‡ƒ–—”‡•ƒ†ˆ— –‹‘•ƒ•‹‹–‹ƒŽŽ›•’‡ ‹ˆ‹‡† 

Notes

  1. Chaos report: only a minority of projects succeed (on time, on budget, full scope); the rest are challenged or fail.

Slide 7 / 79

ɎɖɖɏŏɏɍɎɔ

Slide 7: ɎɖɖɏŏɏɍɎɔ
Slide 8 / 79

ƒ•‡–—†› Š‡ ‹–‹ƒŽƒ— Š‘ˆ ‡ƒŽ–Šƒ”‡‰‘˜

Slide 8: ƒ•‡–—†› Š‡ ‹–‹ƒŽƒ— Š‘ˆ ‡ƒŽ–Šƒ”‡‰‘˜
Slide 9 / 79

Š ‡ƒŽ–Šƒ”‡ō‰‘˜

Slide 9: Š ‡ƒŽ–Šƒ”‡ō‰‘˜

Notes

  1. HealthCare.gov (2013): ~$500M+, crashed at launch: changing requirements, late and inadequate testing (no end-to-end test until days before launch), poor management.

Exam angle

PredictionQ1

Name two software-engineering failures behind the HealthCare.gov launch.

Compare with the model answer

Inadequate testing (full testing only weeks or days before launch, no end-to-end or load testing close to real volume) and constantly changing requirements combined with a write-everything-then-build process; also poor coordination among contractors.

Slide 10 / 79

• ‡”ˆ‘”ƒ ‡”‡•’‘•‡–‹‡Žƒ†‹‰’ƒ‰‡•

Slide 10: • ‡”ˆ‘”ƒ ‡”‡•’‘•‡–‹‡Žƒ†‹‰’ƒ‰‡•
Slide 11 / 79

‡ƒŽ–Šƒ”‡ō‰‘˜ŠŠ‡‘–”ƒ –‘”•ĖŠ‡‘•–

Slide 11: ‡ƒŽ–Šƒ”‡ō‰‘˜ŠŠ‡‘–”ƒ –‘”•ĖŠ‡‘•–
Slide 12 / 79

‡ƒŽ–Šƒ”‡ō‰‘˜ŠŠ‡ ƒ‹Ž—”‡•Š‘ˆ–™ƒ”‡‰ō

Slide 12: ‡ƒŽ–Šƒ”‡ō‰‘˜ŠŠ‡ ƒ‹Ž—”‡•Š‘ˆ–™ƒ”‡‰ō
Slide 13 / 79

• ˜‘Ž˜‹‰‘ŽŽ‹‰‡“—‹”‡‡–•

Slide 13: • ˜‘Ž˜‹‰‘ŽŽ‹‰‡“—‹”‡‡–•
Slide 14 / 79

ƒ•‡–—†›Ō ‡ƒŽ–Šƒ”‡ō‰‘˜Š ‹•‡›Ŗ‡†‡ƒŗ••‡••‡–

Slide 14: ƒ•‡–—†›Ō ‡ƒŽ–Šƒ”‡ō‰‘˜Š ‹•‡›Ŗ‡†‡ƒŗ••‡••‡–
Slide 15 / 79

• ƒƒ‰‡‡–‡š’‡”–‹•‡‹•‹‰‡––‹‰ ‘–”ƒ –•‘–†‡Ž‹˜‡”‹‰ ’”‘Œ‡ –•

Slide 15: • ƒƒ‰‡‡–‡š’‡”–‹•‡‹•‹‰‡––‹‰ ‘–”ƒ –•‘–†‡Ž‹˜‡”‹‰ ’”‘Œ‡ –•
Slide 16 / 79

• ‘˜‡”‡– ’”‘Œ‡ –•

Slide 16: • ‘˜‡”‡– ’”‘Œ‡ –•
Slide 17 / 79

• „—‰ˆ‹š‡•„›–Š‡‡†‘ˆ‘˜

Slide 17: • „—‰ˆ‹š‡•„›–Š‡‡†‘ˆ‘˜
Slide 18 / 79

• ••—‡•‘†ƒ–ƒƒ —”ƒ ›ƒ† ‘’Ž‡–‡‡••

Slide 18: • ••—‡•‘†ƒ–ƒƒ —”ƒ ›ƒ† ‘’Ž‡–‡‡••
Slide 19 / 79

•  ‡–—”‡ –‘‘‘˜‡”‹ ƒƒ•–Š‡Ž‡ƒ† ‘–”ƒ –‘”ˆ‘”†‡˜‡Ž‘’‡– ƒ†ƒ‹–‡ƒ ‡

Slide 19: •  ‡–—”‡ –‘‘‘˜‡”‹ ƒƒ•–Š‡Ž‡ƒ† ‘–”ƒ –‘”ˆ‘”†‡˜‡Ž‘’‡– ƒ†ƒ‹–‡ƒ ‡
Slide 20 / 79

• ”‘ŽŽ‡–ˆ‘”•–ƒ–‡•

Slide 20: • ”‘ŽŽ‡–ˆ‘”•–ƒ–‡•
Slide 21 / 79

• †‘’–•‘ˆ–™ƒ”‡‡‰‹‡‡”‹‰„‡•–’”ƒ –‹ ‡•

Slide 21: • †‘’–•‘ˆ–™ƒ”‡‡‰‹‡‡”‹‰„‡•–’”ƒ –‹ ‡•
Slide 22 / 79

Slide 22

Slide 22: Slide 22
Slide 23 / 79

• ‡”ˆ‘”ƒ ‡

Slide 23: • ‡”ˆ‘”ƒ ‡
Slide 24 / 79

• ™‘‡›‡–”‹ •ˆ‘”‹–”‹•‹ ’”‘†— –“—ƒŽ‹–›ƒ”‡‡ƒ‹‡‘ ƒ‹Ž—”‡  ƒ†ƒ˜ƒ‹Žƒ„‹Ž‹–›

Slide 24: • ™‘‡›‡–”‹ •ˆ‘”‹–”‹•‹ ’”‘†— –“—ƒŽ‹–›ƒ”‡‡ƒ‹‡‘ ƒ‹Ž—”‡  ƒ†ƒ˜ƒ‹Žƒ„‹Ž‹–›

Notes

  1. MTTF: mean time to failure. MTTR: mean time to repair. MTBF = MTTF + MTTR.

Slide 25 / 79

• ‡ƒ–‹‡„‡–™‡‡ˆƒ‹Ž—”‡•

Slide 25: • ‡ƒ–‹‡„‡–™‡‡ˆƒ‹Ž—”‡•

Notes

  1. Availability = MTTF / (MTTF + MTTR) × 100%.

Exam angle

PredictionQ1

MTTF = 98 hours, MTTR = 2 hours. Availability =

Slide 26 / 79

• ˜ƒ‹Žƒ„‹Ž‹–›

Slide 26: • ˜ƒ‹Žƒ„‹Ž‹–›
Slide 27 / 79

• ‘ˆ–™ƒ”‡ƒ˜ƒ‹Žƒ„‹Ž‹–›‹•–Š‡’”‘„ƒ„‹Ž‹–›–Šƒ–ƒ’”‘‰”ƒ‹•‘’‡”ƒ–‹‰ ƒ ‘”†‹‰–‘”‡“—‹”‡‡–•ƒ–ƒ‰‹˜‡’‘‹–‹–‹‡ƒ†‹•†‡ˆ‹‡†ƒ•

Slide 27: • ‘ˆ–™ƒ”‡ƒ˜ƒ‹Žƒ„‹Ž‹–›‹•–Š‡’”‘„ƒ„‹Ž‹–›–Šƒ–ƒ’”‘‰”ƒ‹•‘’‡”ƒ–‹‰ ƒ ‘”†‹‰–‘”‡“—‹”‡‡–•ƒ–ƒ‰‹˜‡’‘‹–‹–‹‡ƒ†‹•†‡ˆ‹‡†ƒ•

Notes

  1. "Five nines" (99.999%) availability ≈ 5 minutes of downtime a year.

Slide 28 / 79

• ‡Ž‹ƒ„‹Ž‹–›†‡’‡†•‘–Š‡ —‹– ‘ˆ‘’‡”ƒ–‹‘

Slide 28: • ‡Ž‹ƒ„‹Ž‹–›†‡’‡†•‘–Š‡ —‹– ‘ˆ‘’‡”ƒ–‹‘
Slide 29 / 79

• –‡‰”ƒ–‹‘–‡•–‹‰

Slide 29: • –‡‰”ƒ–‹‘–‡•–‹‰
Slide 30 / 79

•  ‡’–ƒ ‡–‡•–‹‰

Slide 30: •  ‡’–ƒ ‡–‡•–‹‰
Slide 31 / 79

Slide 31

Slide 31: Slide 31
Slide 32 / 79

‘‡’‘••‹„Ž‡†‡ˆ‹‹–‹‘• • —ƒŽ‹–›œ‡”‘†‡ˆ‡ –•”‘•„›

Slide 32: ‘‡’‘••‹„Ž‡†‡ˆ‹‹–‹‘• • —ƒŽ‹–›œ‡”‘†‡ˆ‡ –•”‘•„›
Slide 33 / 79

‘ˆ–™ƒ”‡›•–‡—ƒŽ‹–‹‡•

Slide 33: ‘ˆ–™ƒ”‡›•–‡—ƒŽ‹–‹‡•

Notes

  1. Qualities: correctness, reliability, robustness, safety, performance, usability, security, maintainability, reusability, portability, interoperability.

Slide 34 / 79

• ‘””‡ –‡••

Slide 34: • ‘””‡ –‡••

Notes

  1. Correctness: consistent with the specification (all or nothing). Reliability: probability of operating without failure under a usage profile (statistical).

Slide 35 / 79

• ƒˆ‡–›

Slide 35: • ƒˆ‡–›

Notes

  1. Safety: prevents undesirable behaviours (hazards). Robustness: behaves reasonably (degrades gracefully) outside normal conditions.

Exam angle

PredictionQ1

A system that keeps working in a degraded mode when the network fails is:

Slide 36 / 79

• ‘””‡ –‡••‹•ƒƒŽŽ‘”‘–Š‹‰’”‘’‘•‹–‹‘

Slide 36: • ‘””‡ –‡••‹•ƒƒŽŽ‘”‘–Š‹‰’”‘’‘•‹–‹‘
Slide 37 / 79

• ˆ‘”ƒŽŽ›•‘ˆ–™ƒ”‡‹•”‡Ž‹ƒ„Ž‡‹ˆ–Š‡—•‡” ƒ†‡’‡†‘‹–Š‡ •’‡ ‹ƒŽ‹œ‡†Ž‹–‡”ƒ–—”‡‘•‘ˆ–™ƒ”‡”‡Ž‹ƒ„‹Ž‹–›†‡ˆ‹‡•”‡Ž‹ƒ„‹Ž‹–›‹–‡”•

Slide 37: • ˆ‘”ƒŽŽ›•‘ˆ–™ƒ”‡‹•”‡Ž‹ƒ„Ž‡‹ˆ–Š‡—•‡” ƒ†‡’‡†‘‹–Š‡ •’‡ ‹ƒŽ‹œ‡†Ž‹–‡”ƒ–—”‡‘•‘ˆ–™ƒ”‡”‡Ž‹ƒ„‹Ž‹–›†‡ˆ‹‡•”‡Ž‹ƒ„‹Ž‹–›‹–‡”•
Slide 38 / 79

• ’”‘‰”ƒ‹•”‘„—•–‹ˆ‹–„‡Šƒ˜‡•”‡ƒ•‘ƒ„Ž›‡˜‡‹ ‹” —•–ƒ ‡•–Šƒ–™‡”‡‘–ƒ–‹ ‹’ƒ–‡†‹–Š‡

Slide 38: • ’”‘‰”ƒ‹•”‘„—•–‹ˆ‹–„‡Šƒ˜‡•”‡ƒ•‘ƒ„Ž›‡˜‡‹ ‹” —•–ƒ ‡•–Šƒ–™‡”‡‘–ƒ–‹ ‹’ƒ–‡†‹–Š‡
Slide 39 / 79

• ‘””‡ –‡••ƒ†”‡Ž‹ƒ„‹Ž‹–›ƒ”‡ ‘–‹‰‡–‘‘”ƒŽ‘’‡”ƒ–‹‰ ‘†‹–‹‘•

Slide 39: • ‘””‡ –‡••ƒ†”‡Ž‹ƒ„‹Ž‹–›ƒ”‡ ‘–‹‰‡–‘‘”ƒŽ‘’‡”ƒ–‹‰ ‘†‹–‹‘•
Slide 40 / 79

‘ —•‹‰‘Š‹ˆˆ‡”‡– ƒ ‡–•‘ˆ–Š‡›•–‡

Slide 40: ‘ —•‹‰‘Š‹ˆˆ‡”‡– ƒ ‡–•‘ˆ–Š‡›•–‡
Slide 41 / 79

SFMJBCMFCVU SPCVTUCVUOPU OPUDPSSFDU TBGFDBUBTUSPQIJD

Slide 41: SFMJBCMFCVU SPCVTUCVUOPU OPUDPSSFDU TBGFDBUBTUSPQIJD
Slide 42 / 79

‡Žƒ–‹‘•Š‹’‘‰–Š‡—ƒŽ‹–‹‡•

Slide 42: ‡Žƒ–‹‘•Š‹’‘‰–Š‡—ƒŽ‹–‹‡•
Slide 43 / 79

• ‡”ˆ‘”ƒ ‡

Slide 43: • ‡”ˆ‘”ƒ ‡
Slide 44 / 79

• •ƒ„‹Ž‹–›

Slide 44: • •ƒ„‹Ž‹–›
Slide 45 / 79

• ƒ‹–ƒ‹ƒ„‹Ž‹–›

Slide 45: • ƒ‹–ƒ‹ƒ„‹Ž‹–›
Slide 46 / 79

Slide 46

Slide 46: Slide 46
Slide 47 / 79

• ‘”•‘ˆ–™ƒ”‡–™‘‹†•‘ˆ“—ƒŽ‹–›ƒ›„‡‡ ‘—–‡”‡†

Slide 47: • ‘”•‘ˆ–™ƒ”‡–™‘‹†•‘ˆ“—ƒŽ‹–›ƒ›„‡‡ ‘—–‡”‡†
Slide 48 / 79

• ”‡˜‡–‹‘ ‘•–•‹ Ž—†‡

Slide 48: • ”‡˜‡–‹‘ ‘•–•‹ Ž—†‡

Notes

  1. Cost of quality: prevention (training, reviews) + appraisal (testing) + internal failure (rework before release) + external failure (after release: support, recalls).

Slide 49 / 79

• Šƒ– ’ •™”‘‰™‹–Š ’‡”ˆ‘”ƒ ‡–‘ —•–‘‡”• ‡š’‡ –ƒ–‹‘• ”ƒ–Š‡”–Šƒ “ ’ ” ”‡“—‹”‡‡–•

Slide 49: • Šƒ– ’ •™”‘‰™‹–Š ’‡”ˆ‘”ƒ ‡–‘ —•–‘‡”• ‡š’‡ –ƒ–‹‘• ”ƒ–Š‡”–Šƒ “ ’ ” ”‡“—‹”‡‡–•
Slide 50 / 79

explains

Slide 50: explains
Slide 51 / 79

• ‹’Ž‹•–‹ ƒŽŽ›•‘ˆ–™ƒ”‡’”‘†— –“—ƒŽ‹–›‹•Žƒ ‘ˆ “ „—‰• ‹–Š‡’”‘†— – ” • Š›‹•–Š‹•’”‘„Ž‡ƒ–‹ ƒŽˆ‘”•‘ˆ–™ƒ”‡•›•–‡•

Slide 51: • ‹’Ž‹•–‹ ƒŽŽ›•‘ˆ–™ƒ”‡’”‘†— –“—ƒŽ‹–›‹•Žƒ ‘ˆ “ „—‰• ‹–Š‡’”‘†— – ” • Š›‹•–Š‹•’”‘„Ž‡ƒ–‹ ƒŽˆ‘”•‘ˆ–™ƒ”‡•›•–‡•
Slide 52 / 79

Slide 52

Slide 52: Slide 52
Slide 53 / 79

• ˜‡‡š’‡”‹‡ ‡†•‘ˆ–™ƒ”‡‡‰‹‡‡”•‹Œ‡ –ƒ†‡ˆ‡ –ƒ„‘—–‡˜‡”›–‡Ž‹‡• ‘ˆ ‘†‡

Slide 53: • ˜‡‡š’‡”‹‡ ‡†•‘ˆ–™ƒ”‡‡‰‹‡‡”•‹Œ‡ –ƒ†‡ˆ‡ –ƒ„‘—–‡˜‡”›–‡Ž‹‡• ‘ˆ ‘†‡
Slide 54 / 79

‘•–‘ˆ‘ˆ–™ƒ”‡‡ˆ‡ –•

Slide 54: ‘•–‘ˆ‘ˆ–™ƒ”‡‡ˆ‡ –•
Slide 55 / 79

•–‹ƒ–‡†‘•–‘ˆ ‹š‹‰‡ˆ‡ –•

Slide 55: •–‹ƒ–‡†‘•–‘ˆ ‹š‹‰‡ˆ‡ –•

Notes

  1. The later a defect is found, the more it costs to fix (up to 100× after release).

Slide 56 / 79

‹•–”‹„—–‹‘‘ˆ‡ˆ‡ –•Š‹‡ –”‘†— ‡†ƒ† ‹š‡†

Slide 56: ‹•–”‹„—–‹‘‘ˆ‡ˆ‡ –•Š‹‡ –”‘†— ‡†ƒ† ‹š‡†
Slide 57 / 79

‘•–„›‡˜‡Ž‘’‡–Šƒ•‡•

Slide 57: ‘•–„›‡˜‡Ž‘’‡–Šƒ•‡•
Slide 58 / 79

Slide 58

Slide 58: Slide 58
Slide 59 / 79

the

Slide 59: the

Notes

  1. Verification: does it meet the specification? Validation: does it meet the user’s real needs?

  2. Seen again Testing throughout the SDLC, slide 4: V&V

Slide 60 / 79

ƒŽ‹†ƒ–‹‘˜•ō‡”‹ˆ‹ ƒ–‹‘

Slide 60: ƒŽ‹†ƒ–‹‘˜•ō‡”‹ˆ‹ ƒ–‹‘
Slide 61 / 79

ƒŽ‹†ƒ–‹‘˜•ō‡”‹ˆ‹ ƒ–‹‘

Slide 61: ƒŽ‹†ƒ–‹‘˜•ō‡”‹ˆ‹ ƒ–‹‘
Slide 62 / 79

• ‡•–‹‰ ƒ„‡†‘‡ˆ‘”˜‡”‹ˆ‹ ƒ–‹‘ƒ†˜ƒŽ‹†ƒ–‹‘ • ‡”‹ˆ‹ ƒ–‹‘

Slide 62: • ‡•–‹‰ ƒ„‡†‘‡ˆ‘”˜‡”‹ˆ‹ ƒ–‹‘ƒ†˜ƒŽ‹†ƒ–‹‘ • ‡”‹ˆ‹ ƒ–‹‘
Slide 63 / 79

Slide 63

Slide 63: Slide 63
Slide 64 / 79

• —ƒŽ‹–‹‡• ƒ‘–„‡ƒ††‡†ƒˆ–‡”†‡˜‡Ž‘’‡–

Slide 64: • —ƒŽ‹–‹‡• ƒ‘–„‡ƒ††‡†ƒˆ–‡”†‡˜‡Ž‘’‡–
Slide 65 / 79

• —ƒŽ‹–›’”‘ ‡•••‡–‘ˆƒ –‹˜‹–‹‡•ƒ†”‡•’‘•‹„‹Ž‹–‹‡•

Slide 65: • —ƒŽ‹–›’”‘ ‡•••‡–‘ˆƒ –‹˜‹–‹‡•ƒ†”‡•’‘•‹„‹Ž‹–‹‡•
Slide 66 / 79

• ‘”‡˜‡”›†‡˜‡Ž‘’‡–ƒ –‹˜‹–›–Š‡”‡‹•ƒ ‘””‡•’‘†‹‰–‡•–‹‰ ƒ –‹˜‹–›

Slide 66: • ‘”‡˜‡”›†‡˜‡Ž‘’‡–ƒ –‹˜‹–›–Š‡”‡‹•ƒ ‘””‡•’‘†‹‰–‡•–‹‰ ƒ –‹˜‹–›
Slide 67 / 79

• ‹– ‘’‘‡–‘†—Ž‡–‡•–‹‰ • –‡‰”ƒ–‹‘–‡•–‹‰

Slide 67: • ‹– ‘’‘‡–‘†—Ž‡–‡•–‹‰ • –‡‰”ƒ–‹‘–‡•–‹‰
Slide 68 / 79

 –—ƒŽ‡‡†• ƒ† ‡Ž‹˜‡”‡†ƒ ƒ‰‡ •‡” ‡’–ƒ ‡Ž’Šƒ‡–ƒ‡•–• ‘•–”ƒ‹–•

Slide 68:  –—ƒŽ‡‡†• ƒ† ‡Ž‹˜‡”‡†ƒ ƒ‰‡ •‡” ‡’–ƒ ‡Ž’Šƒ‡–ƒ‡•–• ‘•–”ƒ‹–•

Notes

  1. V-model: user requirements ↔ acceptance test, system spec ↔ system test, design ↔ integration test, code ↔ unit test.

Slide 69 / 79

• ‡•–‹‰‘ˆ‹†‹˜‹†—ƒŽ•‘ˆ–™ƒ”‡—‹–‘†—Ž‡ ‘’‘‡–•

Slide 69: • ‡•–‹‰‘ˆ‹†‹˜‹†—ƒŽ•‘ˆ–™ƒ”‡—‹–‘†—Ž‡ ‘’‘‡–•
Slide 70 / 79

• ‡•–‹‰’‡”ˆ‘”‡†–‘‡š’‘•‡†‡ˆ‡ –•‹–Š‡ ‹–‡”ˆƒ ‡• ƒ†‹–Š‡ ‹–‡”ƒ –‹‘•„‡–™‡‡ ‹–‡‰”ƒ–‡† ‘’‘‡–•‘”•—„•›•–‡•

Slide 70: • ‡•–‹‰’‡”ˆ‘”‡†–‘‡š’‘•‡†‡ˆ‡ –•‹–Š‡ ‹–‡”ˆƒ ‡• ƒ†‹–Š‡ ‹–‡”ƒ –‹‘•„‡–™‡‡ ‹–‡‰”ƒ–‡† ‘’‘‡–•‘”•—„•›•–‡•
Slide 71 / 79

• •‡†™Š‡ƒŽƒ”‰‡ƒ‘—–‘ˆ–‡•–‹‰‹•‡‡†‡†ƒ†–Š‡ Šƒ‰‡•™Š‹Ž‡ •ƒŽŽ ƒƒˆˆ‡ –ƒ›’ƒ”–•‘ˆ–Š‡•›•–‡

Slide 71: • •‡†™Š‡ƒŽƒ”‰‡ƒ‘—–‘ˆ–‡•–‹‰‹•‡‡†‡†ƒ†–Š‡ Šƒ‰‡•™Š‹Ž‡ •ƒŽŽ ƒƒˆˆ‡ –ƒ›’ƒ”–•‘ˆ–Š‡•›•–‡
Slide 72 / 79

• ‡•–‹‰‘ˆƒ‹–‡‰”ƒ–‡†•›•–‡–‘˜‡”‹ˆ›–Šƒ–‹–‡‡–•–Š‡ •’‡ ‹ˆ‹ ƒ–‹‘

Slide 72: • ‡•–‹‰‘ˆƒ‹–‡‰”ƒ–‡†•›•–‡–‘˜‡”‹ˆ›–Šƒ–‹–‡‡–•–Š‡ •’‡ ‹ˆ‹ ƒ–‹‘
Slide 73 / 79

• ‡•––Š‡™Š‘Ž‡•›•–‡–‘‡•—”‡–Šƒ–‹–‡‡–•–Š‡ ”‡“—‹”‡‡–• • ‘ —•‘ —•–‘‡”ƒ ‡’–ƒ ‡

Slide 73: • ‡•––Š‡™Š‘Ž‡•›•–‡–‘‡•—”‡–Šƒ–‹–‡‡–•–Š‡ ”‡“—‹”‡‡–• • ‘ —•‘ —•–‘‡”ƒ ‡’–ƒ ‡
Slide 74 / 79

•  ‡’–ƒ ‡–‡•–‹‰

Slide 74: •  ‡’–ƒ ‡–‡•–‹‰
Slide 75 / 79

• ƒ†‘•–ƒ–‹•–‹ ƒŽ–‡•–‹‰ • Ž’Šƒ–‡•–‹‰

Slide 75: • ƒ†‘•–ƒ–‹•–‹ ƒŽ–‡•–‹‰ • Ž’Šƒ–‡•–‹‰
Slide 76 / 79

• ƒ†‘–‡•–•–ƒ–‹•–‹ ƒŽ–‡•–

Slide 76: • ƒ†‘–‡•–•–ƒ–‹•–‹ ƒŽ–‡•–
Slide 77 / 79

• ‹—Žƒ–‡†‘’‡”ƒ–‹‘ƒŽ–‡•–‹‰ • ‡”ˆ‘”‡†„›’‡”•‘‡Ž ƒ –‹‰ƒ• ’‘–‡–‹ƒŽ—•‡”• —•–‘‡”•

Slide 77: • ‹—Žƒ–‡†‘’‡”ƒ–‹‘ƒŽ–‡•–‹‰ • ‡”ˆ‘”‡†„›’‡”•‘‡Ž ƒ –‹‰ƒ• ’‘–‡–‹ƒŽ—•‡”• —•–‘‡”•

Notes

  1. Alpha testing: by potential users at the developer’s site (controlled). Beta: by real users in their own environment.

Slide 78 / 79

• ’‡”ƒ–‹‘ƒŽ–‡•–‹‰–‘†‡–‡”‹‡™Š‡–Š‡”‘”‘–ƒ ‘’‘‡– ‘”•›•–‡•ƒ–‹•ˆ‹‡•–Š‡—•‡” —•–‘‡”‡‡†•ƒ†ˆ‹–•™‹–Š‹–Š‡

Slide 78: • ’‡”ƒ–‹‘ƒŽ–‡•–‹‰–‘†‡–‡”‹‡™Š‡–Š‡”‘”‘–ƒ ‘’‘‡– ‘”•›•–‡•ƒ–‹•ˆ‹‡•–Š‡—•‡” —•–‘‡”‡‡†•ƒ†ˆ‹–•™‹–Š‹–Š‡
Slide 79 / 79

• ’‡ –”—‘ˆ•‘ˆ–™ƒ”‡“—ƒŽ‹–‹‡• • ‡–”‹ •‘ˆ“—ƒŽ‹–›ƒ––”‹„—–‡•

Slide 79: • ’‡ –”—‘ˆ•‘ˆ–™ƒ”‡“—ƒŽ‹–‹‡• • ‡–”‹ •‘ˆ“—ƒŽ‹–›ƒ––”‹„—–‡•