TownPartner
Case Study
There
are a number of risks of leaving usability out of the design equation.
Not only are the performance measures noticeably worse, but preference
ratings are also much lower. Perhaps most importantly, the task
failure rates are much higher- this means that in the real world,
users would not successfully complete a given task. In some cases
participants think they have completed a task when in fact, they
have not, while in other instances they give up knowing they have
not completed the task. In either case, the consequences are the
same-customer dissatisfaction. Again, it's extremely important to
have baseline numbers for comparison purposes.
It's
an established fact - in testing web sites that have been designed
without any human factors involvement, participants take longer,
commit more errors, experience more problems and require more assists.
Also, perception ratings for these sites are significantly lower.
No
involvement - usability test results
| Measure |
TP-
May 2001 |
PGE |
| Task
Times |
10:42 |
3:50 |
| Errors |
3.51 |
1.41 |
| Problems |
3.01 |
0.67 |
| Assists |
0:70 |
0.18 |
| Perception |
6.86 |
8.52 |
| Task
Failure Rate |
45% |
4% |
A recent
usability test resulted in 120 recommendations for improvement to
the design. Even with limited human factors involvement, the results
of the usability test were significantly better.
Limited
involvement - usability test results
| Measure |
TP
- April 2002 |
PGE |
| Task
Times |
5:31 |
3:50 |
| Errors |
1.21 |
1.41 |
| Problems |
1.92 |
0.67 |
| Assists |
0:29 |
0.18 |
| Perception |
7.57 |
8.52 |
| Task
Failure Rate |
28%
|
4% |
©
2002 Usability Concepts, LLC
|