|d.||Evaluate design against requirements : During this phase Sherlock can act as an electronic guidelines handbook or as a "reminder" tool for assisting experts in identifying potential usability problems that can not be automatically evaluated or as a guide for identifying areas where user testing should focus.|
As is the case with all available design tools, Sherlock is not a panacea for the usability analyst. The limits of automated user interface evaluation (Farenc et al., 1996) as well as those of expert evaluation ( Desurvire, 1994) have already been investigated and are well documented. These limitations are often used as arguments for condemning automated user interface evaluation. But, the fact that this type of evaluation cannot do everything should not diminish the value of the technique. Sherlock is intended to be a 'usability aspirin'; i.e., a small-scale, useful and friendly to use tool that allows user interface designers to easily and quickly get rid of 'usability headaches'. In other words it allows them to spot and correct tedious, frequently repeated usability problems, so that their focus of attention can be shifted towards larger and more important usability issues.
Cohen, A., Crow, D., Dilli, I., Gorny, P., Hoffman, H.-J., Ianella, R., Ogawa, K., Reiterer, H., Ueno, K. & Vanderdonckt, J. ( 1995). "Tools for Working with Guidelines". SIGCHI Bulletin, 27 ( 2), 30-32.
Desurvire, H.W. ( 1994). "Faster, Cheaper!! Are Usability Inspection Methods as Effective as Empirical Testing"? In Nielsen, J. & Mack R.L. (Eds.): Usability Inspection Methods, pp. 173-202. New York: John Wiley & Sons Inc.
Farenc, C., Liberati, V. & Barthet M.-F. ( 1996). "Automatic Ergonomic Evaluation: What are the limits"? In Vanderdonckt, J. (Ed), Proc. of the 2 International Workshop on Computer-Aided Design of User Interfaces (CADUI'96, Namur, June 5-7, 1996), pp. 159-170, Namur: Presses Universitaires de Namur.
Gorny, P. ( 1995). "EXPOSE: An HCI-Counselling tool for User Interface Design". Proceedings of INTERACT '95, pp. 297-304, London: Chapman & Hall.
Grammenos, D., Akoumianakis, D. & Stephanidis, C. ( 1999a). "Integrated Support for Working with Guidelines: The Sherlock Guideline Management System". Interacting with Computers, 11 ( 4), to appear.
Grammenos, D., Akoumianakis, D. & Stephanidis, C. ( 1999b). "Support for Iterative User Interface Prototyping: The Sherlock Guideline management System". Proceedings of the IFIP Working Conference on Engineering for HumanComputer Interaction (EHCI '98, Crete,Greece), to appear.
ISO/DIS 13407 ( 1997). Human-centred design processes for interactive systems. Geneva, Switzerland:. International Organisation for Standardisation.