Ethnographic Study / Field Observation

Observing users in the field is often the best way to determine their usability requirements. Traditional usability testing, while providing a laboratory environment that makes data collection and recording easy, also removes the user and the product from the context of the workplace. Sometimes, it's best to see exactly how things are done in the real world.

Hom, James. VWH.net. Articles>Usability>Methods>Contextual Inquiry

Evaluating Index Usability  

Usability is like beauty. It is in the eye of the beholder. In other words, much of it is purely subjective. For example, what seems useful to you today might not seem as useful to you tomorrow or next week or next month. With those thoughts in mind, I designed a usability test questionnaire for one of my corporate clients. Since then, I have used the questionnaire in consulting with other corporate clients to help them evaluate their existing indexes. Also, I have made it available on my Web site – http://www.indexingskills.com/usabhtml.html - and I have given several other corporations and publishers permission to use it.

Lathrop, Lori M. STC Proceedings (2003). Articles>Indexing>Usability

Evaluating Our New Look and Moving Online: Seeing Is Believing    

The editorial advisory board and I have been asking our readers' opinions about the journal's redesign and the directions this publication should take in the future. We've also commissioned usability studies and carefully examined the technologies available for online publication. In this editorial, I'd like to share what we've learned and the directions in which we hope to move during the coming year.

Hayhoe, George F. Technical Communication Online (1998). Articles>Publishing>Online>Usability

Evaluating the Effect of Iconic Linkage on the Usability of Software User Guides    

This study investigates whether Iconic Linkage--the use of the identical wording to present the same information recurring in a text--can improve the usability of user guides. Iconic Linkage is a writing strategy that potentially allows users to work more quickly and effectively and which promotes better retention of information. The usefulness of Iconic Linkage was tested in a laboratory-based usability study that combined: 1) objective task-based evaluation; and 2) users' subjective evaluations of a software program used in recording parliamentary debates. A post-test survey designed to test subjects' retention of information contained in the user guides was also administered. The study shows that Iconic Linkage significantly improved usability of the user guide: in all tasks, subjects worked more effectively and made fewer mistakes; while in the three timed tasks, subjects completed the tasks much more quickly. Subjects also gave higher ratings for the software and their retention of information was noticeably improved.

Byrne, Jody. Journal of Technical Writing and Communication (2005). Articles>Documentation>Software>Usability

Evaluating the Usability of Educational Websites for Children

This study examined the usability of educational websites for children. Children ages 7 - 11 performed seven search tasks with one of three websites. Overall, participants, especially those less than 10 years of age were not very successful. Terminology, number and organization of links, location of information above the fold, and length of individual pages all influenced performance on the tasks.

Naidu, Shivashankar. Usability News (2005). Articles>Web Design>Usability>Children

Evaluating Web Sites for Accessibility

This document outlines approaches for preliminary review Web site accessibility, and for evaluation of conformance to the Web Content Accessibility Guidelines 1.0. While it does not provide checkpoint-by-checkpoint testing techniques it does include general procedures and tips for evaluation during development of Web sites, and for monitoring of established Web sites. Other resources will be developed for in-depth compliance testing. The measures described here are intended to supplement an organization's existing procedures for content management and quality assurance on their Web sites. For information about why making Web sites accessible is important read the Introductions on the WAI Resources page.

W3C. Articles>Accessibility>Usability>Web Design

Evaluation of an Informational Web Site: Three Variants of the Think-aloud Method Compared    

To evaluate Web sites, usability experts often use methods that were originally employed for the evaluation of software applications. In doing so, they assume that these methods will work exactly the same for both types of test objects. However, there is a major difference between transactional software applications and informational Web sites, a difference that could have an effect on the workings of various usability methods. As such, we felt that it was valuable to repeat one of our previous studies in which we compared concurrent think-aloud protocols, retrospective think-aloud protocols, and constructive interaction to evaluate a Web application, this time using a Web site. The results of our study showed that in some respects, the methods did work differently depending on the test object they were applied to. However, we conclude that the three methods are largely interchangeable and that the decision to choose one variant of the think-aloud method over the other should be based on practical considerations.

van den Haak, Maaike J., Menno de Jong, D.T. and Peter JanSchellens. Technical Communication Online (2007). Articles>Web Design>Usability>Methods

Evaluation Toolbox for Aviation Technical Publications

This article describes the Evaluation Toolbox (Chaparro et al., 2004) - an aid to understand the process of evaluating the usability of aviation maintenance documentation -- from the initial development stage through the final pre-publication stage. This toolbox provides techniques to help technical writers better understand their users and to evaluate their documentation more effectively and efficiently.

Rogers, Bonnie Lida, Chris Hamblin and Alex Chaparro. Usability News (2005). Articles>Documentation>Assessment>Usability

Evangelizing Usability: Change Your Strategy at the Halfway Point

The evangelism strategies that help a usability group get established in a company are different from the ones needed to create a full-fledged usability culture.

Nielsen, Jakob. Alertbox (2005). Articles>Usability

Evolution Trumps Usability Guidelines

'Use a Search Box instead of a link to a Search page.' This is one guideline from the plethora of recently created usability guidelines to help designers produce more usable web sites. It makes sense. After all, there are more than 42 million web sites on the Internet. It should be simple to study these sites and put together a list of 'do's' and 'don'ts' that, when followed, will produce easy-to-use sites. But...

Spool, Jared M. uiGarden (2006). Articles>Usability>Standards>Web Design

Examining how Users Interact with Hypermedia Using a Neural Network  

Users of hypermedia systems, including the Web, are known to produce distinctive patterns depending upon what it is that they are trying to achieve with the medium. For example, someone who is seeking specific information produces a different browsing pattern than someone who is browsing generally. However, it is also known that people using hypermedia for similar purposes produce similar, but not identical, patterns. Such information would be useful for a browsing aid, since it would enable the better selection of links, for offering to the user, based upon what the user’s task is. This paper describes the architecture and training of a neural network system designed to recognise hypermedia browsing patterns in a prototype hypermedia environment. A further fuzzy-logic based system, which is used to record trends in browsing patterns, is then discussed in outline. Both systems have performed well in small-scale studies, with both real users and simulated-data. Further, both systems have proved robust to the potentially complex behaviour of users. These issues are discussed further.

Mullier, D.J. Proceedings of ICAI (2000). Articles>Usability>Methods>Cognitive Psychology

Examining the Relationship Between Quality Writing and Quality Reading    

This article introduces the ISTE approach as a way to measure the relationship between the design of a document and the way that users handle it. ISTE is an acronym for Information SubTypes and Effects. The article describes the classification of information into a general typology as well as into a specific one, to illustrate how the approach can be adapted to specific usability questions. ISTE also requires a typology for categorizing possible user reactions. This article first positions ISTE within the broader context of usability testing and then describes its basic approach and some recent applications. Unlike most formal research methods, ISTE does not require an inordinate amount of time and effort for analyzing high-fidelity data. Electronic versions such as the ERR instrument allow for the creation of a complete and detailed profile of the use of a document 10 minutes after task completion. These characteristics make ISTE a viable instrument for gathering usability metrics in industrial settings.

van der Meij, Hans. Technical Communication Online (2000). Articles>Usability>Testing>Assessment

Excuse-ability

Without innovative solutions that are imaginative and that promote the talents of the producer, the designer is left solving narrow, piecemeal issues that don't add up to much. Which is why Nielsen and Tahir reduce everything to the banal. They accept that the interface is the most critical aspect of the product, losing sight of the possibilities of the product itself.

Perks, Martyn. Spiked Online (2002). Articles>Usability>Web Design>CRM

Experience Equity and Universal Access: Designing Clinical Studies for Low Vision  

In this paper, I describe web page design for those interested in conducting clinical, low vision studies. Ideally, web pages should be accessible and usable for all readers; however, the web is a highly visual medium for communication and creates serious accessibility issues for specialized (diverse needs) those with vision needs. Therefore, I propose that researchers consider a paramount and concurrent user-centered design approach when creating stimulus materials for these specialized audiences. This paper introduces readers to this design approach for a low vision audience as described in the WebText Study.

Reece, Gloria A. STC Proceedings (2005). Articles>Usability>Testing>Visual

Experiences in Remote Usability Evaluations  

Traditional usability testing occurs in a laboratory setting in which users are directly observed by test facilitators. However, the costs associated with accessing users for usability testing as well as the limited availability of many users make it necessary to consider new methods for gathering usability feedback for software products. Online, remote testing is a key to achieving a larger, more diverse pool of participants.

Cheatham, Deane and Velda Bartek. IBM (2004). Articles>Usability>Testing

Extreme Usability: How to Make an Already-Great Design Even Better

The 1% of websites that don't suck can be made even better by strengthening exceptional user performance, eliminating miscues, and targeting company-wide use and unmet needs.

Nielsen, Jakob. Alertbox (2008). Articles>Web Design>Usability

Extreme User Research

What is the biggest problem I face almost every time a client hires me to do something about a web project going awry? They don't know a thing about their users. They don't have a clue, whatsoever. Unbelievable but true!

Lafreniere, Daniel. Boxes and Arrows (2008). Articles>User Centered Design>Research>Usability

Eye Gaze Patterns while Searching vs. Browsing a Website

This article discusses users' visual scan paths of web pages containing text and/or pictures while conducting browsing and searching tasks. User performance on three usability tasks on an e-commerce website is described. Results show that users follow a fairly uniform scan path when browsing through pictures, and a more random path while specifically searching through them. Additionally, users appeared to follow Nielsen's 'F' pattern (2006) while both browsing and searching through text-based pages.

Shrestha, Sav and Kelsi Lenz. Usability News (2007). Articles>Usability>Testing>Eye Tracking

An Eye on User Data: An Interview with Jared Spool, Founding Principal of User Interface Engineering

Our most striking finding is how bad web sites are in general. We have yet to find a site where, if you choose questions at random based on information the developers have placed on the site, users can find the answers more than 50% of the time. (The best we've found is 42% of the time.)

Spool, Jared M. WebWord (1999). Articles>Usability>Web Design

Eye Tracking

Eye tracking is a technique used in cognitive science, psychology (notably psycholinguistics), human-computer interaction (HCI), marketing research, medical research, and other areas. The most widely used current designs are video based eye trackers. A camera focuses on one or both eyes and records their movement as the viewer looks at some kind of stimulus. Most modern eye-trackers use contrast to locate the center of the pupil and use infrared and near-infrared non-collumnated light to create a corneal reflection (CR). The vector between these two features can be used to compute gaze intersection with a surface after a simple calibration for an individual.

Wikipedia. Articles>Usability>Methods>Eye Tracking

Eye Tracking in Human-Computer Interaction and Usability Research: Current Status and Future Prospects  

Discusses the various opportunities for eye-movement studies in future HCI research, and details some of the challenges that need to be overcome to enable effective application of the technique in studying the complexities of advanced interactive-system use.

Poole, Alex and Linden J. Ball. Alex Poole (2004). Articles>Human Computer Interaction>Usability>Eye Tracking

Eye-Tracking Studies: Usability Holy Grail?

The reality is that eye-tracking, while valuable, doesn't make usability testing any more powerful. It's what you do with the observations and the usability test data that counts.

Spillers, Frank. Demystifying Usability (2004). Articles>Usability>Methods>Eye Tracking

F-Shaped Pattern For Reading Web Content

Eyetracking visualizations show that users often read Web pages in an F-shaped pattern: two horizontal stripes followed by a vertical stripe.

Nielsen, Jakob. Alertbox (2006). Articles>Web Design>Usability>Eye Tracking