Usability testing is a technique used to evaluate a prototype of a product by testing it on users. This can be seen as an irreplaceable usability practice, since it gives direct input on how real users will use the system.
#24758
Using Microsoft Excel to Collect Usability Data 
For many usability engineers and human factors researchers, basic note-taking on a paper form or laptop computer represents the common data collection strategy. Unfortunately, this approach can be cumbersome and slow to compile the data following the completion of a study.
Zazelenchuk, Todd. Userfocus (2003). Articles>Usability>Testing>Microsoft Excel
#27701
Variability in User Performance
When doing website tasks, the slowest 25% of users take 2.4 times as long as the fastest 25% of users. This difference is much higher than for other types of computer use; only programming shows a greater disparity.
Nielsen, Jakob. Alertbox (2006). Articles>Web Design>Usability>Testing
#31903
Weekly User Testing: TiVo Did It, You Can, Too
TiVo ran 12 user tests in 12 weeks while designing its new website. As TiVo's experience shows, frequent and regular testing keeps the design usability focused.
Nielsen, Jakob. Alertbox (2008). Articles>Usability>Testing
#24695
What Really Goes on at a Usability Test
The term 'usability testing' means different things to different people. In its 'high fidelity' form, it connotes two-way mirrors, fancy electronic equipment, sophisticated logging software, and tomes of test data. However, high fidelity options aren’t always required for learning about or performing substantive usability testing. Even in a 'low fidelity' environment, you can hit all of the usability high points and provide a valuable service to your software developers and users.
Hyman, Francine N. and Barton A. Evans. STC Proceedings (1996). Articles>Usability>Testing
#28017
When 100% Really Isn't 100%: Improving the Accuracy of Small-Sample Estimates of Completion Rates 
Small sample sizes are a fact of life for most usability practitioners. This can lead to serious measurement problems, especially when making binary measurements such as successful task completion rates (p). The computation of confidence intervals helps by establishing the likely boundaries of measurement, but there is still a question of how to compute the best point estimate, especially for extreme outcomes. In this paper, we report the results of investigations of the accuracy of different estimation methods for two hypothetical distributions and one empirical distribution of p. If a practitioner has no expectation about the value of p, then the Laplace method ((x+1)/(n+2)) is the best estimator. If practitioners are reasonably sure that p will range between .5 and 1.0, then they should use the Wilson method if the observed value of p is less than .5, Laplace when p is greater than .9, and maximum likelihood (x/n) otherwise.
Lewis, James R. and Jeff Sauro. Journal of Usability Studies (2006). Articles>Usability>Testing>Methods
#28915
When Observing Users Is Not Enough: 10 Guidelines for Getting More Out of Users' Verbal Comments
One of the principles underlying usability testing is that observing a user perform a task provides more reliable information than simply asking the user how easy it would be to perform the task. By observing users, you can assess whether they are actually able to use a product. By asking them, you simply cannot.
Peyrichoux, Isabelle. UXmatters (2007). Articles>Usability>Testing>Methods
#27413
Why You Only Need to Test With Five Users
Some people think that usability is very costly and complex and that user tests should be reserved for the rare web design project with a huge budget and a lavish time schedule. Not true. Elaborate usability tests are a waste of resources. The best results come from testing no more than 5 users and running as many small tests as you can afford.
Nielsen, Jakob. Alertbox (2000). Articles>Usability>Testing>Methods
#28378
#32357
Unexpected Complexity in a Traditional Usability Study
This article is a case study of a demonstration project intended to prove the value of usability testing to a large textbook publishing house. In working with a new client, however, the research team discovered that what our client thought were simple problems for their users were actually complex problems that required the users to evaluate potential solutions in a surprisingly complex context of use. As Redish (2007) predicted, traditional ease of use measures were "not sufficient" indicators and failed to reveal the complex nature of the tasks. Users reported high levels of satisfaction with products being tested and believed they had successfully completed tasks which they judged as easy to complete when, in fact, they unknowingly suffered failure rates as high as 100%. The study recommends that usability specialists expand our definition of traditional usability measures so that measures include external assessment by content experts of the completeness and correctness of users' performance. The study also found that it is strategically indispensable for new clients to comprehend the upper end of complexity in their products because doing so creates a new space for product innovation. In this case, improving our clients' understanding of complexity enabled them to perceive and to take advantage of a new market niche that had been unrealized for decades.
Howard, Tharon W. Journal of Usability Studies (2008). Articles>Usability>Testing>Methods
#32362
A Low-Cost Test Environment for Usability Studies of Head-Mounted Virtual Reality Systems
There is a need to develop new usability testing environments and methodologies for unconventional interactive systems. Pursuant to that need, we developed a low-cost test environment for a Head-Mounted Display (HMD)-based, virtual reality system called Osmose. Osmose was difficult to test for many reasons, one of which was its style of interaction. We began setting up the testing environment about two weeks before the start of the usability testing. We learned many lessons throughout the experience. This paper summarizes the study findings, both methodological - how to setup and conduct a usability lab for such an environment - as well as conceptual -the human experiences and behavioral patterns involved in using an immersive environment.
Seffah, Ahmed, Jonathan Benn and Halima Habieb Mammar. Journal of Usability Studies (2008). Articles>Usability>Testing>3D
#32378
Quick Turnaround Usability Testing
Completing usability testing quickly is a challenge anywhere but especially in consultancies, which have to overcome additional challenges, such as learning a new application. To assure success on these projects, I’ve developed a quick turnaround usability testing methodology (QTUT) that minimizes the time needed to complete testing.
Nuschke, Paul. Boxes and Arrows (2008). Articles>Usability>Testing
#32546
The Sixty-Minute Guide to Evaluating Comparative Test Data
Mary wants to compare the average registration times between the two versions to see if the second version is faster than the first. The method typically used when comparing averages is called a t-test of independent means.
Hughes, Michael A. STC Proceedings (2008). Articles>Usability>Testing>Assessment
#32592
Usability testing makes use of a lot of role-playing scenarios like this one, and many findings and design recommendations result from participants’ responses to these scenarios. But an over-reliance on role playing when testing a product and making design recommendations can have major downsides and risks
Peyrichoux, Isabelle. UXmatters (2008). Articles>Usability>Testing>Personas
#32901
Guidelines for Usability Testing with Children
Although user-centered design is a well-supported concept in the literature on adult computer products, not until recently have publications begun to appear addressing the need to include the user in the design process of children’s computer products.
#33007
Get Out of Your Lab, and Into Their Lives
The proliferation of usability labs is a sign of success for the field of user-centered design. Whether it’s a low-rent lab comprised of a couple adjacent conference rooms, a video camera, and a television, or a fully decked-out space with remote-control cameras, two-way mirrors, an observation room, and bowls of M&Ms — more and more companies are investing in such set-ups. Conducting user tests in labs is probably the most common means of getting user input on projects. That’s a shame, because standard user testing practice is remarkably out of sync with reality.
Merholtz, Peter. Adaptive Path (2006). Articles>Usability>Testing>Contextual Inquiry
#33163
Why Doing User Observations First is Wrong
Field studies, user observations, contextual analyses, and all procedures which aim at determining true human needs are still just as important as ever – but they should all be done outside of the product process. This is the information needed to determine what product to build, which projects to fund. Do not insist on doing them after the project has been initiated. Then it is too late, then you are holding everyone back.
Norman, Donald A. JND.org. Articles>Usability>Testing>Contextual Inquiry
#33186
Conducting International Usability
User testing is a valuable tool, but how does one conduct user tests internationally? This essay draws from my experience leading an international user testing project, and I hope you can learn from my mistakes and successes.
Merholtz, Peter. Adaptive Path (2003). Articles>Usability>Testing>International
#33244
Usability Testing: Revisiting Informed Consent Procedures for Testing Internet Sites 
This paper explores issues of professional, ethical conduct in usability testing centering around the concept of 'informed consent'. Previous work on informed consent has been in homogeneous geographic locations. With Internet sites being developed at a prodigious rate, these procedures need to be revisited for their applicability to heterogeneous locations, in terms of culture, business practice, language and legal requirements. Some previously valued principles might now be considered discretionary, that is their applicability has situational specificity. Other principles are mandatory.
Burmeister, Oliver K. ACM (2000). Articles>Usability>Testing>Ethics
#33245
Videotape has become one of the CHI community's mostuseful technologies: it allows us to analyze users' interactions with computers,prototype new interfaces, and present the results of our research andtechnical innovations to others. But video is a double-edged sword. It isoften misused, however unintentionally. How can we use it well, without compromising our integrity? This paper presents actual examples of questionable videotaping practices. Next, it explains why we cannot simply borrow ethical guidelines from otherprofessions. It concludes with a proposal for developing usable ethical guidelines for the capture, analysis andpresentation of video.
Mackay, Wendy E. ACM SIGCHI (1995). Articles>Human Computer Interaction>Usability>Testing
#33295
Noddys Guide to Usability Testing and Gaming
Discusses how usability testing can be useful at all stages of games development.
#33311
Sometimes we need to take a step back to ensure that our motivations are in the right place. It can be easy to forget that, when people participate in our studies, they are our partners. Dana Chisnell has taken the time to examine these attitudes and help us understand how to avoid falling into such traps.
Chisnell, Dana E. Boxes and Arrows (2008). Articles>Usability>Testing
#33666
Quick Turnaround Usability Testing, Part II
The beauty of the whiteboard method is that your report becomes simply a summary of what you have already written on the whiteboard, including completion metrics, findings, and recommendations that have been vetted by key stakeholders.
Nuschke, Paul. Boxes and Arrows (2008). Articles>Usability>Testing>Methods
#33958
In today’s financial climate, organisations are trying to cut costs. This has led to lots of new and innovative cost-cutting usability techniques springing up. Some of them are ingenious, but not every cost saving measure is a good idea. One technique that is becoming popular with some is focus group usability testing. I recommend that you avoid this technique completely. I’ll try to explain why.
Hamill, David. Good Usability (2008). Articles>Usability>Testing>Focus Groups
#34460
The Benefits of Viewing User Tests
The benefits of user testing have long been established. It is still important however to try and maximise these benefits. One way in which this can be done is by viewing the user test yourself.
Frontend Infocentre (2009). Articles>Usability>Testing>Methods
#34502
Tips for Effective DIY Participant Recruitment for Usability Testing
In case you are not using the services of a professional recruitment agency, or do not have an internal recruitment team that can help you acquire participants for usability tests, here are some tips to help you begin with finding those participants successfully.
Rautela, Abhay. Cone Trees (2009). Articles>Usability>Testing
