Putting A/B Testing in Its Place
http://www.useit.com/alertbox/20050815.html

Nielsen, Jakob
Alertbox
2005

Abstract:

Measuring the live impact of design changes on key business metrics is valuable, but often creates a focus on short-term improvements. This near-term view neglects bigger issues that only qualitative studies can find.