Jeff Sauro

Principal, Measuring Usability

A History of Usability


Click to view a larger image.

Jeff's infographic is a beautifully designed snapshot of the last 100 years of usability. A poster-sized print is available for purchase.

For those who prefer a text-based commentary:

  • 1911: Frederick Taylor publishes Principles of Scientific Management which describes time and motion studies and methods for improving industrial efficiency.
  • 1916: Frank and Lillian Gilbreth reduce work motions into smaller steps and pioneer ways of making work faster and easier from bricklaying to clerical work. They applied this method during World War I by showing soldiers how to assemble and disassemble weapons in the dark.
  • 1936: The Palm Beach Post publishes an advertisement for a new Frigidaire highlighting usability as one of its features.
  • 1943: Alphonse Chapanis, a lieutenant in the U.S. Army, shows that "pilot error" can be greatly reduced through the more intuitive layout of airplane cockpits.
  • 1947: John E Karlin at Bell Labs is named head of the newly-formed User Preference Department (later renamed the Human Factors department) where he would help perfect the modern numeric dialing system and keypad still in use today.
  • 1954: Paul Fitts publishes a paper in the Journal of Experimental Psychology that describes a mathematical model used to predict the time it takes to move to a target based on its size and distance (which became known as Fitts' Law).
  • 1956: The psychologist George Miller coins the phrase "the magic number seven plus or minus two" from a variety of experimental results indicating that humans have trouble holding more than five to nine items (chunks) simultaneously in working memory.
  • 1957: The Human Factors Society is formed.
  • 1967: Micheal Scriven writes about formative and summative evaluations in the education literature as applied to student learning and assessment. These terms would later be applied to different types of usability evaluations.
  • 1979: Permanent Labs at companies like IBM perform what we now would call Summative usability testing. The first scientific publication with usability in its title appears, The Commercial Impact of Usability in Interactive Systems by John Bennett.
  • 1980: Ericson and Simon publish "Verbal Reports as Data" which focuses on using the Think Aloud Method that would later come to dominate usability tests.
  • Alphonse Chapanis' student, Jeff Kelley, is credited with coining the term "Oz Paradigm" which we now refer to as the "Wizard of Oz" method.
  • 1981: Alphonse Chapanis and colleagues publish Tutorials for the First-Time Computer User which describes usability as more of a formative than summative activity. They suggested that observing about five to six users using the software will reveal most of the problems in a usability test.
  • 1982: Wanting a more precise estimate of a sample size than 5-6, Jim Lewis published the first paper describing how the binomial distribution can be used to model the sample size needed to find usability problems. It is based on the probability of discovering a problem with probability 'p' for a given set of tasks and user population given a sample size 'n'.

    Clayton Lewis publishes an IBM technical report using Herb Simon's Thinking Aloud" Method in Cognitive Interface Design.
  • 1983: The Psychology of Human Computer Interaction is published by researchers at Carnegie Mell on and Xerox PARC (Stuart Card, Thomas Moran & Allen Newell). This seminal book explains GOMS and Keystroke Level Modeling based on the earlier work of Taylor, Fitts and Gilbreth.

    The first CHI Conference was held in Boston as part of ACM's SIGCHI subgroup.
  • 1984: Apple introduces the Macintosh during the 1984 Super Bowl, making the case that ease of use sells.

    Smith and Moser publish 997 guidelines for Designing User Interface Software.

    The Human Factor, by Harry Hersh and Dick Rubinstein, both at Digital Equipment Corporation, is published. It is the first book-length description of human-computer interaction.
  • 1985: J. Gould and Clayton Lewis publish the influential paper, "Designing for Usability: Key Principles and What Designers Think". They discuss an early and continual focus on users as well as empirical measurement and iterative design.

    Computer Usability Testing & Evaluation by Richard Spencer is published.
  • 1986: John Brooke at Digital Equipment Corporation creates a "quick and dirty" questionnaire to assess the usability of software. The System Usability Scale (SUS) has gone on to become the mostly widely used questionnaire for evaluation perceptions of system usability.

    The first local chapter of SIGCHI is started in Boston a few months after the annual SIGCHI conference is held there.
  • 1987: Designing the User Interface (1st edition) by Ben Shneiderman is published. It is now in its fifth edition.

    The Questionnaire For User Interaction Satisfaction (QUIS) is published based on the work at Ben Shneiderman's HCI lab at the University of Maryland.
  • 1988: John Whiteside at Digital Equipment Corporation and John Bennett at IBM published a number of chapters and papers on the topic of "usability engineering" (Whiteside, Bennett, & Holtzblatt,1988) which stressed early goal setting, prototyping and iterative evaluation. Joe Dumas, one of the godfathers of usability, attributes these papers and this period as the birth of usability as a profession.

    Don Norman publishes the "Psychology of Everyday Things", which later would be renamed the Design of Everyday Things.
  • 1989: The Technology Acceptance Model (TAM), including a questionnaire to measure perceived usefulness and usability, is published by Fred Davis.
  • 1990: Shackel publishes Human Factors and Usability which defined usability as a function of efficiency, effectiveness & satisfaction (the ISO 9241 pt 11 standard). Despite many proposed extensions, we still think of usability in terms of these three aspects.

    Peter Polson & Clayton Lewis publish several papers on the Cognitive Walkthrough.

    Jakob Nielsen & Rolf Molich publish the seminal paper "Heuristic Evaluation of User Interfaces," in which they describe this influential discount usability method.

    Robert Virzi details three experiments at the Human Factors and Ergonomics Society Conference replicating earlier work from Nielsen using the binomial formula for deriving sample sizes for usability studies.
  • 1991: The Usability Professionals Association is formed by a group of CHI attendees including Janice James who along with Ginny Redish would start the usability special interest group in the Society of Technical Communications.
  • 1992: Robert Virzi's paper "Refining the test phase of usability evaluation: How Many Subjects is Enough?" is published. This, along with his previous paper found that additional subjects are less and less likely to reveal new information in a usability test. The first 4-5 users find ~80% of problems in a usability test (avg. p of .32). Severe problems are more likely to be detected by the first few users.

    Jim Lewis publishes the Post Study System Usability Questionnaire (PSSUQ).
  • 1993: Usability Engineering by Jakob Nielsen is published.
    A Practical Guide to Usability Testing by Joe Dumas & Ginny Redish is published.

    Publication of the Software Usability Measurement Inventory (SUMI) questionnaire by Jurek Kirakowski at the University of Cork.

    A listserve dedicated to usability is started by Tharon Howard and continues to be a popular discussion outlet to this day.
  • 1994: Jeff Rubin publishes The Handbook of Usability Testing.

    Cost Justifying Usability by Randolph Bias & Deborah Mayhew is published.

    Jim Lewis reexamines Virzi's claims in the paper "Sample sizes for usability studies: Additional considerations" and finds general support for the claim that additional users are less likely to reveal new information but the sample size is dependent on the problem occurrence. He also found that problem severity and frequency were independent.
  • 1995: Jakob Nielsen publishes the first bi-weekly column on usability on useit.com which continues to this day.

    The Usability Professionals' Association holds its first annual meeting in Portland Maine.
  • 1996: John Brooke publishes the System Usability Scale (SUS) after 10 years of use in industry.

    WebEx is founded in California and goes on to develop screen sharing and conferencing software that will be used in moderated remote usability testing.
  • 2000: Don't Make me Think by Steve Krug is published which brings usability testing to the masses using the same Think Aloud method from Ericson and Simon from 20 years earlier.
  • 2001: American National Standards Institute (ANSI) develops the Common Industry Format for Usability Test Reports (CIF).
  • 2002: The first publications about remote usability testing emerge, including the one by Tom Tullis et al on "An Empirical Comparison of Lab and Remote Usability Testing of Web Sites”.
  • 2003: Observing the User Experience is published.
  • 2006: Methods of automating heretofore expensive and time consuming usability studies using software and crowdsourcing are published.
  • 2008: Tom Tullis and Bill Albert publish Measuring the User Experience, the first book dedicated to measuring usability, which for the last decade had turned increasingly qualitative.
  • 2010: Beyond the Usability Lab: Conducting Large-Scale User Experience Studies is published.
  • 2012: UPA changes its name to the User Experience Professionals Association (UxPA).

    Sauro and Lewis publish the first book on the statistical analysis of usability data: Quantifying the User Experience: Practical Statistics for User Research.

​Note: this post contains affiliate links. We appreciate your support!

Jeff Sauro

Jeff is the founding principal of Measuring Usability LLC, a usability and quantitative research firm in Denver, CO. He is author of over twenty journal articles and four books, including Quantifying the User Experience. Jeff has a masters from Stanford University and is a PhD candidate in Research Methods & Statistics at the University of Denver.

Comments

comments powered by Disqus

UXmas is a joint effort from the teams at Thirst Studios and UX Mastery.

Sign up for regular emails and notifications about the latest articles...