Usability Testing of an Internet Form for the 2004 Overseas Enumeration Test: Iterative Testing Using Think-Aloud and Retrospective Report Methods

An Internet form for the U. S. Census Bureau's 2004 Overseas Enumeration Test was evaluated in two rounds of usability testing. Participants were assigned to one of two conditions: Think-Aloud, in which they talked about what they were doing; or Retrospective-Report, in which they completed the form and then talked about their experience while viewing a recording. Participants also completed follow-up tasks. Sessions were video taped and logged. Round 1 testing identified 28 usability issues. Round 2 testing found that 13 of the issues had been resolved following design changes made to the interface. Round 2 testing identified 21 new and continuing usability issues. Results suggest that changes made to the interface increased the likelihood that respondents would be able to successfully complete the form. Task completion times in the think-aloud condition were only slightly longer than they were in the retrospective condition, while retrospective reports required a substantial amount of added time.