Managing Digitization Activities · 153
http://ldp.library.jhu.edu/services/usability
Johns Hopkins University
A focus group typically involves a moderator, a note-taker, and 6-10 participants. Guided by a set of
questions, the facilitator moderates a discussion about the system, while the note-taker and perhaps a
tape recorder keep track of the conversation. Topics may include: how the participants currently use
the system, what other systems they use instead, and what they would like the system to be able to do
in the future.
Scenario-based think-aloud tests
A scenario-based think-aloud test session involves a participant, a facilitator, and a note-taker. The
facilitator presents a series of scenarios to the participant. The participant uses the system to complete
the tasks presented in the scenarios while "thinking aloud," that is, while providing comments on what
he is doing. The note-taker and the facilitator keep track of these comments as well as the participant's
actions and the system's responses. Several test sessions are held in order to observe the experiences
of different users.
Contextual inquiry
An observer watches the participant working with the system in the context of his or her typical work
environment. The observer may ask some questions at the end of the session, but the most important
aspect is observation of real use of the system in the work environment.
Card-sorting
A facilitator presents a set of cards to the participant. Each card contains a brief description of one
page in the system. The participant sorts the cards into groups and labels each group. The facilitator
compiles the results from several participants and conducts a cluster analysis in order to see which
cards tend to be grouped together most frequently. This information is applied to the organization of
pages and links.
Link-naming
This is a two-stage method. In the first stage, the facilitator presents a set of page names to the
participant and asks what she would expect to see if she clicked on links by those names. In the second
stage, the facilitator presents descriptions of the pages or the pages themselves and asks what the
participant would call the links to those pages. The facilitator can recommend new link names for the
terms that were frequently misunderstood or renamed by participants.
Heuristic evaluation
In a heuristic evaluation, a usability specialist inspects a web site to determine if it meets general
guidelines for usability and accessibility, such as consistency in navigation, clarity in language, and
flexibility in the pace of interaction.
http://ldp.library.jhu.edu/services/usability
Johns Hopkins University
A focus group typically involves a moderator, a note-taker, and 6-10 participants. Guided by a set of
questions, the facilitator moderates a discussion about the system, while the note-taker and perhaps a
tape recorder keep track of the conversation. Topics may include: how the participants currently use
the system, what other systems they use instead, and what they would like the system to be able to do
in the future.
Scenario-based think-aloud tests
A scenario-based think-aloud test session involves a participant, a facilitator, and a note-taker. The
facilitator presents a series of scenarios to the participant. The participant uses the system to complete
the tasks presented in the scenarios while "thinking aloud," that is, while providing comments on what
he is doing. The note-taker and the facilitator keep track of these comments as well as the participant's
actions and the system's responses. Several test sessions are held in order to observe the experiences
of different users.
Contextual inquiry
An observer watches the participant working with the system in the context of his or her typical work
environment. The observer may ask some questions at the end of the session, but the most important
aspect is observation of real use of the system in the work environment.
Card-sorting
A facilitator presents a set of cards to the participant. Each card contains a brief description of one
page in the system. The participant sorts the cards into groups and labels each group. The facilitator
compiles the results from several participants and conducts a cluster analysis in order to see which
cards tend to be grouped together most frequently. This information is applied to the organization of
pages and links.
Link-naming
This is a two-stage method. In the first stage, the facilitator presents a set of page names to the
participant and asks what she would expect to see if she clicked on links by those names. In the second
stage, the facilitator presents descriptions of the pages or the pages themselves and asks what the
participant would call the links to those pages. The facilitator can recommend new link names for the
terms that were frequently misunderstood or renamed by participants.
Heuristic evaluation
In a heuristic evaluation, a usability specialist inspects a web site to determine if it meets general
guidelines for usability and accessibility, such as consistency in navigation, clarity in language, and
flexibility in the pace of interaction.
