Usability Test Project

New York Public Library | www.nypl.org

Julia Marx
LS 560
March 24, 2010

1
Table of Contents

Usability Test 2

Library Website 2

Representative Users 2

Data Collection 4

Data Analysis and Report 4

Bibliography 5

1
USABILITY TEST

Library Website

! According to the the New York Public Library website 28 millions visits are made each
year to the library’s online presence, www.nypl.org. These visitors include persons in more than
200 countries with a variety of cultures, languages, and experiences. The library’s 89 research
and community libraries serve 16 million walk-in patrons annually. One third of New York City’s
population are immigrants.

! The question for this proposed testing: Is www.nypl.org accessible and easy to use for
typical users?

Representative Users

! Users of the New York Public Library and its website are diverse, therefore participants
in this usability testing should represent those differences. Possible users may be:

1) Bilingual young adult: This is your average American tween, who just happens to speak two
languages. She uses the library regularly.

2) Adult Researcher: He is a professional and uses the library regularly.

3) Adult whose second language is English: This individual speaks English very well but would
like to improve his vocabulary. He is a casual library user.

4) Senior Citizen with some visual impairment: This individual is beginning to experience the
effects of Glaucoma. He uses the library intermittently.

5) Senior Citizen whose second language is English. This individual speaks functional English
and wants to improve her language skills. She is a casual library user.

Methodology

! A usability test consisting of 10 tasks will be administered to 5 representative users of the

New York Public Library. The tasks are designed to test the functionality and ease of use of the
library’s website. The time and actions taken to complete the tasks, as well as the participants’
verbal comments and suggestions, will be recorded and analyzed.

2
Setting:

! After participants have been selected they will make an appointment for the test at a con-
venient library branch location. Testing will occur on an individual basis in an assigned branch
computer lab. The computers used will be the standard NYPL public access computers.

! Observers will sit a comfortable distance behind the participant and will remain silent for
the duration of the testing. Participants will be told by the observer that their participation will
help make the library’s website better for all patrons. They’ll also be told that they will not be
graded or judged on their performance nor are there any “right or wrong” ways to go about ap-
proaching a task, other than they must use the library website. They will have no time limits on
individual tasks but will be instructed to finish the test within a specified time limit. The partici-
pants will be encouraged to imagine they are alone in the room. The observer is simply there to
observe and will not be able to help with any specifics of the tasks.

Tasks to be performed by participant:

1) Locate a copy of the Medieval English play Everyman by Anonymous in the catalog.

- note the call number, nearest library location, and availability of item.

2) Find the address and hours of that library (from task 1).

3) Find journal articles on homelessness.

4) Locate a picture of Geronimo, the Apache leader and medicine man.

5) Adjust the type size of the website.

6) What programs and events are happening tomorrow at the Grand Central branch?

7) Which libraries offer wireless internet access (WIFI)?

8) Find a list of current job openings in the library system.

9) What information can you find on the history of the New York Public Library?

10) Which branches offer English classes for speakers of other languages?

3
Data Collection

! Data collection will occur in 3 parts:

! Quantitative data will be collected with a a screen capture software, such as Camtasia.
This will record the exact movements of the participant through the test and will be analyzed to
find the number of clicks per task and task completion time.

! Qualitative and quantitative data will be collected by both an observer and an exit ques-
tionnaire. Each observer will take notes (pencil and paper) on participant’s comments during
tasks as well as their own suggestions for improving usability of the website based on perceived
difficulties of the participant. The exit questionnaire will gather the participant’s perceptions on
completing tasks (such as difficulties) and their suggestions for making the website better.

Data Analysis and Report

! Quantitative data collected such as task completion times and number of clicks per task
will be entered into a spreadsheet and appropriate charts will be made to visualize the outcomes.
Qualitative data such as observer and participant comments and suggestions will be constructed
into a written report.

! The observer will analyze the data sets in order to answer the following:

1) Effectiveness - Did participants perform tasks completely and correctly?

2) Efficiency - How much effort did it take for participants to perform a task completely and cor-
rectly?

3) Satisfaction - Did participants feel comfortable performing the task?

! The results of this study along with the data sets will be organized into a written report
and presentation called, Usability Suggestions for Improving nypl.org, and presented to the web-
site administrators.

4
BIBLIOGRAPHY

Designing and Implementing a Usability Study: User Studies: NCSU Libraries. Retreived 3/23/!
! 10, from http://www.lib.ncsu.edu/userstudies/procedures/utdesign_study.html

Genuis, S. (2004). Web Site Usability Testing: A Critical Tool for Libraries. Feliciter, 50(4), !
! 161-4. Retrieved March 23, 2010, from Library Lit & Inf Full Text database.

New York Public Library. Retrieved 3/23/10, from http://www.nypl.org

Nielsen, Jakob. Usability 101: Introduction to Usability. Retrieved 3/23/10, from ! !

! http://www.useit.com/alertbox/20030825.html

Usability Testing at OCLC. Retrieved 3/23/10, from http://www.oclc.org /US/EN/usability !

! /testing/default.htm