Usability Test Report For Home Depot Project Color

1
Final Project Test Report:

Home Depot Project Color
Conducted by Group 3: Cassidy Craig, Sabrina Dali-Mendoza,

Jessica Klayman, Jonathan Neal, Francis Salatino
Back to Table of Contents
Usability Test Plan for

The Home Depot Project Color
___________________________________________________
Prepared for:
Dr. Jane Moody, Professor ENC 4290
Completed by:
Group 3
Cassidy Craig
Jonathan Neal
Sabrina DAli-Mendoza
Francis Salatino
Jessica Klayman
Date:
December 06, 2015
TABLE OF CONTENTS
3
Cover.1
Title.2
Table of Contents....3
Executive Summary.4
Introduction.4
Test Plan and Procedures.5
Users.6
Scenarios.7
Top Findings and Severity Codes.8
Analysis from Questionnaires.10
Recommendations.11
Urge to Action.12
Appendices
Section 1 - Heuristic Evaluation.13
Section 2 - Moderator Script.26
Section 3 - Screening Questionnaires.27
Section 4 - Post-Task Questionnaires.30
Section 5 - Post-Test Questionnaires.36
Section 6 - Personas.44
Section 7 - Session Logs.48
Section 8 - Test Plan.49
Section 9 - Miscellaneous.71
EXECUTIVE SUMMARY
Our group analyzed a smartphone app called Project Color. Overall, the study
participants did not enjoy using the app, because they encountered numerous design
flaws and usability issues that hindered their progress in significant ways. The majority
opined that while the app is capable of doing what it should, its structure and layout are
too confusing for it to really be useful. The symbols and prompts are also problematic,
often leading to dead ends when the user cant figure out what to do or where to go
next. These various problems are quite damaging, because Project Color is only likely
to be used for a short time, and users will probably not want to spend a lot of time
learning how it works. We offer our recommendations for change below.
Specifically, the study participants encountered high priority usability issues with
the following areas:
Navigating backwards and forwards,
Locating the checkout menu, and
Utilizing the Match It feature.
For a more detailed description, see Top Findings and Severity Codes.
Fortunately, these various flaws might be repaired without too much extra effort, as the
core area that needs work is the just clarity of the signifiers. The majority of our
volunteers agreed that the app is capable of doing what is should. Most of the usability
problems will be resolved if the buttons and prompts are reworked.
INTRODUCTION
Since the advent of the first Smartphones, applications (or apps) have become
increasingly popular. With even fast food companies such as McDonalds and Steak N
Shake releasing apps to make commerce run more smoothly, reach out to customers
with promotions, and gather data, Smartphone apps have become a ubiquitous part of
the digital landscape. Today you can check your bank balance, deposit checks into
your account, order goods and services from Amazon all with the click of a button. This
makes it easier for both customers to shop and it also gives those companies a direct
connection to the users of their goods and services.
In theory, commercial Smartphone apps should be mutually beneficial for both
the users of those apps and the companies that develop them. Such apps should be
easy to use even for novice users, complete with features like as Help/Technical
support, intuitive user-interface, and other features that will encourage potential
customers to save time and spend less time in the store.
Home Depots Project Color app is supposed to make it easier for customers to
pick out house paint, and give them an idea of what various colors would look like on
the surfaces they intend to paint. We tested the applications usability by asking
volunteers of varying levels of proficiency to perform basic tasks using Project Color.
The following report is covers our methods of testing as well as the results and
conclusions weve drawn based on feedback from our volunteers.
TEST PLAN AND PROCEDURES

Our groups test plan and procedures encompassed a series of tests and
questions that offered insightful data about our product. Together, we created a
screening questionnaire, pre-test questionnaire, post-task questionnaire, and a post-test
questionnaire to gather the information we needed during our time spent testing. Each
of these tests individually were crucial to the success of our project. Our goal for the
tests was to learn about how a consumer would respond to this app and any challenges
they might encounter along the way. In this sense, we could learn about the usability of
this application.
The screening questionnaire was used to discover the background of the person
we were testing. Through this set of questions we learned not only basic things about
the person such as their gender and age, but their comfort level using technology.
Understanding where this person was in their level of comfort towards technology was
important to note so that we could read their end results with the application
appropriately; for example, if they are clueless about technology and had issues with
the test then we cannot conclude the app does not work well, but that perhaps their
issues with technology was a factor.
The pre-test questionnaire is specifically pointed questions to the test subject
regarding the Home Depot Project Color app. The purpose of this test was to find what
expectations the test subject had about the app going into the test. This gave insight
into what a regular consumer would expect from the app when they download it.
Both the post-task questionnaire and the post-test questionnaire work together to
understand what the test-subject thought about each aspect of the app. This was
accomplished by creating various types of questions; there were questions that required
a 1-5 rating to represent how well they agree with the prompt, write-in answer questions
such as The aspect I liked most about Home Depot Project Color app was, areas
where the participant could list any changes they felt needed to improve in the app as
well as space to write any comments they would like. The variety of questions were put
into place to ensure we got the most information from the testing as possible.
Our procedure was for 4 group members to find one person willing to participate
in this test and conduct the previously agreed upon tests. After having found our one
person, each group member used a smartphone or some other recording device to
capture the test subjects verbal reactions to navigating the app.
USERS
We had four users for our testing purposes.
The first user was a Female who is 34 years old. This user has average
proficiency when it comes to technology. She mostly uses her apps for social media
and has downloaded a total of 6 in the past month. When asked about average amount
of time spend on apps in an average week she responded with 7-8 hours. She fit our
parameters and was found to be a good test user.
The second user was a Male who is 67 years old. This user rated himself as a 5
in proficiency when it comes to technology on a scale of 1-10. He mostly uses a
desktop computer and has not downloaded any apps in the past month. This user
mostly uses email and messaging functions on his smartphone. When asked about
average amount of time spend on apps in an average week she responded with 1 hour.
He fit our parameters and was found to be a good test user.
The third user was a Female who is 27 years old. This user rated their
proficiency as a 6 on a scale of 1-10 when it comes to technology. She mostly uses her
apps for games and has downloaded none in the past month. When asked about
average amount of time spend on apps in an average week she responded with less
than 1 hour. She fit our parameters and was found to be a good test user.
The final user was a male who is 23 years old. This user rated their proficiency
as a 7 on a scale of 1-10 when it comes to technology. He mostly uses apps for social
media, text messaging, bleacher report and emails. He has downloaded a total of 3
apps in the past month. When asked about average amount of time spend on apps in
an average week he responded with 6-7 hours. He fit our parameters and was found to
be a good test user.
As you can see we had a variety of users to test and each has a different level of
technology proficiency as well as experience levels with applications. This allowed us
to diversify our results and avoid any bias results.
SCENARIOS
Each moderator made the effort to keep the testing scenario both professional
and organized for every volunteer. Each volunteer would be greeted and given a
general understanding of what the test pertains too in terms of content. Once the
volunteer agrees to partake in the study they are given the consent form. This form
gives a brief overview of both their rights and the right of the moderator. Once this
document is signed the moderator begins the pre-screening questionnaire. For further
reference and detail on the pre-screening script consult Section 1 of the Appendices.
Once the volunteer has located the app and downloaded the program successfully the
volunteer then begins the usability testing process. This begins with the volunteer filling
out the pre-task questionnaire. For further detail on these topics and the volunteers
consult Sections 3-5 of the Appendices. The volunteers would be both guided through
the app without instruction and with instruction from the moderator. This dual tactic
allows for a more thorough understanding of the user ability. Once the usability test was
complete the moderator would then administer the post task questionnaire. This is the
conclusion of the usability test where the volunteer is given the opportunity to express
their opinion on the user ability of Project Color.
TOP FINDINGS AND SEVERITY CODES

SEVERITY CODES
Our ranking system has three levels: high priority, medium priority, and low
priority. High priority issues have a significant impact on usability, in which the user is
unable to continue using the product or one of its important features. Medium priority
issues are lesser problems, though ones that should be fixed if possible. Minor
problems are cosmetic, but worth mentioning because we want the product to be
polished.
TOP FINDINGS - HIGH PRIORITY

There is no universal back button to help navigate through menus. The way users
navigate is not streamlined, as there are several different back buttons with
contrasting appearances, and a few of the menus lack a back button entirely. The
majority of our volunteers needed to repeat an action but found themselves unable to
locate the previous menus.
The checkout menu is difficult to locate. This is a significant problem, because enabling
users to buy paint is a fundamental part of Home Depots agena. The majority of our
volunteers were unable to find it without help.
Users have trouble with the Match It menu, which is used to select colors from
photographs for use in other photographs. There are no instructions on the screen after
thee user takes his/her first picture - it merely becomes still, causing it to appear as
though the app has crashed or frozen.
TOP FINDINGS - MEDIUM PRIORITY

There is no visible indicator that there are two drawing modes (draw and fill). The
majority of our volunteers did not utilize both.
The paint button shares a space with the erase button, often causing confusion about
which mode is currently active. The button does not display the tool that is being used,
but rather the tool that would be used if it were pressed again. A different way to
distinguish between these two modes would be helpful.
Painting around windows can be difficult. This is mainly due to the previous two issues.
The See It and Match It mode titles are too vague. The majority of our volunteers
expressed some concern that they were guessing where to go first.
TOP FINDINGS - LOW PRIORITY
The menu for Editing Tools is redundant as it only contains one editing tool. This is not
a significant usability problem, since the majority of our users were able to find the tool
inside without any trouble. However, it remains a design flaw.
There is no internal help menu. This is not a significant usability issue, because the
majority of our volunteers decided that they would not put much time into learning the
apps functions. We suggest improving the apps UI before adding more text.
ANALYSIS FROM QUESTIONNAIRES

10
Upon carefully reading each of the questionnaires there were several issues that
seemed to be a problem for each user who tested Home Depots Project color. There
were a lot of similarities in the features that the users liked as well. Any of the issues
that were mentioned by more than one user can safely be considered problematic.
Overall the user responses on their experience using Home Depots Project Color were
negative.
The most common problem, which was mentioned in one form or another in all
four of the surveys we conducted was that it was not user friendly or intuitive. While the
younger users in our group seemed to have less trouble completing the tasks than the
older users, none of the users thought that the user interface was consistent or selfexplanatory. Most users noted that there was no Back button on the menu. Another
user noted that the instructions on the opening screen See it and Match it are not
clear instructions on how to use the application or what to do first.
Several users had difficulty using the color match tool. As one of the applications
main features, the color match tool should be easy to use. This is a difficult flaw to
overlook, and since it showed up as an issue on several of our surveys it's probably an
issue that the developers of Project Color should consider addressing.
Half of the users we surveyed said that that the tasks they were asked to perform
took between 5 and 10 minutes, with two outliers. One user was able to complete the
tasks in under 5 minutes and another user took between 10 and 25 minutes. The user
who was able to complete the tasks in the shortest period of time gave a less negative
review of Project Color, and while overall, most of the feedback was negative, the user
who took the longest to complete the tasks feedback seemed more negative than the
others.
The most popular, or the only feature that each user said they liked about the
product was the color match feature, but that was also a feature that users had the most
difficulty using successfully. The idea of the color match tool was popular, but the
execution of it is problematic.
While several users noted that the concept was a good idea, most followed that
by saying that the bugs, and problem areas needed to be fixed in order for the
application to be useful to them. The general consensus was that the program would
be useful if it could easily do the things it is supposed to do, but that it was needlessly
complicated. Clarity of how or what it could do were also an issue. It was unclear to
our users whether or not you could purchase the paint color you choose using the
application, and if you could how it was done.
RECOMMENDATIONS
11
As far as improvements for the Home Depot app go, our team has some
suggestions to offer based on the data we acquired. We have found that there are both
short-term and long-term improvements that can be made. The short-term
improvements are the smaller issues-the ones that are simple fixes. This means then
that the long-term improvements are the more difficult ones to deal with and the ones
that have greater effects on the usability of the app.
One of our short-term recommendations for improvement would be to make the
fact that there are two different drawing modes more clear. Through our testing we
discovered that most of the participants were unaware that this was even an option.
Another recommendation we have is to add a way to view two separate pictures at the
same time. The addition of this would be ideal for people who wish to compare colors
without the trouble of having to go back and forth through the app. There a few small
issues that, if resolved, would make the app much simpler to use. A specific problem we
encountered through testing was that tools for editing were scattered throughout the
app. We recommend collecting all the editing tools and putting them under the Editing
Tools menu. Currently, this menu has only editing tool. These short-term fixes will
make a huge difference in the overall usefulness of the app.
As far as long-term improvements go, we found a few that affect the app more
than the others and cause the usefulness of the app to be minimal for some consumers.
One of these long-term improvements that need to be made is a dedicated back
button. Through the testing, many participants dealt with frustration when they could not
go back to the main menu or to whatever they were previously on. We recommend that
a back button remain constant no matter where in the app you are so that the user has
the freedom to move through the app without getting stuck and not being able to go
back. Another major issue is the system locking up or crashing. When switching from
live view to still photo the system would often lock up or force the user out of the
application completely. Whenever an app has any sort of crashing happening it gives
the impression to the user that it is broken and they often will not deal with it any longer.
Overall, the greatest issue we found with the app is the lack of clear directions and
guidance offered. Our recommendation is to add in tips instead of leading the user to a
page without any directions. While experienced users might be able to guide
themselves through the process, a huge portion of your consumers are being ignored
by not offering more guidance. Another recommendation to help fix this issue is to add a
help page. This way, if someone needs assistance they have a place to go and if they
dont then they are not bothered.
We believe that these are important problems to tackle, both short-term and longterm. If dealt with, the usability of this app will be much better.
URGE TO ACTION
12
Since only four test subjects were used it would be best to take the format
created and expand the pool of users tested. For the purpose of the initial testing the
results were consistent with the users experiences and knowledge of applications. To
get more accurate results a testing pool of roughly 100 plus users would give a better
picture. We suggest keeping the mixture of age and sex to keep the results diverse and
quantifiable with these current results.
APPENDICES
Section 1 - Heuristic Evaluation

13
Heuristic Evaluation:
Project COLOR
Introduction
The Home Depots Project Color app promises to ease a buyer's concerns when
it comes to committing to a new paint color. This is supposedly accomplished through
an application that allows the user to view paint colors against their house or wall
without any consequences. Our group chose to test this app and see how user-friendly
it was. Before conducting a test ourselves, we thought it best to discuss the user type
we would consider as well as the scenario. Our user type would likely be an individual
who is inexperienced with this specific app- a majority of people do not paint their house
very often so even if they have used the app before they might have lost familiarity. Our
scenario was specified with more guidelines; we would look at how the app works when
choosing a color to paint the outside walls of our house. Our individual tests of the
application will be critical to our future testing. This report allowed us to become
comfortable in the inner workings of the app; it also unveiled any issues to look out for
to see if other users encounter the same issues. In these ways the report helps us find
patterns and understand usability.
Purpose
The purpose of our test is to provide a description of the critical elements within
the Project Color application. This test plan will identify any problems that may exist so
that executives, developers, and managers can react to increase the experience of the
users. Our group plans to use this report in preparation for testing by developing the
proper testing scenarios for the users. The report will also assist our group with setting
up realistic test goals. Without these test goals we will be blindly testing users without
any specific desired results. We feel that the results below will be a good benchmark for
us to begin our testing.
Methodology
14
To evaluate Project Color, our team has conducted a formal evaluation and
review. We first agreed upon the target user, then tested the application with that
mindset, exploring the entire experience. This includes: starting the application, taking
photos (indoors and outdoors), manipulating the photos with different paint colors,
textures, and finally exploring the check-out feature. Our set of heuristics is divided into
Quesenberys five Es: Engaging, Efficient, Effective, Error Tolerant, and Easy to Learn.
Within each E, we considered Nielsons 10 heuristics model, locating and marking
issues with these specific aspects of usability in mind.
Ranking/Priority System Used
Our ranking system has three levels: high priority, medium priority, and low
priority. High priority issues have a significant impact on usability, in which the user is
unable to continue using the product or one of its important features. Medium priority
issues are lesser problems, though ones that should be fixed. Minor problems are
cosmetic, but worth mentioning because we want the product to be polished.
Heuristic Evaluation Findings

Each member of the group was tasked with their choice of Quesenberys Five Es
to test our subject. Listed below are the findings.
Quesenbery E used: Engaging.
Criterion Overview: In order to create a successful app that engages its users, it is
necessary to setup a simple layout that is easy for a majority of people to navigate.
Other things to keep in mind when looking to engage users are: visual elements,
descriptions and fun activities to allow the user to enjoy the product.
Suggestion: Overall, the app could work on being more engaging to its users through
different methods.
15
Specific Issue- No dedicated back button.
Description-There are 3 simple choices when the user first opens the app. While
this aspect is very engaging due to its simplicity, there is no clear way out of the
option and back to the home screen once a choice has been made. Since the
options are not detailed the user must discover through trial-and-error. While
there is a sidebar menu option, it does not have the ability to get the user back to
the main menu.
Suggestion- The addition of a undo or back to menu feature to the app would
be an enormous improvement to the engaging qualities of the app. It is essential
to have this throughout every step of the way so that the user has control to
venture through the app without repercussions. Nielsen stresses the importance
of this by saying, Users often choose system functions by mistake and will need
a clearly marked emergency exit to leave the unwanted state without having to
go through an extended dialogue (Barnum 62).
Specific Issue- Favorite colors are difficult to locate.
Description- When the user selects the choose a color menu, favorite colors
arent a selectable option. Instead, to find your favorite colors you must go to the
system menu where the different app functions are, which is not logical or
simple.
Suggestion- Add a favorite colors tab at the top of the choose a color menu.
This tab is already functional on other menus, so it would not be difficult or
expensive to implement here.
Quesenbery E used: Error tolerant.
16
Criterion Overview: Due to the lack of information and prompts it is not difficult to come
across an error message or find a glitch. Things such as: lighting, angles, odd shaped
walls and many others create obstacles when designing your space.
Suggestion: Overall, I believe this app could use more prompts and how-tos. The
current application does not offer quick tips or suggestions when taking or uploading
pictures.
Specific Issue- Insufficient information about security settings.
Description- Users who are not familiar with smartphones may struggle with the
required add-ons and security settings required by the application. If you do not
have your camera set to allow access to your photos the application will lock up
and require you to leave the application and return once you update your phones
privacy settings.
Suggestion- Once the application is installed it would be helpful for there to be a

quick tips before you begin or pop up informing you of this requirement to
ensure proper use of the application.
Specific Issue- Live View is prone to errors.
Description- When opening the application and selecting see it you are given the
option to Take Photo, Load Photo or Live View. If you were to select Live View
and then click Take Photo it will take a still photo. You will then receive the
17
options to paint the space you just took a still photo of. An error will then occur
and you are not able to paint the space. The paint brush will show you drawing
the lines but they disappear as soon as you let go.
Suggestion- The function to paint the space that you just took a still photo of is
available; it just needs to have the bugs worked out. The steps and buttons are in
place but need to be functional.
Quesenbery E used: Effective.
Criterion Overview: When looking at how effective the app is it must be considered that
the app itself is designed to save Home Depot shoppers time and money on paint
related projects. Whether it be deciding on a color, choosing a room to paint, matching a
piece of furniture to a complimentary paint color, or any other possible combination this
app is in fact effective. Because the app allows a sample color to be applied to any
space provided in a photograph the time and money of going to Home Depot and
acquiring a physical sample is saved.
Suggestion: Overall the accuracy of the app is what inevitably varies. Because each
human eye is different the app relies heavily on the consumer perception of what the
color will look like on the wall, dry. The efficiency of the app is going to constantly be in
question as a result of this premise.
Specific Issue- Insufficient feedback.
Description- One of the main issues with the efficiency of the app is the lack of
direction. Although as a new user I was able to move comfortably throughout the
settings, more feedback would be a significant improvement to future users.
18
Suggestion- When taking photos helpful reminder bubbles should appear reading
turn off flash to avoid glares and discoloration and use HDR functions to
improve color accuracy. These bubbles should appear initially then disappear in a
timely manner.
Specific Issue- Inconsistent menu design.
Description- The initial screen of the app is ideal in that it is clean and
straightforward. However, this soon becomes lost in drop down menus, side
screens, clear all buttons, and a mess of other consistency issues.The side menu
with the same options as the home screen appears cluttered and confusing to
users.
Suggestion- Eliminate the side screen and the irellevant escape cues in place of
one single home button that will bring the user back to the original screen. This will
give users a certain level of expertise in that they know how to go back if they get
lost. This will greatly improve the efficiency and time spent using the app itself.
Quesenbery E used: Easy to learn.
Criterion Overview: Some users are not experienced with smartphones or technology in
general. For this reason its important to make applications approachable and easy to
learn - otherwise, the application could fail to fulfil its purpose. Some qualities to look out
for are visibility, flexibility, and helpful documentation.
Suggestion: The fundamental idea is to make
19
Specific Issue- No indicator of drawing modes.
Description- There is no visible indicator that there are two drawing modes. New
users may not realize that tapping the screen fills a field with color, while drawing
a continuous line generates blotches. Because of this, its possible that users
wont use both features.
Suggestion- According to Nielsons 10 heuristics, Instructions for use of the

system should be visible or easily retrievable whenever appropriate (Barnum 62).
Therefore, there should be explicit instructions on the painting screen letting users
know what they are able to do. Alternatively, there could be a button that reveals
the instructions.
Specific Issue- Text can be too small in external help screen.
Description- In the help screen (a webpage meant to supplement the application),

the text size is too small, and the user cannot zoom in. It is too difficult to read this
way.
Suggestion- Since the phones Internet browser is not a part of Project Color, the
best way to solve this issue would be to put the instructions in the application
itself. Then it would be possible to incorporate a reliable zoom function.
Quesenbery E used: Efficient.
20
Criterion Overview: While the application may be helpful in giving the user a general
idea of how certain colors will look in their homes, lack of visible cues make it difficult to
figure out how to get started. Additionally, there doesnt seem to be a way to change the
size of the brush, and painting any surface with visible windows or other features means
the user has to meticulously color around such objects. In order to paint a room
efficiently using the app, one would need to remove any pictures or similar objects
hanging on the walls, which seems like a lot of effort if the user isnt planning on
painting immediately after using the program.
Suggestion: I think the efficiency of the app could be improved if the program offered a
fill tool and allowed the user to change the size and shape of brushes. The only brush
available is a circular shape, making it difficult to neatly paint corners and around
windows. A feature implementing Google street view would also using the program
faster and more efficient.
Specific Issue- Rounded Brush and No Indicator that a Fill Tool is Available.
Description- Painting around windows can be difficult. Though there is a fill tool,
there are no visual cues to indicate this feature (there isnt even a button). The fill
tool is also problematic for anything with a texture that will create shadows and
make filling large area time consuming.
Suggestion- Adding a button for the fill tool, such as the universally recognized
bucket of paint spilling that youll find in almost all paint programs. A tool that
allows the user to paint larger rectangular areas by dragging their finger to the
size rectangle they would like to paint.
Specific Issue- Inefficient Color Matching Tool.
21
Description- The Match It menu doesnt compare colors - it merely catalogues

them, which is somewhat misleading because the icon displays two pieces of
paper. The user may paint two catalogued colors on one wall, but theres no way
to display two separate pictures at the same time and match colors from one to
the other.
Suggestion- Allow the user to either see two images side by side to easily match
colors from one picture to another, or enable a swiping feature to switch back and
forth between pictures while keeping the same pallet.
Specific Issue- Image Tools only features one tool.
Description- The button on the main screen for Editing Tools. This is a
redundancy because the only tool in that section is a lighting adjustment tool.
Meanwhile clicking on the paint roller icon allows the user to adjust the
transparency (which seems somewhat useless, since you cant really adjust the
transparency of house paint).
Suggestion- Change the Editing Tools button to simply say Adjust Lighting.
Key Findings
Our goal was to evaluate Home Depots Project Color application as impartially
as possible. Most of us were completely new to this application and we came up with
the same basic flaws. The lack of visual cues and signifiers made it difficult for us as
new users to figure out what the program was and was not capable of. As Jonathan
pointed out, there is no Help feature built into the program. It is difficult to find, and
actually forces to user to leave the program, redirecting them to the Home Depot
22
website, which is not formatted for easy viewing on smartphones. This seems like a
glaring oversight, since the majority of the programs users will likely be using the
application on their smartphones.
While the key functions do work, the lack of visual cues and signifiers fail to direct
the user in an efficient and easy-to-use manner. One feature we thought would save the
user time would be the ability to purchase paint online and pick it up in the store at a
later time. Since the primary goal of this application is for Home Depot to sell paint, it
seemed like including a feature like this would be beneficial to both the user and Home
Depot.
There is a Take an App Tour feature, which is difficult to read, and only found
under the See It interface (normally something like this would be located on the main
interface- the menu the user sees when they first load the application). The Tour
consists of a four slides that do little to explain the features and functions (such as
loading and taking pictures to the program).
Though we think that the concept for the application is clever idea that has the
potential to make picking out and purchasing paint a less daunting and time-consuming
task, the flaws and lack of direction render it frustrating and time consuming for first time
users. Most basic Paint programs can perform the same functions available in Project
Color. Overall we agreed that the painting features come off more like an afterthought in
a program otherwise designed to lead people to their nearest Home Depot or their
website.
High Priority Issues
There is no dedicated back button to help navigate through menus. Users may have to
restart the application if they make a mistake.
There is no help screen built into the application. The external help website does not
necessarily have a zoom function, so users may not be able to read it depending on
their phone.
23
The application does not notify you of requirements and security settings that may need
to be altered up front. Users can be locked out of some features if they make a mistake.
When changing from live view to still photo the system locks up.
In general, there is a lack of directions or prompts to guide you through the application.
Medium Priority Issues

There is no visible indicator that there are two drawing modes.
Painting around windows can be difficult.
There is no way to display two separate pictures at the same time and match colors
from one to the other.
The icons do not remain consistent from screen to screen. The initial screen is clear
and easy to navigate, but this is not the same for all screens.
Low Priority Issues
Favorite colors arent a selectable option in the choose a color menu.
The menu for Editing Tools is redundant as it only contains one editing tool.
24
Conclusion
Through test performance of the app by novice users we will be able to
determine the core user ability flaws within the program. In order to better determine
what the issues are we will require each user to perform several styles of testing
depending on which program flaw we are targeting. For instance, users will be asked to
focus on navigation or the overall experience, while others will be asked to focus on
design. The focus of our testing will be to determine the program flaws and the most
efficient means of correction. We will record feedback from each user on their
expectations before the test and after the test for a well executed conclusion. By the
end of this study will be able to identify the usability flaws and the steps necessary to
correct them.
Section 2 - Moderator Script

Main Scenario #1 - Painting Indoors / Color Search Method
1. Take a photo of a wall indoors.
2. Find and select an attractive color.
25
3. Paint the desired area.

4. View the image in alternate lighting conditions.
5. Continue to checkout.
Main Scenario #2 - Painting Outdoors / Color Match Method
1.
2.
3.
4.
5.
6.
Take a photo of a nearby house to choose a color from.

Choose a color and add it to Favorites.
Take a photo of a wall outdoors.
Paint the wall in the second image with the favorite color.
View the image in alternative lighting conditions.
Continue to checkout.
Section 3 - Screening Questionnaires

The Screening Questionnaire
Are you male or female? Male.
26
What is your age? 67.
On a scale from 1 to 10 with 10 being the most proficient, where do define yourself in
technological proficiency? 5.
Are you currently renting or do you own property? Own.
Do you own a smartphone or tablet device? Yes.
If yes, how many apps have you downloaded in the past month? None.
Which device do you use most often to access the Internet? Desktop computer.
What type of apps do you use most often? Email and messaging.
What would you like to see in future apps? Better use of older hardware.
What would you like to change about current apps? More security. Easier to block unwanted
access.

Are you male or female? Male.
Are you currently renting or do you own property? Renting.
Do you own a smartphone or tablet device? Yes.
If yes, how many apps have you downloaded in the past month? 3.
Which device do you use most often to access the Internet? Smartphone.
What type of apps do you use most often? Instagram, text messaging, Bleacher Report, Email.
What would you like to see in future apps? Quicker response time.
What would you like to change about current apps? Unwanted crashing.
27
Are you male or female? Female.
Do you own a smartphone or tablet device? Smartphone.
If yes, how many apps have you downloaded in the past month? None.
Which device do you use most often to access the Internet? Computer.
What type of apps do you use most often? Games.
What would you like to see in future apps? Less internet unreliability.
What would you like to change about current apps? The need for internet connection.

Are you male or female? Female.
technological proficiency? Average proficiency.
Do you own a smartphone or tablet device? Both.
If yes, how many apps have you downloaded in the past month? 6.
Which device do you use most often to access the Internet? Smartphone.
What type of apps do you use most often? Social media.
What would you like to see in future apps? Easier to use.
What would you like to change about current apps? More compatibility across different devices.
28
Section 4 - Post-task Questionnaires

Post Task Questionnaire
1. Home Depots Project Color lived up to my expectations.
Strongly Disagree Slightly Disagree
Not Sure
Slightly Agree
Strongly Agree
x
2. Based on the tasks you performed using Home Depots Project Color, please rate how useful
you think it would be for someone picking out paint for their home:
Extremely Useful
Might save time.
Not Sure
Not useful
A waste of time
Sometimes
Occasionally
Always
Fairly Easy
Extremely Easy
x
3. I needed help completing my tasks:
Never
Rarely
x
4. Overall, finding specific colors using Project Color was:
Extremely Difficult
Slightly Difficult
Average
29
5. Completing all of the tasks I was asked took me:

Under 5 Minutes
Between 5 and
10 minutes.
Between 10 and
25 Minutes
Over 25
Minutes.
Was unable to
complete task.
6. The aspect I liked most about Home Depots Project Color was...linked photo to paint color.
Best part is ability to match a color to the photo and have it link to an actual paint color.
7. The aspect I disliked most about Home Depots Project Color wasWas not clear how it
worked. Symbols were not helpful. Navigation not intuitive. Cannot go back.
8. Please list any changes that you think would improve Home Depots Project Color:
1. The colors need more organization. Need more categories. Need colors to
correspond to color books or swatches. You cant just have 1000 green squares with no
organization and expect people to pick one.
2. Use standard navigation, similar to a browser. Provide an easy way to start over.
3. Fix opening screen. Not clear how to start. See it is not a good option.
4.
5.
9. Please use the space provided for any additional comments:
Not nearly good enough.

Strongly
Disagree
Slightly Disagree
Not Sure
Slightly Agree
x
Strongly Agree
30
2. Based on the tasks you performed using Home Depots Project Color, please rate how
useful you think it would be for someone picking out paint for their home:
Extremely Useful
Might save time.
Not Sure
Not useful
Sometimes
Occasionally
A waste of time
x
Never
Rarely
Always

Extremely
Difficult
Slightly Difficult
Average
Fairly Easy
Extremely Easy

Under 5 Minutes
Between 5 and
10 minutes.
Between 10 and
25 Minutes
Over 25
Minutes.
Was unable to
complete task.
x
6. The aspect I liked most about Home Depots Project Color was..I liked the Match It feature
so I can see what color something else is painted that I like.
7. The aspect I disliked most about Home Depots Project Color wasHow difficult it was to
navigate; you cannot go back to the main menu and where to purchase a color was unclear.
1. A simple way to start over or undo everything-not just the paint.
2. More instructions to start out with; See it and Match it are not specific enough.
3. Directions on how to paint-you needed to double tap the photo to paint and that was
not clear.
4.
31
5.
It is a good concept, but it has some kinks to work out.

Strongly Disagree
Slightly Disagree
Not Sure
Slightly Agree
Strongly Agree
x
2. Based on the tasks you performed using Home Depots Project Color, please rate how useful
you think it would be for someone picking out paint for their home:
Extremely Useful
Might save time.
Not Sure
Not useful
A waste of time
x
Never
Rarely
Sometimes
Occasionally
Always
x
Extremely Difficult
Slightly Difficult
Average
Fairly Easy
Extremely Easy
x
Under 5
Minutes
Between 5 and 10
minutes.
Between 10 and
25 Minutes
Over 25
Minutes.
Was unable to
complete task.
x
6. The aspect I liked most about Home Depots Project Color was... The color option and photo
smash.
7. The aspect I disliked most about Home Depots Project Color was The layout.
32
1. More detail.
2.
3.
4.
5.

N/A

Strongly
Disagree
Slightly Disagree
Not Sure
Slightly Agree
Strongly Agree
x
Extremely Useful
Might save time.
Not Sure
Not useful
A waste of time
x
Never
Rarely
Sometimes
Occasionally
Always
x
Extremely
Difficult
Slightly Difficult
Average
x
Fairly Easy
Extremely Easy
33
Under 5 Minutes Between 5 and

10 minutes.
Between 10 and
25 Minutes
Over 25
Minutes.
Was unable to
complete task.
x
6. The aspect I liked most about Home Depots Project Color was...It was kind of fun to play
around with.
7. The aspect I disliked most about Home Depots Project Color wasThe application did not
work.
1. Make it easier to use and easier to know what to do.
2. Make the brush easier to control.
3.Add a help menu or tutorial.
4.
5.
N/A
Section 5 - Post-test Questionnaires

Post Test Questionnaire
34
1. I think I would use Home Depots Project Color frequently when painting my house.
Strongly Disagree
1
Strongly Agree
5
2. I found Home Depots Project Color to be needlessly complicated.

Strongly Disagree
1
Strongly Agree
5
x
3. I thought Home Depots Project Color was user-friendly and easy to use.
Strongly Disagree
1
Strongly Agree
5
x
4. I think I would need the help of a Technical Support person or expert in order to use Home
Depots Project color effectively.
Strongly Disagree
1
Strongly Agree
5
x
5. I thought that the various functions in Home Depots Project Color were well-integrated (that
the functions and capabilities are coordinated well-enough to make functional whole).
Strongly Disagree
1
Strongly Agree
5
Strongly Agree
5
x
6. I thought Home Depots Project Color was inconsistent.
Strongly Disagree
1
3
x
7. I think average new users would have no trouble learning to use Home Depots Project Color
quickly and easily.
Strongly Disagree
Strongly Agree
35
8. I found Home Depots Project Color to be very clumsy and awkward to use.
Strongly Disagree
1
Strongly Agree
5
x
9. The user-interface was very intuitive and I felt very sure of myself while using Home Depots
Project Color.
Strongly Disagree
1
Strongly Agree
5
x
10. I needed to look for help and learn quite a bit before I was able to get started using Home
Depots Project Color.
Strongly Disagree
1
Strongly Agree
5

Strongly Disagree
1
Strongly Agree
5
x
Strongly Disagree
1
3
x
Strongly Agree
5
36
Strongly Disagree
1
Strongly Agree
5
x
Strongly Disagree
1
Strongly Agree
5
x
Strongly Disagree
1
Strongly Agree
5
Strongly Agree
5
x
Strongly Disagree
1
x
quickly and easily.
Strongly Disagree
1
Strongly Agree
5
x
Strongly Disagree
1
Strongly Agree
5
x
Project Color.
37
Strongly Disagree
1
Strongly Agree
5
x
Strongly Disagree
1
Strongly Agree
5

Strongly Disagree
1
Strongly Agree
5
x
Strongly Disagree
1
Strongly Agree
5
x
Strongly Disagree
1
Strongly Agree
5
38
Strongly Disagree
1
Strongly Agree
5
x
Strongly Disagree
1
Strongly Agree
5
x
Strongly Disagree
1
Strongly Agree
5
quickly and easily.
Strongly Disagree
1
Strongly Agree
5
x
Strongly Disagree
1
Strongly Agree
5
Project Color.
Strongly Disagree
1
3
x
Strongly Agree
5
39
Strongly Disagree
1
Strongly Agree
5
4
x

Strongly Disagree
1
Strongly Agree
5
x
Strongly Disagree
1
Strongly Agree
5
x
Strongly Disagree
1
Strongly Agree
5
x
Strongly Disagree
1
Strongly Agree
5
x
Strongly Disagree
1
3
x
Strongly Agree
5
40

Strongly Disagree
1
Strongly Agree
5
x
quickly and easily.
Strongly Disagree
1
Strongly Agree
5
x
Strongly Disagree
1
Strongly Agree
5
x
Project Color.
Strongly Disagree
1
Strongly Agree
5
x
Strongly Disagree
1
3
x
Section 6 - Personas
Strongly Agree
5
41
Sources:
We decided that the best way to develop a demographic for Project Color would be to read
customer reviews on iTunes (Apples app store) and Google Play (the primary app store for
most android phones). We also use a website called Market Realist (www.marketrealist.com) to
develop a profile for Home Depot customers in general, versus those who would go to a
competing store like Lowes or simply go to Walmart when planning to paint their house.
Personas:
Our first persona is someone younger, who is likely to be familiar with Smartphone technology
but is new to painting. Our second persona is an older person (55 years old), who may be
intimidated by new technology but is willing to try a new method of picking out colors if it will
make the task easier for her. As you can see by the attached documents, our user profiles sit on
opposite ends of the spectrum, with one potential user being new to painting but savvy with
technology, and the other being a homeowner who has experience with painting but not
technology.
Personas
Persona 1
Younger user / New to painting
Photo
Source: Freedigitalphotos.net
Fictional Name
John Doe
Demographics
25 years old
Engaged
0 children
Bachelors degree
Goals / Tasks
He is busy balancing work and wedding planning. He plans to pick out

colors for his new home quickly and efficiently.
42
His fiance tasked him with finding colors for both the bedroom and
living room. It is important to her that he coordinate the colors with the
furniture they have already purchased as well as making sure the
colors will flow with the layout of the rooms.
He and his wife will paint the rooms together.
Mindset /
Expectations of
Product
He learned about Home Depots Project Color app from a TV

commercial, and therefore expects it to work as shown there.
Since he is busy, theres not much time in his schedule to spend on
shopping for paint. He has never bought paint before, but he expects it
to be relatively simple. The commercial convinced him that it would be
easy if he used the app.
He requires explicit instructions to help him get started, but wants
them to be clear and concise. He expects to receive assistance from
the app with both picking out a paint color and the paint-buying
process.
He expects for there to be a few steps (as shown on the commercial),
but should be efficient and simple to learn.
His opinion of Home Depot is neither positive nor negative. If he
encounters too many problems, he may choose to buy paint from a
different home improvement store instead.
Environment
He is in a domestic environment, painting the interior of his new

home.
The lighting conditions in his new home are ideal. There is one large
window in the living room, and there are two small windows in the
bedroom.
He is comfortable with using the latest technologies, including
computers and touch screen smartphones. However, he cant use his
computer now. The computers in his workplace are reserved for
business use only, so he cannot use them.
His new home does not have an Internet connection yet, but he can
use his smartphones Internet functions near access points. This
means he cannot use the Internet while painting.
43
Persona 2
Older User / New to Technology
Photo
Source: Freedigitalphotos.net
Fictional Name
Sarah Brown
Demographics
55 years old
Married
3 children
2 grandchildren
Masters degree
Goals / Tasks
Tasks: Sarah is looking to perform the following tasks and has more
than enough time to do so because she is retired.
Selecting a color based on the homes on her street
Finding painters
Goals: Sarah would like to have the following completed at the end of
the process.
Finding a complimentary color to her neighbors homes
Having the home painted in the color selected, finding it
Mindset /
Expectations of
Product
Sarah is intimidated by the idea of choosing a paint color online as

she struggles with technology. Because the color is important, she is
willing to experiment with new methods of finding the perfect color.
Her mindset is challenged by the idea of technology and that it may be
untrustworthy. Sarah is determined to find a color at all costs and she
is motivated to do so and is willing to spend time and money. She is a
longtime Home Depot customer, and is willing to listen to employees
advice.
Environment
Sarah is retired and is looking to paint the exterior of her home to

compliment the neighborhood homes she lives near. Sarah will hire
someone else to paint once she decides on a color. She lives in a
modest home with all the modern conveniences including cable and
Internet. Because she is painting the exterior of her home, lighting will
44
not be an issue for the photos. Navigating the website will be

moderately difficult as she is a novice smartphone user. Her level of
success using the app will depend on her patience while using the
app.
Section 7 - Session Logs

Our group used several different means of communication throughout the semester.
Approximately 4 meetings took place via webcourses conferences, 4 via a text message
client on our cellphones, and 1 via teleconference. As of this writing, the text message
client contains 297 messages. Each meeting took approximately 30-90 minutes.
In sum, our sessions totalled 5 - 7 hours.
45
Section 8 - Test Plan

Group 3 Usability Test Plan
Goals And Test Objectives
Our goal for these test findings is simply to discover if our findings in the heuristics report were
accurate and all-inclusive. In other words, we want to know whether the issues we encountered
in our personal tests were a problem only because of something in our understanding or
background, or if there is a usability issue in the app that the majority of users will face while
navigating the features of the app. Specifically, our team is interested in finding out how users
respond to the lack of a help feature and how they cope with this fact among other things too.
Beyond confirming our previous findings, we hope that through this test plan we can learn more
about the problems different users will have while using the Home Depot color application; in
the end, we will have a firm understanding in the overall usability of the program.
46
Scope of Project / Number of Users / Length of Sessions

The scope of our project is on a smaller scale but we believe it will be highly effective. Through
the test we set up, we will discover if the user encounters the same problems that we did during
our personal testings. There will be 4 users total; this is to ensure that we receive enough data
to come to a complete and accurate conclusion. The length of the sessions could vary slightly
from user to user simply because some might have more difficulty navigating the app more than
others. We estimate that it will take a user about 5 minutes to complete the questionnaire. Our
team decided to make sure that answering the questions would not take very long so that we
would not have an issue convincing people to participate in our survey. We are confident that we
have set up tests that will yield successful results.
Project Color User Profile

The persona of John Doe was used to develop the test plan and the user profile. John is
described as:
25 years old
Engaged
0 children
Full time employee
Bachelors degree
Time is of the essence
Busy balancing work and planning a wedding
His fiance tasked him with finding colors for both the bedroom and living room
He is a first time homeowner
Based on the persona of John, we will be conducting our testing on participants who hold the
following characteristics:
Language: Must be able to speak and read English

Professional Status: Must be employed full time working 45 plus hours per week
Application Use: Either for business or for pleasure
Age: 20-35
Gender: Female and male
Ethnicity: Mixed / no specifications
47
Experience: Must not have any prior experience with the Project Color application
Usage: Must be familiar with a smart phone and use one at least 5 hours per week

Are you male or female?
What is your age?
technological proficiency?
Are you currently renting or do you own property?
Do you own a smartphone or tablet device?
If yes, how many apps have you downloaded in the past month?
Which device do you use most often to access the Internet?
What type of apps do you use most often?
What would you like to see in future apps?
What would you like to change about current apps?
48
Tasks / Scenarios
We want to test our concerns listed in the heuristic evaluation. The most inclusive and
condensed series of tasks and scenarios would be as follows:
Main Scenario #1 - Painting Indoors / Color Search Method - APPROXIMATE 10-20 MINUTES
Task
Context & Prerequisites
UI Flow
Issues tested
Task Scenario
Take a
photo of a
wall indoors.
User is provided a brief

overview of the app, its
purpose, and its
functions.
1. Start app on
phones menu
No internalized
help screen
2. Select yes to
allow access to
phones camera
data
Lack of directions
or prompts
John is tasked by his

fiancee to find a color for
a room in their new
house. Since he just
watched an
advertisement about
Project Color, he decides
to download it. There are
no explicit instructions in
the app itself, so he uses
his experience with apps
in general to construct a
mental map.
3. Select See It
Potential camera
data lockout /
security issues
4. Select Take
Photo
5. Aim camera
and click the white
circle to take a
photo.
2
Find and
select an
attractive
color.
After taking a photo, the

user is asked to select a
color that they want to
test on the wall. The
proctor should wait
before giving any hints
for how to navigate the
UI.
1. Click the plus

icon
2. Choose one of
the tabs. The app
defaults to
Paints, but the
user may
optionally choose
Stains or
Search
3. Locate and
select an
attractive color.
Potential or
perceived error
upon exiting live
view
John notices that there

are many colors to
choose from. He can pick
categorically, or he can
use the Search feature
to find a color he already
knows the name of.
49
Paint the
desired area
View the
image in
alternative
lighting
conditions
After selecting a color,

the user is brought to a
screen with no explicit
instructions on what to
do. We expect him/her to
vocalize questions.
1. Click on the
box containing the
desired color
Painting around
windows is
difficult
2. Touch the
screen to apply
color. Draw to
paint, and tap to
fill.
No indicator that
there are two
drawing modes
After painting the image,

the user might want to
see the color in alternate
lighting conditions. This
is an optional step.
1. Click on the
Editing Tools
button.
Redundancy in
menu options
John considers how his

rooms would look with
different lighting
conditions. The walls
might look different at
night or with different
types of lightbulbs. He
tests the filters available
to him.
No universal
back button
John doesnt like the first

color he chose, and
decides to look at a few
more to find the best
paint color.
2. Click on the
next button to
access lighting
options
John tries to paint the

image the same way
actors did in the
advertisement.
3. Manipulate the
slider to see three
lighting options
5
Repeat
steps 2-4 as
desired.
This step tests the users

ability to retrace his/her
steps and navigate the
applications UI. If the
applications UI flow has
problems, they are likely
to be detected at this
stage.
See above
Note: The back
button is either 1)
a click on the
same icon that
opened the menu,
or 2) a click
outside of the
active menu, or 3)
a click at the top
left corner of the
screen.
Inconsistent icons
/ Clarity issues
Note: The user

may remove paint
with the Erase
tool or clear the
image with the
Clear All tool. It
is also possible to
paint directly over
other colors.
Continue to
checkout.
After finding a suitable

color, the user must
figure out the name of
1. Click on the
Done button
located in the
Inconsistent icons
/ Clarity issues
John finds a really good

paint color and wants to
buy it. Before driving to
50
the paint somehow, or

buy it directly. There is
no explicit Buy button
in the main menu, so we
expect the user to
vocalize questions.
topmost toolbar
Home Depot, he
searches through the
application to see if he
can buy from there. It
would be best if he didnt
have to spend a lot of
time doing this.
2. Click on the
box containing the
desired color to
activate the link
for purchasing
3. Click on the link
for purchasing
Main Scenario #2 - Painting Outdoors / Color Match Method
Task
Context & Prerequisites
UI Flow
Issues tested
Task Scenario
Take a
photo of a
nearby
house to
choose a
color from.
User is provided a brief

overview of the app, its
purpose, and its
functions.
1. Start app on
phones menu
No internalized
help screen
2. Select yes to
allow access to
phones camera
data
Lack of directions
or prompts
John wants to paint his

house exterior so that it
matches with another
house in the
neighborhood. He learns
about Project Color from
a Home Depot employee,
so he decides to try it out.
3. Click Match It
4. Click Take
Photo
Potential camera
data lockout /
security issues
Interface for
matching colors
is clunky
5. Aim camera
and click the white
circle to take a
photo
2
Choose a
color and
add it to
Favorites.
After taking the photo,

the user is presented
with a static screen with
no explicit instructions
for what to do. The
Proctor should wait
before giving any hints.
1. Touch the
screen to make a
color swatch
appear
Potential or
perceived error
upon exiting live
view
2. Click on the
colored bar listing
the name and
code of the
desired color
Lack of directions
or prompts
John finds the house that

he wants to match, so he
attempts to capture a
color and learn its name.
If he doesnt know the
colors name or code, he
cannot buy it, so he uses
his intuition to figure out
the apps Match It
feature.
3. Click Add to
Favorites
3
Take a
After taking the first
1. Click See it
No universal
John has the color he
51
photo of a
wall
outdoors.
Paint the
wall in the
second
image with
the favorite
color
photo and saving a color,

the user needs to retrace
his/her steps to access
the See It screen.
Taking the second photo
should be easy once
inside the correct mode.
while in the same

menu from before
or from other
menus
After taking a second

photo, the user is can
access his/her color in
more than one way. If
the user restarts the
application from the
main menu, he/she will
need to find the favorite
color in a separate menu
from the preloaded
swatches.
1. If the favorite
color is available
at the bottom,
click on it. If the
favorite color not
not available
there, click the
Menu icon, then
Favorites. Click
on the color here
to make it show
up in the toolbar.
The screen for painting,

again, has no explicit
instructions. The user
may not use both
drawing modes.
View the
image in
alternative
lighting
conditions
After painting the image,

the user might want to
see the color in alternate
lighting conditions. This
is an optional step.
back button
Inconsistent icons
/ Clarity issues
2. Aim camera
and click the white
circle to take a
photo
Favorite colors
can be hard to
locate
wants to try. Next he

needs to take a picture of
his own wall so he can
apply the color to it.
Walking back, his phone
goes into sleep mode, so
depending on his phone
he may have to restart
the application from the
main menu to take the
second photo.
After taking the photo of
his wall, John tries to
locate the color he added
to Favorites earlier.
Painting around
windows is
difficult
No indicator that
there are two
drawing modes
2. Touch the
screen to apply
color. Draw to
paint, and tap to
fill.
1. Click on the
Editing Tools
button.
Redundancy in
menu options
John considers how his

wall would look in
different lighting
conditions. He tests the
filters available to him.
No universal
back button
John doesnt like the first

color he chose, and
decides to capture some
more colors from other
houses. He tries them
one by one, so over time
he has a lot to remember.
2. Click on the
next button to
access lighting
options
3. Manipulate the
slider to see three
lighting options
Repeat
steps 1-5 as
desired.
This step tests the users

ability to retrace his/her
steps and navigate the
applications UI. If the
applications UI flow has
problems, they are likely
to be detected at this
stage.
See above
Note: The back
button is either 1)
a click on the
same icon that
opened the menu,
or 2) a click
outside of the
Inconsistent icons
/ Clarity issues
52
active menu, or 3)
a click at the top
left corner of the
screen.
Note: The user
may remove paint
with the Erase
tool or clear the
image with the
Clear All tool. It
is also possible to
paint directly over
other colors.
7
Continue to
checkout.
After finding a suitable

color, the user must
figure out the name of
the paint somehow, or
buy it directly. There is
no explicit Buy button
in the main menu, so we
expect the user to
vocalize questions.
1. Click on the
Done button
located in the
topmost toolbar
Inconsistent icons
/ Clarity issues
2. Click on the
box containing the
desired color to
activate the link
for purchasing
John finds a really good

paint color and wants to
buy it. Before driving to
Home Depot, he
searches through the
application to see if he
can buy from there. It
would be best if he didnt
have to spend a lot of
time doing this.
3. Click on the link

for purchasing
Pre-test Questionnaire
How likely are you to consult an app for help with at home projects?
What are your expectations of the app based on the name of the app alone?
How often do you see yourself using the app in everyday life?
What has been the most frustrating part about apps in your past experience?
53
What are your goals going into the purchase of this app as a consumer?
What is the average amount of time you spend using apps in an average week?
Do you typically navigate apps and other online mediums without trouble?
How likely are you to recommend an app to a friend?
What makes an app successful based on your previous personal experience?

Strongly
Slightly Disagree
Not Sure
Slightly Agree
Strongly Agree
Disagree
Extremely Useful
Might save time.
Not Sure
Not useful
A waste of time
54
Never
Rarely
Sometimes
Occasionally
Always

Extremely
Slightly Difficult
Average
Fairly Easy
Extremely Easy
Difficult

Under 5 Minutes
Between 5 and
10 minutes.
Between 10 and
Over 25
Was unable to
25 Minutes
Minutes.
complete task.
6. The aspect I liked most about Home Depots Project Color was...
7. The aspect I disliked most about Home Depots Project Color was
The application did not work.
1.
2.
3.
4.
55
5.

____________________________________________________________________________
____________________________________________________________________________
____________________________________________________________________________
____________________________________________________________________________
____________________________________________________________________________

Strongly
Strongly
Disagree
Agree

Strongly
Strongly
Disagree
Agree
56
Strongly
Strongly
Disagree
Agree
Strongly
Strongly
Disagree
Agree
Strongly
Strongly
Disagree
Agree

Strongly
Strongly
Disagree
Agree
57
quickly and easily.
Strongly
Strongly
Disagree
Agree
Strongly
Strongly
Disagree
Agree
Project Color.
Strongly
Strongly
Disagree
Agree
Strongly
Strongly
Disagree
Agree
58
Consent and Release Form

Without expectation of compensation or other reparation, now or in the future, I hereby give my
consent to ENC 4230 Group 3, to conduct image and likeness and/or any interview statements
from me in its publications, advertising or other media activities (including the Internet). This
consent includes, but is not limited to:
(a) Permission to interview, film, photograph, tape, or otherwise make a video

reproduction of me and/or record my voice;
(b) Permission to use my name
(c) Permission to use quotes from the interview(s) (or excerpts of such quotes), the film,
photograph(s), tape(s) or reproduction(s) of me, and/or recording of my voice, in part or in
whole, in its publications, in newspapers, magazines and other print media, on television, radio
and electronic media (including the Internet), in theatrical media and/or in mailings for
educational and awareness.
By signing this form I am giving up any rights to the video recording and/or publications and
understand that they may be used for purposes listed on this release form. My signature is also
acknowledging that I have completely read and fully understand the above release and agree to
be bound.
59
Full Printed Name: ___________________________________

Street Address: ______________________________________
City/State/Zip Code: ___________________________________
Phone Number: __________________
Email Address: ___________________
Signature: _________________________________ Date: ____________
Project Timeline
Task
Date Completed
60
Complete Final Project Test Plan
10/18/15
Formal Conference
Find 4 volunteers who pass pre-test
10/26/15
screening. Make plans to test with them.

Formal Conference
Administer / Proctor Tests and produce the
11/16/15
following deliverables:
Screening questionnaire
Pre-test questionnaire
Post-task questionnaire
Post-test questionnaire
Audio of volunteers think-aloud process
Formal Conference
Formal Conference
Complete all sections of first draft of Final
11/23/15
Project Report
Formal Conference
11/30/15
Compile first draft of Final Project Report

Complete first draft of Presentation of
11/30/15
Usability Test Results

Formal Conference
11/27/15
Complete final draft of Final Project Test
12/5/15
Report
Formal Conference
12/4/15
Complete final draft of Presentation of
12/5/15
Usability Test Results

Submit Final Project Test Report
Submit Presentation of Usability Test Results
12/6/15
61
Responsibilities of Team Members Checklist

Name
Responsibility
Due Date
Cassidy Craig
Proctor the test for one volunteer.
11/16/15
Deliverables are as follows:

Contribute 4 report elements to the Final
11/23/15
Project Test Report. This members report

elements are as follows:
Cover
Description of test plan and procedures
Recommendations for short-term and longterm improvements
Prepare all 4 Screening Questionnaires for
Appendices
Submit Final Project Test Report
12/6/15
Sabrina Dali-
Prepare first draft of Presentation of
11/30/15
Mendoza
Usability Test Results. Length is

approximately 10-12 PowerPoint Slides.
11/2315

Title page
Description of users
Conclusion noting the need for further
testing / Urge to action
Prepare all 4 Post-task and all 4 Post-test
Questionnaires for Appendixes
Submit Presentation of Usability Test
Results
12/6/15
Checklist
62
Jessica Klayman
11/16/15

11/23/15

Table of Contents
Description of scenarios
Prepare Heuristic Evaluation for
Appendices
Prepare Moderator Script for Appendixes
Jonathan Neal
Serve as Copy Editor for PowerPoint
11/23/15 -
Presentation
12/5/15
11/16/15

11/23/15

Executive summary
Top findings with examples and severity
codes
Prepare Personas for Appendices
Prepare Logs from Sessions for
Appendices
Manage communications and compile first
draft of Final Project Test Report
11/20/15
63
Francis Salatino
11/16/15

11/23/15

Introduction
Analysis from the post-task and post-test
questionnaires
Prepare Test Plan for Appendices
Prepare miscellaneous test session
material for Appendices
Serve as Copy Editor for Final Project Test
11/20/15 -
Report
12/1/15
Plan for Recording and Uploading the Test

With the affordability of Smartphones they are now ubiquitous. Even the most basic
Smartphones are now being manufactured with cameras capable of recording video and audio.
In lieu of going out and purchasing expensive standalone recording equipment, we reasoned
that the most affordable option for recording the testing process.
Since the test will encourage the users to think out loud the verbal reactions are just as
important as physical ones. There are a number of audio editing programs, with one of the more
64
popular ones being Audacity. Audacity is a free-source audio editing program that we can use
to adjust the volume of the audio and reduce noise to optimise the clarity of the users verbal
reactions while using Project Color.
Section 9 - Miscellaneous
How likely are you to consult an app for help with at home projects? Phone never, computer
often.
What are your expectations of the app based on the name of the app alone? Helps me pick a
paint color from Home Depot.
How often do you see yourself using the app in everyday life? A few times a year.
65
What has been the most frustrating part about apps in your past experience? Input is difficult on
a phone. No standard. Small screen.
What are your goals going into the purchase of this app as a consumer? The app has to be
free. Its a way for Home Depot to sell me something.
What is the average amount of time you spend using apps in an average week? Approx. 1 hour
per week. Would use it more if it functioned better.
Do you typically navigate apps and other online mediums without trouble? Takes a while to
learn at first, then no problem.
How likely are you to recommend an app to a friend? Very likely if its good, not likely if bad.
What makes an app successful based on your previous personal experience? It works. Doesnt
crash.


66
be bound.
Street Address: 1151 Western Way
City/State/Zip Code: Orlando, FL 32804
Phone Number: 407-247-1732
Email Address: andywork@gmail.com
Electronic Signature: Andy Neal
Date: 11/11/15
How likely are you to consult an app for help with at home projects? Likely on phone.
What are your expectations of the app based on the name of the app alone? It will help me
choose a color.
How often do you see yourself using the app in everyday life? Once or twice a year.
What has been the most frustrating part about apps in your past experience? Difficult to
navigate.
What are your goals going into the purchase of this app as a consumer? Quick and easy color
selection.
What is the average amount of time you spend using apps in an average week? 6-7 hours per
week.
Do you typically navigate apps and other online mediums without trouble? Yes.
How likely are you to recommend an app to a friend? Likely, if it works well.
What makes an app successful based on your previous personal experience? Easy to use,
simple design that works well.
67


be bound.
Street Address: 9263 Lake Lotta Cir
City/State/Zip Code: Gotha, Florida 34734
Email Address: Tedjacobwatson@gmail.com
Electronic Signature: Tj Watson
Date: 11/14/15
68
How likely are you to consult an app for help with at home projects? Somewhat likely.
What are your expectations of the app based on the name of the app alone? I expect it has
something to do with projects and color.
How often do you see yourself using the app in everyday life? Not often.
What has been the most frustrating part about apps in your past experience? You cant use
them easily.
What are your goals going into the purchase of this app as a consumer? That its going to be
helpful.
What is the average amount of time you spend using apps in an average week? Less than an
hour.
Do you typically navigate apps and other online mediums without trouble? Sometimes.
How likely are you to recommend an app to a friend? Somewhat likely.
What makes an app successful based on your previous personal experience? If I can use it.

69
be bound.
Full Printed Name: Katie Grace Sanders
Street Address: 140 Ruby Street
City/State/Zip Code: Rockledge, Florida 32955
Email Address: KatieSanders137@aol.com
Electronic Signature: Katie Sanders
Date: 11/15/15
How likely are you to consult an app for help with at home projects? Somewhat likely.
What are your expectations of the app based on the name of the app alone? That it should give
a basic idea of what different colors of paint you can buy at their store would look in your own
house.
How often do you see yourself using the app in everyday life? Not very likely.
What has been the most frustrating part about apps in your past experience?
Advertisements/Freemium programs.
What are your goals going into the purchase of this app as a consumer? N/A
What is the average amount of time you spend using apps in an average week? 7-8.
Do you typically navigate apps and other online mediums without trouble? Yes.
How likely are you to recommend an app to a friend? It depends on if its useful to that friend or
not.
70
What makes an app successful based on your previous personal experience? Being easy for
the average person to use, and make performing a task easier and faster, not more
complicated.


(c) Permission to use quotes from the interview(s) (or excerpts of such quotes),
the film, photograph(s), tape(s) or reproduction(s) of me, and/or recording of my voice, in part or
in whole, in its publications, in newspapers, magazines and other print media, on television,
radio and electronic media (including the Internet), in theatrical media and/or in mailings for
be bound.
71
Street Address: 7980 S. Great Oaks Dr
City/State/Zip Code: Floral City, Florida 34436
Email Address: KellySalatino1@gmail.com
Electronic Signature: Kelly Salatino
Date: 11/17/15

Usability Test Report For Home Depot Project Color

Enviado por

Dados do documento

Título original

Direitos autorais

Formatos disponíveis

Compartilhar este documento

Compartilhar ou incorporar documento

Opções de compartilhamento

Você considera este documento útil?

Este conteúdo é inapropriado?

Direitos autorais:

Formatos disponíveis

Usability Test Report For Home Depot Project Color

Enviado por

Direitos autorais:

Formatos disponíveis

1

Final Project Test Report:

Conducted by Group 3: Cassidy Craig, Sabrina Dali-Mendoza,

Back to Table of Contents

Usability Test Plan for

Dr. Jane Moody, Professor ENC 4290

December 06, 2015

Back to Table of Contents

Back to Table of Contents

Back to Table of Contents

TEST PLAN AND PROCEDURES

Back to Table of Contents

Back to Table of Contents

Back to Table of Contents

TOP FINDINGS AND SEVERITY CODES

TOP FINDINGS - HIGH PRIORITY

TOP FINDINGS - MEDIUM PRIORITY

Back to Table of Contents

TOP FINDINGS - LOW PRIORITY

ANALYSIS FROM QUESTIONNAIRES

Back to Table of Contents

Back to Table of Contents

Section 1 - Heuristic Evaluation

Back to Table of Contents

Heuristic Evaluation Findings

Back to Table of Contents

Specific Issue- No dedicated back button.

Quesenbery E used: Error tolerant.

Back to Table of Contents

Specific Issue- Insufficient information about security settings.

Suggestion- Once the application is installed it would be helpful for there to be a

Specific Issue- Live View is prone to errors.

Quesenbery E used: Effective.

Specific Issue- Insufficient feedback.

Back to Table of Contents

Quesenbery E used: Easy to learn.

Suggestion: The fundamental idea is to make

Back to Table of Contents

Specific Issue- No indicator of drawing modes.

Suggestion- According to Nielsons 10 heuristics, Instructions for use of the

Specific Issue- Text can be too small in external help screen.

Description- In the help screen (a webpage meant to supplement the application),

Quesenbery E used: Efficient.

Back to Table of Contents

Specific Issue- Inefficient Color Matching Tool.

Back to Table of Contents

Description- The Match It menu doesnt compare colors - it merely catalogues

Specific Issue- Image Tools only features one tool.

Back to Table of Contents

High Priority Issues

Medium Priority Issues

Painting around windows can be difficult.

Low Priority Issues

Favorite colors arent a selectable option in the choose a color menu.

Back to Table of Contents

Section 2 - Moderator Script

Back to Table of Contents

3. Paint the desired area.

Take a photo of a nearby house to choose a color from.

Section 3 - Screening Questionnaires

Back to Table of Contents

The Screening Questionnaire

Back to Table of Contents