Usability Test Report for [Product Name] Date of Report: Date of Test: Location of Test:
January 23, 2016 January 3, 2016 Naples, Florida
Prepared for: Phone Number: Email:
James Robbins (248) 334-1329 jmrobbins@comcast.net
Prepared by: Phone Number: Email:
Elizabeth Robbins (248) 339-6578 robbiner@miamioh.edu
Source: Usability.gov
1
Table of Contents Executive Summary ..................................................................................................................................... 3 Methodology ................................................................................................................................................ 3 What happened during the usability test .................................................................................................. 3 Who we tested ......................................................................................................................................... 3 What participants did ................................................................................................................................ 5 What data we collected ............................................................................................................................ 5 Where we tested ...................................................................................... Error! Bookmark not defined. Introductory Questions & Tasks ................................................................................................................... 6 Findings & Recommendations ..................................................................... Error! Bookmark not defined. Home Page Issues ................................................................................................................................ 7 Finding [#1]: .................................................................................... Error! Bookmark not defined. Scenario #1 ........................................................................................................................................... 8 Finding [#1]: .................................................................................................................................... 8 Exit Questions/User Impressions ............................................................................................................... 11 Appendices ................................................................................................................................................ 12
Source: Usability.gov
2
Executive Summary Overall, the users had a positive experience navigating the site. This was due to organization and accessibility. The users appreciated the aesthetic appeal that the site offered as well as the simplicity of the design. At the end of their time navigating the site, I believe that the users were much more interested in purchasing a pair of jeans from the Mugsy Jeans Company. While the majority of the user experience was positive, there were a few parts of the site that became frustrating to the users. The users frustrating lied in the process of purchasing the product and finding the correct size. On the website, it states that all of the lengths are the same for every single pair of jeans. This information is helpful, but it is not in the correct place. The users were able to complete each task in a reasonable amount of time. In the first task, the users were pleased to complete it very quickly and without any problems. The next two tasks did not present themselves to be quite as simple. The users found it hard to find the place on the site that they would look to for inspiration for their future clothing habits. Also, as stated above, the length of the jeans also presented itself as an issue for the users. Methodology What happened during the usability test The usability evaluation of the Mugsy Jeans website was conducted by Elizabeth Robbins in Naples, FL on January 3, 2016. During the usability evaluation, four participants, matching the user profile(s), were asked to spend approximately twenty minutes with the site. During this hour, participants: ! ! !
Answered questions about initial site impressions Performed real-world tasks on the site while thinking aloud Answered questions about their overall satisfaction
Who we tested Four participants, having the following profile characteristics, evaluated the Mugsy Jeans website. Because the website is tailored to a male audience, only men where chosen to participate. NOTE: Add or delete main categories as needed. Refer to screener for main demographic information. Audience Type
Computer Usage
Doctor
1
0 to 10 hrs. wk.
0
Student Business Man
2 1
11 to 25 hrs. wk. 26+ hrs. wk.
1 3
TOTAL (participants)
4
TOTAL (participants)
4
Source: Usability.gov
3
Age
Gender
18-25
2
Women
0
26-39 40-59
1 1
Men
4
TOTAL (participants)
4
TOTAL (participants)
4
Participants, matching the Mugsy Jeans website user profile, were recruited prior to testing with the assistance of a market research firm.
Source: Usability.gov
4
What participants did During the usability evaluation, participants were asked to complete three scenarios or “real-life” tasks on the site. The tasks were presented in chronological order and participants were never told the search bar wasn’t an option. The following tasks were identified from user data collection efforts and assistance from Elizabeth. # Task 1 You’ve heard that Mugsy jeans are worth buying and that you should check them
2 3
out. You want to learn about the company and its founders. Let me watch what you would do. You want to get some ideas for clothes and accessories you can wear with your jeans. Let me watch what you do. Your friend’s birthday coming up and you would like to buy him a pair of Mugsy Jeans and have them delivered to his house. He is a size 33W 32L. Let me watch what you would do.
What data we collected NOTE: This section should describe: Performance • Task 1: Learn about Mugsy Jeans and their founders. o 4/4 of the users completed this task without assistance. o Time taken to complete task: ! All users completed this task in under 10 seconds •
Task 2: Get ideas for clothes and accessories. o 2/4 of the users completed this task without assistance by clicking on the blog tab and also seeing the link to the company’s Instagram account on the bottom of the page. o 2/4 of the users needed assistance in completing this task. o Time taken to complete task: ! 2/4 users completed task in under 45 seconds ! 2/4 users needed at least 2 minutes to complete the task
!
Task 3: Purchase the product. • 4/4 of the users completed this task without assistance (the only assistance needed was the restatement of the length of the pants)
Preference ! 4/4 of the users loved the visual appeal of the website. ! 4/4 users said they would purchase the product after visiting the website.
Source: Usability.gov
5
Introductory Questions & Tasks At the beginning of each session, we asked participants nine questions, including: Background Information Questions: 1. How often do you wear jeans? 2. What is your profession? Do you wear jeans for your profession? 3. Do you wear jeans when you go to a nice restaurant? 4. Where do you buy your jeans? 5. Do you buy jeans online, If no, would you consider buying jeans online? Initial Impression: • What is your initial impression of the website? • What is the purpose of the site? • What can you do on this site? • Talk about the home page design.
Prior to the test, only one of the users had visited the site. This ensured accurate results because it showed a mix of mostly people who had not ever been to the site with one who did. The people who had not been to the site were more helpful because they were not originally familiar with the site’s functionality. In general, all users had a positive initial reaction to the site’s homepage and the aesthetic appeal and simplicity. Because the site included tabs at the top of the page without a lot of sub tabs, the users thought the site looked easy to navigate. All users were able to explain what the site was meant to be used for without further exploring it.
Source: Usability.gov
6
Home Page Issues
Participants were happy to see a rotating image of the product being used in day-today life.
Figure 1
Supporting Evidence
Recommendations/Comments
While many users found the simplicity of the site refreshing and attractive, they do however believe that as the company continues to grow, the website should do the same.
“Continue to add information and products.�
Source: Usability.gov
7
Scenario #1 Scenario [#1]
Find out more about the company. Number of participants % successful
Usability Finding [#1]:
4 4
The participants were able to easily find the page where they can find out more about the story behind the founding and idea of the company.
Participants performed better and preferred a plain background to a busy background.
Supporting Evidence “Why are you having me do this?” “That was so easy! It says “Our Story” right there!”
Source: Usability.gov
8
Recommendations/comments They should include more information about the founder.
Navigation, Links, and Terminology Finding [#1]: Overall the site is easy to navigate.
Supporting Evidence “I like how the navigation bar is simple.”
Recommendations/Comments
“The social media pages aren’t that easy to find.”
Add a tab at the top that includes links to the social media accounts when users click on it.
“The color scheme is very simple. It makes things easy to read.” “The terminology is funny and geared toward the audience, but sometimes a little inappropriate.”
Although it is the whole feeling created by the founders for the company, the language might be able to be cleaned up a little.
Finding [#2]: It is not showcased to the users clearly enough that the size of the jeans are all the same for every pair.
Supporting Evidence “I cannot find my length.”
Recommendations/Comments Add the length to each size option when they are picking their size at checkout. Even if it is redundant.
“They don’t have my length, I would need to
Source: Usability.gov
9
pay an additional cost to get them hemmed!�
Source: Usability.gov
10
Exit Questions/User Impressions At the end of each session, we asked participants three questions: ! ! !
What was your overall impression of the site? Was there any specific page that you think might need improvement? What material on this Web site is most relevant to your needs?
This final usability analysis was not easy due to the overall positive feedback from all of the participants. One of the participants did not think that there was much product that could be bought. They thought the site was simple but overall could have more effects to make it more aesthetically pleasing. This user would also like to see more pictures. Another user agreed and added that specific information should be easier to find. All of the users thought that the site was “cool looking.� Overall the users believed that they site conveyed a personality for the jeans. This company does not take themselves too seriously. Users stated that after using this site they will probably purchase a pair of Mugsy Jeans!
Source: Usability.gov
11
Appendices
Source: Usability.gov
12
Source: Usability.gov
13
The$Documentation$
Home Interactive Elements: Photo Slideshow - Automatic every 10 seconds, works on click (slide right)
OnPageLoad: Case 1 (If text on Unidentified equals "Mugsy Jeans"):
1.1.1. User Interface
1.1.2. Widget Table Footnote Interactions 1
OnClick: Case 1 (If text on This equals "Home"): Case 2 (Else If True): Open Home in Current Window
2
OnClick: Case 1: Open Shop in Current Window
3
OnClick: Case 1: Open Our Story in Current Window
Note
Page$1$
The$Documentation$ Footnote Interactions 4
Note
OnClick: Case 1: Open The Blog in Current Window
5
Link to Shopping Cart
6
Link to FAQ
1.1.3. Unnamed 1.1.3.1. State1
1.1.3.2. State2
1.1.3.3. State3
Page$2$
The$Documentation$ The Blog Interactive Elements: Picture in each shape background Click on each picture to link to blog post
Rotating to feature all of the blogs - automatic
1.1.4. User Interface
1.1.5. Widget Table Footnote Interactions 1
OnClick: Case 1 (If text on This equals "Home"): Case 2 (Else If True): Open Home in Current Window
2
OnClick: Case 1: Open Shop in Current Window
3
OnClick: Case 1: Open Our Story in Current Window
4
OnClick: Case 1: Open The Blog in Current Window
Note
5
links to blog post
6
links to blog post
7
links to blog post
Page$3$
The$Documentation$ Footnote Interactions
Note
8
links to blog post
Page$4$