We have conducted usability testing on five unique users who are currently students at ASU. The user test consisted of four phases.

 

Phase 1: Introduction

We introduced the project and had a small walkthrough of the usability testing. After this, we asked for the user's consent to record the answers and testing for future reference.

 

Phase 2: Pre-test Questionnaire

We conducted a pre-test questionnaire to obtain some brief demographic data on the users as well as some questions pertaining to the maps and ASU maps interface. Below is the questionnaire.

1. What is your name?

2. What is your age?

3. What is relationship status?

4. How comfortable are you with using technology? (1 being not comfortable and 5 being comfortable)

5. How proficient are you in reading maps? (1 being novice and 5 being proficient)

6. Have you used the ASU campus maps and shuttle service before?

7. How often do you use the maps?

8. What was your first impression of the interface? 

​

Phase 3: Usability Testing

User Scenario 1:  You have to attend an interview for an ASU on-campus job.

Task: Find the location of Durham Hall and Engrained cafe using the My ASU app.

 

User Scenario 2:  You have an event scheduled on the west campus.

Task: Check the next shuttle bus that is available in the My ASU app.

 

Phase 4: User Interview and Post-test Questionnaire

Post the user testing we conducted a user interview in the form of a post-test questionnaire. Below is the list of post-test questionnaires.

1. What was your overall impression of the experience?

2. What, if anything, surprised you about the experience?

3. What problems did you face while completing your tasks? 

4. Which task was the most challenging/frustrating? Why? 

5. What did you dislike about the website?

6. What did you like about the website? 

7. If you could change anything about it, what would you change?

8. Is there anything we didn’t ask you about this experience that we should have?

9. What final comments do you want to make before ending this interview?

 

After this, we concluded the testing and thanked them for their time.

 

Analysis of the usability testing:

• 3 out of 5 users were proficient in reading maps.

• 5 out of 5 participants were well-versed in technology.

• All the participants found the interface to be boring and hard to understand.

• 4 out of 5 participants found it hard to navigate the maps.

• 5 out of 5 participants took help to finish the task.

• 5 out of 5 participants found it hard to interpret the maps at first glance.

• 5 out of 5 participants were frustrated while performing the task.

• 2 out of 5 participants ended the task midway.

• Most of the participants stated that the most difficult part was navigating themselves as per the map's directions.

• 5 out of 5 participants complained about not showing the real-time on the map.

• All participants found it hard to enter the “To and Fro” information on the map.

• They weren’t able to navigate their current location on the maps.

• 3 out of 5 participants were able to access the shuttles’ locations.

• 4 out of 5 participants weren’t able to understand the map's indication for the live locations of the bus.

 

All the participants stated that user scenario 2 was easier than user scenario 1.

​

​Usability Testing Pictures and Videos: User_Data Collection