Testing the Testing

In this weeks lecture we looked at how to create effective testing sessions and ensure that we ask effective questions which will provide useful feedback. By evaluating our previous user testing questions from our video prototype.

From the initial look at my questions, I do not think I feel into any of the major traps (although some questions could be a little more specific) but there are still some areas for improvement. Some questions could have been reworded while others were qualitative where being quantitative may have been a better option. Each question is explored in detail below.

Q1: The Game inspirations were easily identifiable

Likert Scale from Strongly Disagree to Strongly Agree. This question was qualitative in nature looking to see if users remembered the two games mentioned in the video. This could have been re-phrased and been done with checkboxes instead to make this into a more quantitative measure. Showing that users got the 2 inspirations would have been more valuable than their perception of how hard it was to identify them. Even if they agreed they were easy to identify this question does not capture if they identified them correctly.

Q2: The purpose of the game was difficult to understand

Likert Scale from Strongly Disagree to Strongly Agree. While this question is also qualitative it may have been more effective as a quantitative measure. Also purpose could have been rephrased as goal, as some users may not see a purpose to games, where as the goal or objective of the game may have been more applicable. 

Q3: The game controls were clearly explained

Likert Scale from Strongly Disagree to Strongly Agree. Another qualitative question. The control system contains multiple elements it may have been better to separate this question into smaller parts (I guess maybe somewhat compound) 

Q4: The controls provide an interesting method of interaction

Likert Scale from Strongly Disagree to Strongly Agree. Another qualitative question. Need to rephrase interesting if looking to specifically test for uniqueness of interaction. Different users may find different systems interesting.

Q5: How would you improve this game?

Open Text answer field question, capturing qualitative information. While the question could be a little bit more specific, from looking at the feedback it is clear that this questions needed a better outline on how to answer it.

Q6: The Video footage was poorly produced

Likert Scale from Strongly Disagree to Strongly Agree. Another qualitative question. Could be a littlle bit more specific, or alternatively follow up with a open text question if they disagreed.

Q7: The Video sound was clear and understandable

Likert Scale from Strongly Disagree to Strongly Agree. Another qualitative question. COMPOUND, need to be over two different questions.

Q8: How would you improve this Video Prototype?

Open Text answer field question, capturing qualitative information. Again more indication could have been given on how the questions was to be answered. E.g write a short sentence indicating how would you improve....

Q9: The Testing method was well explained

Likert Scale from Strongly Disagree to Strongly Agree. Another qualitative question. What the testing method was could have been better explained in this question. So that users better understood which aspect was being critiqued.

Q10: The Survey was too short

Likert Scale from Strongly Disagree to Strongly Agree. Another qualitative question. Could have been quantitative with a simple yes or no answer.