The actual last post

Testing Session Observations and Qualitative Feedback

Looking at the users answers to survey question 5: Please finish this sentence, I accidentally turned the dial the wrong way when...

It is clear that users are running into this problem when the first begin opening a lock rather than when they have to change directions during the unlocking process. One user also remarked that most traditional locks will turn clockwise first where as the digital prototype turns anti-clockwise to begin. Again this could be another area for improvement in the future when experimenting with different control schemes.

Feedback from survey question again suffered from the ambiguity of 'visual feedback' without specifying either the turn indicator or the password progress system. Regardless users thoughts on the entirety of the right panel were largely encouraging. Indicating that the confirmation of password points was essential and am important supplement to the audio system. Users also pointed out that the arrow was not helpful initially as they were unaware it responded to the arrow key they needed to press. Suggestions for a call to action or tutorial system were again made and this will look to be implemented in future prototypes.

Observations

Based on my observations of the testers, on average most users opened two locks. One when they were completing their assigned task of testing the reset function and once afterwards when they had time to play before moving on. After the open of the initial lock using the reset method, most users were able to open the second lock in under 30 seconds.

It was also clear from observations that as users became more comfortable with the control system they moved from a simple tap system of pushing the key in once to the holding method to make the lock dial rotate more quickly. One user even discovered that she could open a lock simply by spinning in one direction to the correct number, resetting, hitting that point and then changing direction. Using this method they were able to open locks very easily and quickly, however, this was unintentional and may need to changed slightly to ensure users are skill relying on precision rather than brute force to open locks.

Finally most users interacted with the reset button six times or more as they ran through the initial task and the opening of additional locks. It seems clear from this testing session that the stability changes made to the code were successful and both the reset and new lock buttons are functioning correctly.