Labs/Ubiquity/Usability/Usability Testing/How To: Difference between revisions

m
Line 23: Line 23:
(1 test with 1-2 participants ''total'')  
(1 test with 1-2 participants ''total'')  


Alpha tests evaluate the usability of a test, the technical feasibility of testing the product, and give evidence of the worthiness of potential test data. Spend a bare minimum of time and effort making this test. However, test on actual likely participants.
Alpha tests evaluate:
* the usability of a test
* the technical feasibility of testing the product
* and generate evidence of the worthiness of potential test data.


 
'''Spend a bare minimum of time and effort''' making and producing alpha tests. However, test on actual likely participants.  Instead of producing a single basic video, a HTML page, and testing a considerable amount of time was spent on the following example materials, researching this topic, along with full blown mockups, 3 videos, team meetings, getting permission, etc.
A considerable amount of time was spent researching this topic, along with full blown mockups, 3 videos, team meetings, etc.


[[Image:Landing-Page-Mockup.png|thumb|640px|]]
[[Image:Landing-Page-Mockup.png|thumb|640px|]]
Line 32: Line 34:
<video type="vimeo" id="2901416" width="437" height="315" desc="1x Video [http://www.vimeo.com/album/58499 Orignal Videos]" frame="true" position="center"/>
<video type="vimeo" id="2901416" width="437" height="315" desc="1x Video [http://www.vimeo.com/album/58499 Orignal Videos]" frame="true" position="center"/>


There is a problem in our first test above, what is it? The devilish part is that the more familiar one is with the software involved the harder the problem is to see. Two other programmers, four usability researchers, the project mailing list, and blog readers all failed to see that a video object steals keyboard focus from the browser and interprets the hotkey for Ubiquity (option and spacebar) as pressing the shortcut for pausing the movie. Beyond saving time, imagine having your manager, professor, or client fail this test during your proposal meeting.
There is a problem in our first test above, what is it?
 
The devilish part is that the more familiar one is with the software involved the harder the problem is to see. Two other programmers, four usability researchers, the project mailing list, and blog readers all failed to see that a video object steals keyboard focus from the browser and intercepts the Ubiquity hotkey (option and spacebar) and interpret it as pressing spacebar for pausing the movie.


This problem nuked the study for about 6 months.
This problem nuked the study for about 6 months.  Beyond saving time, imagine having your manager, professor, or client fail this test during your proposal meeting.
An alpha study with likely participants would have avoided all of this.


=== Beta Phase ===
=== Beta Phase ===
501

edits