Labs/Ubiquity/Usability/Usability Testing/Fall 08 1.2 Tests/Tester 09: Difference between revisions

From MozillaWiki
Jump to navigation Jump to search
mNo edit summary
mNo edit summary
 
(12 intermediate revisions by the same user not shown)
Line 1: Line 1:
Characterize session, important highlights.
The original, high quality version is under the [http://creativecommons.org/licenses/publicdomain/ public domain] At the [http://www.archive.org/details/Ubiquity_Fall_2008_Usability_Tests-Tester_09 Internet Archive]. For originals without the web-cam video feed please contact zachlym@indolering.com.
 
A busy tester who shuffled out early, without taking the post-test.    Being a rare Ubuntu user, so I was thankful to be able to catch him.
 
He never figured out how to invoke Ubiquity despite being an advanced user and trying for over 20 minutes.


Special Note, unfortunately this tester would only agree to the development team having access to the video.  It is unavailable under any Copyleft license.  To view it please email zachlym@indolering.com.
== Video ==
== Video ==
* Please experiment <-intentionally vauge : )
* Tag the first time testers are able to invoke Ubiquity by the tag Invokes Ubiquity i.e. ''"Invokes Ubiquity"''
* Tag every successful command attempt with the command name followed by a command sign i.e. ''email+''
* Tag every unsuccessful command attempt with the command name followed by a plus sign i.e. ''email-''
* Please tag and comment on this video.
* Tags should be NPOV, without suggestions for how to fix them.
* Tags are for events; if it sounds like a newspaper headline or a bug name it's a tag.
* For two or more words in a tag use quotes. ''i.e. "Tag with more than one word"''
<video type="viddler" id="a8735477" width="437" height="315" desc="1x Video [http://www.viddler.com/player/a8735477/ Full screen hack]" frame="true" position="center"/>
<video type="viddler" id="a8735477" width="437" height="315" desc="1x Video [http://www.viddler.com/player/a8735477/ Full screen hack]" frame="true" position="center"/>
<video type="viddler" id="76ff13e6" width="640" height="442" desc="2x Video [http://www.viddler.com/player/76ff13e6/ Full screen hack]" frame="true" position="center"/>
<video type="viddler" id="76ff13e6" width="640" height="442" desc="2x Video [http://www.viddler.com/player/76ff13e6/ Full screen hack]" frame="true" position="center"/>
This following sessions/categories are only suggestions, '''please''' add your own, alter, or ignore them.
 
== Tags ==


=== Discovery ===
=== Discovery ===
* Tag (00:00)
* Tunes out of video (4:14)
 
* Watches Video (0:45)
* leading (11:58)
* Email Shortcut: E (12:04)
* Tries right click (12:16)
* Never invokes Ubiquity (12:32)
==== Qualitative Summary ====
==== Qualitative Summary ====
''Summary''
Unable to figure out how to launch Ubiquity despite being an advanced user with some programming skills.  Tries using E as a shortcut, tries right clicking after reading in documentation.


=== Learnability ===
=== Learnability ===
* Tag (00:00)
* Watches Video (0:45)
 
* Help: Wikipedia (2:03)
==== Qualitative Summary ====
* Tunes out of video (4:14)
''Summary''
* leading (11:58)
 
=== Mental Model ===
* Tag (00:00)


==== Qualitative Summary ====
==== Qualitative Summary ====
''Summary''
Besides Wikipedia the user also browsed various blogs and around the wiki.  Never accesses the tutorial.


=== Commands ===
=== Commands ===
''This is the only required section''
''This is the only required section''
* commands- 00:00 ''successful attempt''
* email- (6:15)
* commands+ 00:00 ''unsuccessful attempt''
* email- (11:54)
* map- (7:25)


==== Qualitative Summary ====
==== Qualitative Summary ====
''Summary''
Tries surfing to Gmail and Google Maps to make Ubiquity work, thinks that it might be a shortcut but doesn't make the jump.


=== Feedback ===
=== Feedback ===
* Likes: comment (00:00)
 
* Feedback: Looks Cool (9:37)
* Feedback: Name- (8:59)
* Feedback: Security- (3:17)


== Demographic Information ==
== Demographic Information ==
Line 52: Line 53:
| Age || What OS do you normally use? || How long have you been using Firefox? || Rate your computer skills. || Time on web per week?
| Age || What OS do you normally use? || How long have you been using Firefox? || Rate your computer skills. || Time on web per week?
|-
|-
| 31
| 18
| Microsoft Windows
| Linux
| Less than 3 Months
| Over 2 Years
| Experienced User
| Modest/Beginner
| 21-40 Hours
| 6-10 Hours
 
|- style="background-color:#efefef;"
|- style="background-color:#efefef;"
| How many computers do you regularly use? || Which are the following are you familiar with using online? || Have you ever used the Firefox Ubiquity before? || Do you know what a Command line is? || Comments
| How many computers do you regularly use? || Which are the following are you familiar with using online? || Have you ever used the Firefox Ubiquity before? || Do you know what a Command line is? || Comments
|-
|-
| 1
| 1
|  
|
* Email (any)
*Google's Gmail
* Google's Gmail
*Search Wikipedia
* Search Wikipedia
*Maps/Lookup directions (MapQuest, Google Maps)
* Language translation websites
* Maps/lookup directions
| No, I do not know what it is
| No, I do not know what it is
| Yes (please tell us your history in ''comments'')
| Yes (please tell us your history below)
| used dos 6.22 and edited things like the autoexec.bat and the config.sys
| I learned about command line when I started using Linux, and I use it almost every time I run linux. I have used it twice in Windows.
|}
|}
{| cellpadding="1" style="border:1px solid black"
{| cellpadding="1" style="border:1px solid black"
<br>
<br />
|+ Posttest Questionnaire
This tester did not fill out a posttest questionnaire.
|- style="background-color:#efefef;"
| Do you think most people would figure out how to use Ubiquity very quickly? || Guess how frequently you would use Ubiquity in the future. || Comments or suggestions. || Is there something that the help is lacking?
|-
| Strongly Disagree
| Often
| If it needs help, it;s not psychically reading my mind enough. I've never used help for any other sofware.
| no one is ever gonna get using ctrl + space to pull it up. Please make it part of the awesome bar or a bar that is on all the time.  
|}


== See Also ==
== See Also ==

Latest revision as of 23:34, 20 February 2009

The original, high quality version is under the public domain At the Internet Archive. For originals without the web-cam video feed please contact zachlym@indolering.com.

A busy tester who shuffled out early, without taking the post-test. Being a rare Ubuntu user, so I was thankful to be able to catch him.

He never figured out how to invoke Ubiquity despite being an advanced user and trying for over 20 minutes.

Video

<video type="viddler" id="a8735477" width="437" height="315" desc="1x Video Full screen hack" frame="true" position="center"/> <video type="viddler" id="76ff13e6" width="640" height="442" desc="2x Video Full screen hack" frame="true" position="center"/>

Tags

Discovery

  • Tunes out of video (4:14)
  • Watches Video (0:45)
  • leading (11:58)
  • Email Shortcut: E (12:04)
  • Tries right click (12:16)
  • Never invokes Ubiquity (12:32)

Qualitative Summary

Unable to figure out how to launch Ubiquity despite being an advanced user with some programming skills. Tries using E as a shortcut, tries right clicking after reading in documentation.

Learnability

  • Watches Video (0:45)
  • Help: Wikipedia (2:03)
  • Tunes out of video (4:14)
  • leading (11:58)

Qualitative Summary

Besides Wikipedia the user also browsed various blogs and around the wiki. Never accesses the tutorial.

Commands

This is the only required section

  • email- (6:15)
  • email- (11:54)
  • map- (7:25)

Qualitative Summary

Tries surfing to Gmail and Google Maps to make Ubiquity work, thinks that it might be a shortcut but doesn't make the jump.

Feedback

  • Feedback: Looks Cool (9:37)
  • Feedback: Name- (8:59)
  • Feedback: Security- (3:17)

Demographic Information

Questions taken from the FF Survey

Pretest Questionnaire
Age What OS do you normally use? How long have you been using Firefox? Rate your computer skills. Time on web per week?
18 Linux Over 2 Years Modest/Beginner 6-10 Hours
How many computers do you regularly use? Which are the following are you familiar with using online? Have you ever used the Firefox Ubiquity before? Do you know what a Command line is? Comments
1
  • Google's Gmail
  • Search Wikipedia
  • Maps/Lookup directions (MapQuest, Google Maps)
No, I do not know what it is Yes (please tell us your history below) I learned about command line when I started using Linux, and I use it almost every time I run linux. I have used it twice in Windows.

This tester did not fill out a posttest questionnaire.

See Also

Fall 08 1.2 Tests