Fennec/Features/visualrefresh/TestPlan: Difference between revisions

 
(5 intermediate revisions by the same user not shown)
Line 18: Line 18:
== Positive Smoke/Alpha Tests ==
== Positive Smoke/Alpha Tests ==


=== UI ===
=== UI ===
List of Various UI Parts for visual appeal:
List of Various UI Parts for visual appeal:
* General  
#General
** about pages:
{{hidden_r
*** about:about
|about pages:
*** about:
|
*** about:config
* about:about
*** about:home
* about: / about:empty
*** about:firstrun
* about:config
*** about:buildconfig
* about:home
*** about:firefox / about:fennec
* about:firstrun
*** about:sync-log
* about:buildconfig
*** about:rights
* about:firefox / about:fennec
*** about:crashes
* about:sync-log
*** about:plugins
* about:rights
*** about:license
* about:crashes
*** about:blank
* about:plugins
*** about:addons
* about:license
*** about:memory
* about:blank
* Side Panels
* about:addons
** Tab Panel Sidebar
* about:memory
*** New Tab
* about:certerror
*** # of Tabs
* about:cache
** Control Panel Sidebar
* about:credits
*** BookMark
* about:logo
**** Page BookMark
* about:mozilla
**** Edit Dialog
* about:support
**** # of Booksmarks
 
*** Back/Forward
Verify that you can go to the about pages<br>
* URL Bar
note: <br>
** Site Menu/Favicon
# about:addons does not work
** Refresh button
# most of the about: pages are local pages (local to the device)
* Control Panel
|headerstyle=background:#dddddd
** Preference Panel
}}
** Download Panel
 
** Addons Panel
{{hidden_r
** Error Panel
|Side Panels:
* Awesome Page
|
** All Pages
* Tab Panel Sidebar
** Bookmarks
** New Tab
** History
** # of Tabs
** Desktop
* Control Panel Sidebar
** Search Engine Menu
** BookMark
* Menu Option Button
*** Page BookMark
** Site Options
*** Edit Dialog
** Preferences
*** # of Booksmarks
** Addons  
** Back/Forward
** Downloads
|headerstyle=background:#dddddd
** > 5 menu items
}}
* Notifications
 
** Geolocation
{{hidden_r
** Updates
|URL Bar
** Restart
|
*** Addons
* Site Menu/Favicon
*** Change of languages
* Refresh Button
** Downloads
|headerstyle=background:#dddddd
** Certificate
}}
** JS Prompts
 
* Buttons
{{hidden_r
** Web Page buttons
|Control Panel
** Comboboxes
|
** Radio Buttons
* Preference Panel
* Sync Menu
* Download Panel
* Context Menu
* Addons Panel
* Error Panel
|headerstyle=background:#dddddd
}}
 
{{hidden_r
|Awesome Page
|
* All Pages
* Bookmarks
* History
* Desktop
* Search Engine Menu
|headerstyle=background:#dddddd
}}
 
{{hidden_r
|Menu Option Button
|
* Site Options
* Preferences
* Addons  
* Downloads
* > 5 menu items
|headerstyle=background:#dddddd
}}
 
{{hidden_r
|Notifications
|
* Geolocation
* Updates
* Restart
* Addons
* Change of languages
* Downloads
* Certificate
* JS Prompts
|headerstyle=background:#dddddd
}}
 
 
{{hidden_r
|Buttons
|
* Web Page buttons
* Comboboxes
* Radio Buttons
|headerstyle=background:#dddddd
}}
 
 
 
{{hidden_r
|Sync Menu
|
|headerstyle=background:#dddddd
}}
 
{{hidden_r
|Context Menu
|
|headerstyle=background:#dddddd
}}


=== Functional ===
=== Functional ===
* UI Based Functionality
{{hidden_r
** Verify the above works
|UI Based Functionality
|
* Verify the above works
|headerstyle=background:#dddddd
}}


== Beta Conditional  ==
== Beta Conditional  ==
*Virtual Conditions  
{{hidden_r
**click in text box  
|Virtual Conditions
**double click in text box  
|
**click outside of Virtual Keyboard&nbsp;: dismissing keyboard  
*click in text box  
**scrolling above the on-screen keyboard  
*double click in text box  
**Change Cursor Focus  
*click outside of Virtual Keyboard&nbsp;: dismissing keyboard  
*** change focus after composition
*scrolling above the on-screen keyboard  
**slide right, slide left [ Panels ]
*Change Cursor Focus  
**AwesomePage
** change focus after composition
**Preferences/Feedback/Plugins/etc Panels
*slide right, slide left [ Panels ]
**Context Menus
*AwesomePage
**Site Menu
*Preferences/Feedback/Plugins/etc Panels
**Favorites Panel
*Context Menus
**Position/Graphical issues
*Site Menu
*** collapsing before bringing up keyboard/dismissing keyboard
*Favorites Panel
*** scrolling before bringing up keyboard/dismissing keyboard
*Position/Graphical issues
*** tapping after dismissing the keyboard should bring the keyboard up
** collapsing before bringing up keyboard/dismissing keyboard
*Content Conditions
** scrolling before bringing up keyboard/dismissing keyboard
** html4
** tapping after dismissing the keyboard should bring the keyboard up
** html5
|headerstyle=background:#dddddd
** asp
}}
** RTL
** back button
** menu button


*Physical Conditions  
{{hidden_r
**While Charged
|Content Conditions
**While not Charged
|
**Power Consumption
* html4
**Performance
* html5
*** Speed of functions
* asp
*** Processor utilization
* RTL
*** Memory utilization
* back button
**** Memory leaks?
* menu button
**** Memory efficiency
|headerstyle=background:#dddddd
**Storage
}}
***Disk
***Sim


*Negative (Tests to Break) Tests
{{hidden_r
|Physical Conditions 
|
*While Charged
*While not Charged
*Power Consumption
*Performance
** Speed of functions
** Processor utilization
** Memory utilization
*** Memory leaks?
*** Memory efficiency
*Storage
**Disk
**Sim
|headerstyle=background:#dddddd
}}


*Race Conditions
{{hidden_r
** Lock conditions?
|Negative (Tests to Break) Tests
** tooltips or other dialogs?
|
** Network Conditions (Should have no impact)
* Change with Persona
*** WiFi
|headerstyle=background:#dddddd
*** 3G
}}
*** Bluetooth (Devices)
*** 4G?
*** SMS
**Signal Conflict
*** Browser notifications
**** clicking in search field (form assistant + virtual keyboard)
**** Restart notification (ie. change in certain preferences in preferences panel )
**** Password notification
**** form manager notification
**** password manager
**** popup blocker
**** offline storage
**** geolocation manager respective to content window
***Battery
****Battery Low
****No Battery
***Calls
****Incoming Phone Call
***Other Apps
****Calendar notification
****Alarm Clock notification
****Sleep notification
****Screensaver / Lock (system)  
****EnergySaver (Fade) (system)
****Other?
****Music playing (should not affect)
****plugins (youtube and other websites with different media types)
****Extensions ( addons to fennec)
**Buttons
***Hard reset
***Soft reset
***Turn off phone
***force quit
***Other buttons being pressed on the phone (zoom, picture, power )
**UI State Change
***Zoom
****while bringing up Keyboard
****while dismissing the keyboard
***Change Orientation
****while bringing up keyboard
****while dismissing the keyboard


*Device/Platform Specific Issues  
{{hidden_r
**Portrait/Landscape Orientation  
|Race Conditions
**Camera (should not conflict?)  
|
**Microphone (Voice commands? Voice Recognition?)  
* Lock conditions?
**Speaker (should not conflict)  
* tooltips or other dialogs?
**headset (should not conflict)  
* Network Conditions (Should have no impact)
**Vibrate mode (should not conflict)  
** WiFi
**Volume (display conflict? need to test)  
** 3G
**GPS
** Bluetooth (Devices)
**Print support?
** 4G?
**Sync
** SMS
** Multiapp?
*Signal Conflict
** physical keyboard
** Browser notifications
*** visible
*** clicking in search field (form assistant + virtual keyboard)
*** hidden
*** Restart notification (ie. change in certain preferences in preferences panel )
*** Password notification
*** form manager notification
*** password manager
*** popup blocker
*** offline storage
*** geolocation manager respective to content window
**Battery
***Battery Low
***No Battery
**Calls
***Incoming Phone Call
**Other Apps
***Calendar notification
***Alarm Clock notification
***Sleep notification
***Screensaver / Lock (system)
***EnergySaver (Fade) (system)
***Other?
***Music playing (should not affect)
***plugins (youtube and other websites with different media types)
***Extensions ( addons to fennec)
*Buttons
**Hard reset
**Soft reset
**Turn off phone
**force quit
**Other buttons being pressed on the phone (zoom, picture, power )
*UI State Change
**Zoom
***while bringing up Keyboard
***while dismissing the keyboard
**Change Orientation
***while bringing up keyboard
***while dismissing the keyboard
|headerstyle=background:#dddddd
}}
 
{{hidden_r
|Device/Platform Specific Issues  
|
*Portrait/Landscape Orientation  
*Camera (should not conflict?)  
*Microphone (Voice commands? Voice Recognition?)  
*Speaker (should not conflict)  
*headset (should not conflict)  
*Vibrate mode (should not conflict)  
*Volume (display conflict? need to test)  
*GPS
*Print support?
*Sync
* Multiapp?
* physical keyboard
** visible
** hidden
(Note : There may be some difference between maemo and android)
(Note : There may be some difference between maemo and android)
|headerstyle=background:#dddddd
}}


*Localization  
{{hidden_r
**Double Byte Characters (Japanese, Chinese, Korean)  
|Localization
**RTL Languages (Arabic/Hebrew)  
|
**High ASCII characters (Euro)  
*Double Byte Characters (Japanese, Chinese, Korean)  
**Date Input/Format (Euro/Japanese/Chinese)  
*RTL Languages (Arabic/Hebrew)  
**Time Format (Chinese/Japanese)  
*High ASCII characters (Euro)  
**Dialog check  
*Date Input/Format (Euro/Japanese/Chinese)  
**Change of IME on Mobile OS
*Time Format (Chinese/Japanese)  
*Dialog check  
*Change of IME on Mobile OS
|headerstyle=background:#dddddd
}}


* Help?
{{hidden_r
** context sensitive help?
|Help?
|
* context sensitive help?
|headerstyle=background:#dddddd
}}


== Usability ==
== Usability ==
*Usability
{{hidden_r
|Usability
|
** Keyboard Real Estate
** Keyboard Real Estate
** scrolling away?
* scrolling away?
** jumping to another field?
* jumping to another field?
** Encryption
* Encryption
* Accessibility (508 compliance)
|headerstyle=background:#dddddd
** Voice Commands?
}}
 
{{hidden_r
|Accessibility (508 compliance)
|
* Voice Commands?
|headerstyle=background:#dddddd
}}
Confirmed users
4,378

edits