Fennec/Features/visualrefresh/TestPlan
From MozillaWiki
< Fennec | Features | visualrefresh
Contents
Test Plan
System Testing
Mobile OS
- Honeycomb
Mobile Device
- Handheld Test devices for comparison:
Motorola Droid 2 Nokia N900
- Tablet
Test Outline
Note : This test out line is a brain storm of all possible conditions to consider for testing. The scope of the testing will be narrowed from this list based on design information, risks of breakage, etc.
Positive Smoke/Alpha Tests
UI
List of Various UI Parts for visual appeal:
- General
about pages:
- about:about
- about: / about:empty
- about:config
- about:home
- about:firstrun
- about:buildconfig
- about:firefox / about:fennec
- about:sync-log
- about:rights
- about:crashes
- about:plugins
- about:license
- about:blank
- about:addons
- about:memory
- about:certerror
- about:cache
- about:credits
- about:logo
- about:mozilla
- about:support
Verify that you can go to the about pages
note:
- about:addons does not work
- most of the about: pages are local pages (local to the device)
Side Panels:
- Tab Panel Sidebar
- New Tab
- # of Tabs
- Control Panel Sidebar
- BookMark
- Page BookMark
- Edit Dialog
- # of Booksmarks
- Back/Forward
- BookMark
URL Bar
- Site Menu/Favicon
- Refresh Button
Control Panel
- Preference Panel
- Download Panel
- Addons Panel
- Error Panel
Awesome Page
- All Pages
- Bookmarks
- History
- Desktop
- Search Engine Menu
Menu Option Button
- Site Options
- Preferences
- Addons
- Downloads
- > 5 menu items
Notifications
- Geolocation
- Updates
- Restart
- Addons
- Change of languages
- Downloads
- Certificate
- JS Prompts
Buttons
- Web Page buttons
- Comboboxes
- Radio Buttons
Sync Menu
Context Menu
Functional
UI Based Functionality
- Verify the above works
Beta Conditional
Virtual Conditions
- click in text box
- double click in text box
- click outside of Virtual Keyboard : dismissing keyboard
- scrolling above the on-screen keyboard
- Change Cursor Focus
- change focus after composition
- slide right, slide left [ Panels ]
- AwesomePage
- Preferences/Feedback/Plugins/etc Panels
- Context Menus
- Site Menu
- Favorites Panel
- Position/Graphical issues
- collapsing before bringing up keyboard/dismissing keyboard
- scrolling before bringing up keyboard/dismissing keyboard
- tapping after dismissing the keyboard should bring the keyboard up
Content Conditions
- html4
- html5
- asp
- RTL
- back button
- menu button
Physical Conditions
- While Charged
- While not Charged
- Power Consumption
- Performance
- Speed of functions
- Processor utilization
- Memory utilization
- Memory leaks?
- Memory efficiency
- Storage
- Disk
- Sim
Negative (Tests to Break) Tests
- Change with Persona
Race Conditions
- Lock conditions?
- tooltips or other dialogs?
- Network Conditions (Should have no impact)
- WiFi
- 3G
- Bluetooth (Devices)
- 4G?
- SMS
- Signal Conflict
- Browser notifications
- clicking in search field (form assistant + virtual keyboard)
- Restart notification (ie. change in certain preferences in preferences panel )
- Password notification
- form manager notification
- password manager
- popup blocker
- offline storage
- geolocation manager respective to content window
- Battery
- Battery Low
- No Battery
- Calls
- Incoming Phone Call
- Other Apps
- Calendar notification
- Alarm Clock notification
- Sleep notification
- Screensaver / Lock (system)
- EnergySaver (Fade) (system)
- Other?
- Music playing (should not affect)
- plugins (youtube and other websites with different media types)
- Extensions ( addons to fennec)
- Browser notifications
- Buttons
- Hard reset
- Soft reset
- Turn off phone
- force quit
- Other buttons being pressed on the phone (zoom, picture, power )
- UI State Change
- Zoom
- while bringing up Keyboard
- while dismissing the keyboard
- Change Orientation
- while bringing up keyboard
- while dismissing the keyboard
- Zoom
Device/Platform Specific Issues
- Portrait/Landscape Orientation
- Camera (should not conflict?)
- Microphone (Voice commands? Voice Recognition?)
- Speaker (should not conflict)
- headset (should not conflict)
- Vibrate mode (should not conflict)
- Volume (display conflict? need to test)
- GPS
- Print support?
- Sync
- Multiapp?
- physical keyboard
- visible
- hidden
(Note : There may be some difference between maemo and android)
Localization
- Double Byte Characters (Japanese, Chinese, Korean)
- RTL Languages (Arabic/Hebrew)
- High ASCII characters (Euro)
- Date Input/Format (Euro/Japanese/Chinese)
- Time Format (Chinese/Japanese)
- Dialog check
- Change of IME on Mobile OS
Help?
- context sensitive help?
Usability
Usability
- Keyboard Real Estate
- scrolling away?
- jumping to another field?
- Encryption
Accessibility (508 compliance)
- Voice Commands?