QA/Fennec1.0/ReleaseTest/1.0Maemo RC1: Difference between revisions
m (→n900 [timr]) |
m (→n900 [timr]) |
||
Line 196: | Line 196: | ||
* Notes: | * Notes: | ||
** Testing sites from [http://bit.ly/5ZDSRF troublesome sites for the n810 list], along with Alexa top 50, and a bunch of login sites (bank, memberships, etc) | ** Testing sites from [http://bit.ly/5ZDSRF troublesome sites for the n810 list], along with Alexa top 50, and a bunch of login sites (bank, memberships, etc) | ||
*** Tested troublesomesites: | |||
**** boingboing.com (including video) | |||
**** fan590.com (we had trouble with that? It is very simplistic site!?) | |||
**** csnation.com - (including video) - loads super slow but has lots of graphics | |||
== L10n Testing == | == L10n Testing == |
Revision as of 01:13, 31 December 2009
Fennec 1.0 Maemo RC1 Test Results
The covered testing for this release will focus on bfts, l10n, top plugins, top financial sites, updates, and spotchecks.
Project contacts
PM: Stuart Parmenter (stuart)
Build: John O'duinn (oduinn)
QA: Aakash Desai (aakashd)
Volunteer Testers
- N810 - Armen Zambrano <armenzg@mozilla.com> - I will be on holidays so I am not sure which day/time I will be able to help out
- N900, N810 - Stas Malolepszy <stas@mozilla.com>
- N900 - Asa Dotzler <asa@mozilla.com> - I'm available Monday to help out.
- N900 - Joe Drew <joe@drew.ca>
- N900, N810 - Vlad <vladimir@mozilla.com>
- N900, bsmedberg <benjamin@smedbergs.us> - I'm on holidays a lot, but send email and I may be able to help out
Schedule
- Code Freeze
- -- 12/1
- Builds hand to QA
- -- 12/3
- QA test signoff
- --
- See Test Coverage below
Build Location and IDs
Download:
Builds:
Test Coverage
- Areas Covered:
- Smoketests - result
- BFTs - PASS
- Bug Fixes - result
- Website Spotchecks
- L10n Spotchecks - PASS
Test Results
Types of Tests | n900 | n810 |
---|---|---|
Smoketests | marcia - result | jmaher - PASS |
BFTs | aakashd/marcia - PASS/result | jmaher - PASS |
L10n Build | n900 | n810 |
---|---|---|
Auto-detect | abillings - PASS | jmaher - PASS |
cs | abillings - PASS | jmaher - PASS |
da | abillings - PASS | jmaher - PASS |
es-ES | abillings - PASS | jmaher - PASS |
fi | abillings - PASS | jmaher - PASS |
fr | abillings - PASS | jmaher - PASS |
de | abillings - PASS | jmaher - PASS |
it | abillings - PASS | jmaher - PASS |
nb-NO | abillings - PASS | jmaher - PASS |
nl | abillings - PASS | jmaher - PASS |
pl | abillings - PASS | jmaher - PASS |
pt-PT | abillings - PASS | jmaher - PASS |
ru | abillings - PASS | jmaher - PASS |
BFT Testing
BFTs are a more comprehensive set of litmus tests that cover the build testing after smoketests result. Tests are available on litmus under the Fennec 1.0 test suite.
FFTs are a full comprehensive set of litmus tests that extend coverage in areas that BFTs dont often get to. These are run at least once during the major milestone timeline.
If you are running a BFT, Please record your detailed results in the section below.
Fixed Bugs Verifications
The following link constain a list of bugs that are fixed for beta 5 and need verifications:
https://wiki.mozilla.org/Mobile/Fennec/Fennec1.0/Maemo-RC
L10n Spotchecks
Run the Fennec 1.0 Localizer String Guide over each locale and device that is associated with the release. Verify each test case results in a UI element that has strings localized to the correct language.
Detailed Results
Smoketests Results
n900 [tchung]
- Build:
- Results: result
- Notes:
n810 [jmaher]
- Build: Mozilla/5.0 (X11; U; Linux armv7l; Nokia N900; en-US; rv:1.9.2b3pre) Gecko/20091229 Namoroka/3.6b6pre Fennec/1.0b6
- Results: PASS
- Notes:
** See notes from BFT
BFT Results
n900 [aakashd] Installation - Language Selector
- Build: Mozilla/5.0 (X11; U; Linux armv7l; Nokia N900; en-US; rv:1.9.2b3pre) Gecko/20091228 Namoroka/3.6b6pre Fennec/1.0b6
- Results: PASS
- Notes:
- Lots of slowness using the awesomebar and panning pagse with flash enabled after browsing for about 10-15 minutes
- Build: 20091228010629
- Did Layout
- Results: result
- Notes:
- Had trouble crashing when trying to login to yahoo mail. Did disable plugins and that seemed to fix the issue
- Crashed when loading the wallet test page on archive.mozilla.org
- Build: 20091229 (Build ID tchung started using)
n900 [tchung]
- Covering: general, content handling, addons manager, downloading, password manager, menu bar, installation, Search, tile caching, layout
- Build: Mozilla/5.0 (X11; U; Linux armv71; en-US; rv:1.9.2b6pre) Gecko/20091229 Firefox 3.6b6pre Fennec/1.0b6pre
- Results: in prog
- Notes:
- Filed bug 537109 - Flash video content on dailymotion.com wont play (
- Filed bug 537127 - Flash ads can overlay the security warning notifications
- Filed bug 537183 - About Us page is unbookmarked, but still starred
- Filed bug 537185 - Fennec favicons are pixelated
- I crashed disabling plugins in the preferences. Need to find a repro.
- Searching for addons returns nothing. even the ones that are listed as recommended
- restarting the added addon takes about 30 seconds to restart. (bug 534982
- For some reason, my "allow cookies" keeps disabling by itself. Investigating the cause.
n810 [jmaher] Installation - Language Selector
- Build: Mozilla/5.0 (X11; U; Linux armv7l; Nokia N900; en-US; rv:1.9.2b3pre) Gecko/20091229 Namoroka/3.6b6pre Fennec/1.0b6
- Results: PASS
- Notes:
* bug 537095 - n810: form manager does not launch when browsing to gmail * bug 537099 - n810: browser crashes while loading yahoo.com if plugins are enabled (flash) * bug 537138 - n810: geolocation pages do not display any data
- Build: Mozilla/5.0 (X11; U; Linux armv7l; Nokia N900; en-US; rv:1.9.2b3pre) Gecko/20091229 Namoroka/3.6b6pre Fennec/1.0b6
- Results: PASS
- Notes:
Websites Testing
A list of tough websites with the n810 and no-swap: http://bit.ly/5ZDSRF
Please build up a list of hard to use (ui interaction, or too heavyweight and slow) so we can add to future testplans.
n900 [timr]
- Build:
- Results: result
- Notes:
- Testing sites from troublesome sites for the n810 list, along with Alexa top 50, and a bunch of login sites (bank, memberships, etc)
- Tested troublesomesites:
- boingboing.com (including video)
- fan590.com (we had trouble with that? It is very simplistic site!?)
- csnation.com - (including video) - loads super slow but has lots of graphics
- Tested troublesomesites:
- Testing sites from troublesome sites for the n810 list, along with Alexa top 50, and a bunch of login sites (bank, memberships, etc)
L10n Testing
n900 [abillings]
- Build:
- Results: result
- Notes:
n810 [jmaher]
- Build:
- Results: result
- Notes: