QA/Fennec1.0/ReleaseTest/1.0Maemo RC1: Difference between revisions

From MozillaWiki
< QA
Jump to navigation Jump to search
Line 196: Line 196:
* Notes:
* Notes:
** Testing sites from [http://bit.ly/5ZDSRF troublesome sites for the n810 list], along with Alexa top 50, and a bunch of login sites (bank, memberships, etc)
** Testing sites from [http://bit.ly/5ZDSRF troublesome sites for the n810 list], along with Alexa top 50, and a bunch of login sites (bank, memberships, etc)
*** Tested troublesomesites:
**** boingboing.com (including video)
**** fan590.com (we had trouble with that? It is very simplistic site!?)
**** csnation.com - (including video) - loads super slow but has lots of graphics


== L10n Testing ==
== L10n Testing ==

Revision as of 01:13, 31 December 2009

Fennec 1.0 Maemo RC1 Test Results

The covered testing for this release will focus on bfts, l10n, top plugins, top financial sites, updates, and spotchecks.

Project contacts

PM: Stuart Parmenter (stuart)
Build: John O'duinn (oduinn)
QA: Aakash Desai (aakashd)


Volunteer Testers

  • N810 - Armen Zambrano <armenzg@mozilla.com> - I will be on holidays so I am not sure which day/time I will be able to help out
  • N900, N810 - Stas Malolepszy <stas@mozilla.com>
  • N900 - Asa Dotzler <asa@mozilla.com> - I'm available Monday to help out.
  • N900 - Joe Drew <joe@drew.ca>
  • N900, N810 - Vlad <vladimir@mozilla.com>
  • N900, bsmedberg <benjamin@smedbergs.us> - I'm on holidays a lot, but send email and I may be able to help out

Schedule

Code Freeze
-- 12/1
Builds hand to QA
-- 12/3
QA test signoff
--
  • See Test Coverage below

Build Location and IDs

Download:

Builds:

Test Coverage

  • Areas Covered:
    • Smoketests - result
    • BFTs - PASS
    • Bug Fixes - result
    • Website Spotchecks
    • L10n Spotchecks - PASS

Test Results

Types of Tests n900 n810
Smoketests marcia - result jmaher - PASS
BFTs aakashd/marcia - PASS/result jmaher - PASS
L10n Build n900 n810
Auto-detect abillings - PASS jmaher - PASS
cs abillings - PASS jmaher - PASS
da abillings - PASS jmaher - PASS
es-ES abillings - PASS jmaher - PASS
fi abillings - PASS jmaher - PASS
fr abillings - PASS jmaher - PASS
de abillings - PASS jmaher - PASS
it abillings - PASS jmaher - PASS
nb-NO abillings - PASS jmaher - PASS
nl abillings - PASS jmaher - PASS
pl abillings - PASS jmaher - PASS
pt-PT abillings - PASS jmaher - PASS
ru abillings - PASS jmaher - PASS

BFT Testing

BFTs are a more comprehensive set of litmus tests that cover the build testing after smoketests result. Tests are available on litmus under the Fennec 1.0 test suite.

FFTs are a full comprehensive set of litmus tests that extend coverage in areas that BFTs dont often get to. These are run at least once during the major milestone timeline.

If you are running a BFT, Please record your detailed results in the section below.

Fixed Bugs Verifications

The following link constain a list of bugs that are fixed for beta 5 and need verifications:

https://wiki.mozilla.org/Mobile/Fennec/Fennec1.0/Maemo-RC

L10n Spotchecks

Run the Fennec 1.0 Localizer String Guide over each locale and device that is associated with the release. Verify each test case results in a UI element that has strings localized to the correct language.

Detailed Results

Smoketests Results

n900 [tchung]

  • Build:
  • Results: result
  • Notes:

n810 [jmaher]

  • Build: Mozilla/5.0 (X11; U; Linux armv7l; Nokia N900; en-US; rv:1.9.2b3pre) Gecko/20091229 Namoroka/3.6b6pre Fennec/1.0b6
  • Results: PASS
  • Notes:
** See notes from BFT

BFT Results

n900 [aakashd] Installation - Language Selector

  • Build: Mozilla/5.0 (X11; U; Linux armv7l; Nokia N900; en-US; rv:1.9.2b3pre) Gecko/20091228 Namoroka/3.6b6pre Fennec/1.0b6
  • Results: PASS
  • Notes:
    • Lots of slowness using the awesomebar and panning pagse with flash enabled after browsing for about 10-15 minutes

n900 [marcia] Layout - Screen Navigation

  • Build: 20091228010629
    • Did Layout
  • Results: result
  • Notes:
    • Had trouble crashing when trying to login to yahoo mail. Did disable plugins and that seemed to fix the issue
    • Crashed when loading the wallet test page on archive.mozilla.org
    • Build: 20091229 (Build ID tchung started using)

n900 [tchung]

  • Covering: general, content handling, addons manager, downloading, password manager, menu bar, installation, Search, tile caching, layout
  • Build: Mozilla/5.0 (X11; U; Linux armv71; en-US; rv:1.9.2b6pre) Gecko/20091229 Firefox 3.6b6pre Fennec/1.0b6pre
  • Results: in prog
  • Notes:
    • Filed bug 537109 - Flash video content on dailymotion.com wont play (
    • Filed bug 537127 - Flash ads can overlay the security warning notifications
    • Filed bug 537183 - About Us page is unbookmarked, but still starred
    • Filed bug 537185 - Fennec favicons are pixelated
    • I crashed disabling plugins in the preferences. Need to find a repro.
    • Searching for addons returns nothing. even the ones that are listed as recommended
    • restarting the added addon takes about 30 seconds to restart. (bug 534982
    • For some reason, my "allow cookies" keeps disabling by itself. Investigating the cause.

n810 [jmaher] Installation - Language Selector

  • Build: Mozilla/5.0 (X11; U; Linux armv7l; Nokia N900; en-US; rv:1.9.2b3pre) Gecko/20091229 Namoroka/3.6b6pre Fennec/1.0b6
  • Results: PASS
  • Notes:
 * bug 537095 - n810: form manager does not launch when browsing to gmail
 * bug 537099 - n810: browser crashes while loading yahoo.com if plugins are enabled (flash)
 * bug 537138 - n810: geolocation pages do not display any data

n810 [jmaher] Layout - Screen Navigation

  • Build: Mozilla/5.0 (X11; U; Linux armv7l; Nokia N900; en-US; rv:1.9.2b3pre) Gecko/20091229 Namoroka/3.6b6pre Fennec/1.0b6
  • Results: PASS
  • Notes:

Websites Testing

A list of tough websites with the n810 and no-swap: http://bit.ly/5ZDSRF

Please build up a list of hard to use (ui interaction, or too heavyweight and slow) so we can add to future testplans.

n900 [timr]

  • Build:
  • Results: result
  • Notes:
    • Testing sites from troublesome sites for the n810 list, along with Alexa top 50, and a bunch of login sites (bank, memberships, etc)
      • Tested troublesomesites:
        • boingboing.com (including video)
        • fan590.com (we had trouble with that? It is very simplistic site!?)
        • csnation.com - (including video) - loads super slow but has lots of graphics

L10n Testing

n900 [abillings]

  • Build:
  • Results: result
  • Notes:

n810 [jmaher]

  • Build:
  • Results: result
  • Notes: