QA/Fennec/Milestones/2.0/ReleaseTest/Beta2 Build2

Fennec 4.0 Beta 2 Test Results

The covered testing for this release will focus on smoketests, verifications and updates. For a list of new features coming in for Fennec 4.0, take a look at the Mobile Planning Page and for test coverage, look at our test plan.

Project contacts

PM: Stuart Parmenter (stuart)
Build: John O'duinn (oduinn)
QA: Aakash Desai (aakashd)

Schedule

Code Freeze

-- 10/28

Builds hand to QA

-- 10/29

QA test signoff

--

Build Location and IDs

1. Go to the candidates folder in our ftp folders
2. Go to the "4.0b2-candidates" folder
3. Go to the "build2" folder
4. Download the candidate:
   • For the n900, install the application catalog and update to the candidate build via your device App Manager.
   • For Android, download and install the actual build over any other instance

Test Coverage

Smoketests

Lite verification tests (or smoketests) will be first run when the builds are ready. Tests are available on litmus under the Fennec 2.0 Test Suite. In any case of failure in any Smoketest, blockers need to be raised ASAP before proceeding to the BFTs.

Please record your detailed results in the "Detailed Test Results" section below.

BFTs for 2.0 Features

BFTs are a more comprehensive set of litmus tests that cover functional testing of features that have landed on Fennec 2.0. Tests are available on litmus under the Fennec 2.0 Test Suite.

Please record your detailed results in the "Detailed Test Results" section below.

Here are the BFT's that need to be run:

• Feedback
• RTL Support
• Panning & Zooming (Screen Navigation)
• Sync

OS Integration

The Operating System Integration testsuite is a set of tests that target how Fennec works with the platform (i.e. Android, Maemo, etc.) and features of the device itself (i.e. Orientation, hard keyboard, soft keyboard, etc.). Tests are available on litmus under the Fennec 2.0 Test Suite under the "OS Integration Tests" testgroup.

Please record your detailed results in the "Detailed Test Results" section below.

Fixed Bugs Verifications

The following link contains a list of bugs that are fixed for beta 1 and need verifications:

• 2.0b2+ Fennec blockers at a resolved state, but un-verified

L10n Checks

We don't have coverage of localized builds until the candidate builds are available, so we'll need to run through the tests within the Fennec 2.0 String Guide on the following locales:

• German
• Finnish
• French

Updates

Fennec 2.0 Beta 2 can be downloaded from the Mozilla Beta Catalog.

Updates tests to perform for each build

Test Results

Types of Tests	Maemo	Android
Smoketests	ahoza - DONE	ioana - DONE
BFTs	ahoza - DONE	ashah - DONE
OS Integration	aakashd - DONE	ioana - DONE
L10n	nhirata - DONE	AaronMT - DONE
Updates	ahoza - DONE aakashd - DONE	ioana - DONE nhirata - DONE

Detailed Test Results

Smoketests Results

HTC Desire [ioana]

• Build: Mozilla/5.0 (Android; Linux armv7l; rv:2.0b7pre) Gecko/20101101 Firefox/4.0b8pre Fennec/4.0b2
• Results: DONE

• Notes:
  • bug 606458 - Throbber displayed in "Your tabs from last time" in about:home after a clean install.
  • bug 602962 - Undo close tab thumbnail dissapears when rotating screen orientation
  • bug 608268 - URL bar larger than usual at sharing a page through twitter

n900 [ahoza]

• Build: Mozilla/5.0 (Maemo; Linux armv7l; rv:2.0b7pre) Gecko/20101101 Firefox/4.0b8pre Fennec/4.0b2
• Results: DONE

• Notes:
  • bug 608997 - Tab crashes while in yahoo.com
  • bug 602962 - Undo close tab thumbnail dissapears when rotating screen orientation

BFT Results

Nexus One [ashah]

• Build: Build: Mozilla/5.0 (Android; Linux armv7l; rv:2.0b7pre) Gecko/20101101 Firefox/4.0b8pre Fennec/4.0b2

• Results: Done

• Notes:
  
  • Known issues:
    
    • bug 579628 HTML iframe can't be panned
      
    • bug 601331 about:home > Give Feedback link 404's
      
    • bug 601018 [RTL] Search engines do not appear after clicking on the magnifying glass next to the Awesome Bar in the Awesome Page
      

• • New bugs filed:
    
    • bug 608852 Soft keyboard comes up when sliding the page to the left.
      
    • bug 608753 Cannot type anything into webpages on 20101101 nightly
      
    • bug 608457 Fennec crashes on gmail standard view on 20101029

n900 [ahoza]

• Build: Mozilla/5.0 (Maemo; Linux armv7l; rv:2.0b7pre) Gecko/20101101 Firefox/4.0b8pre Fennec/4.0b2
• Results: DONE

• Notes:
  • Feedback:
    • bug 601331 - about:home > Give Feedback link 404's
  • RTL:
    • bug 601018 - [RTL] Search engines do not appear after clicking on the magnifying glass next to the Awesome Bar in the Awesome Page
  • Panning&Zooming:
    • bug 579628 - HTML iframe can't be panned

OS Integration Results

HTC Desire [ioana]

• Build: Mozilla/5.0 (Android; Linux armv7l; rv:2.0b7pre) Gecko/20101101 Firefox/4.0b8pre Fennec/4.0b2
• Results: DONE

• Notes:
  • bug 606458 Throbber displayed in "Your tabs from last time" in about:home after a clean install.
  • bug 602962 Undo close tab thumbnail dissapears when rotating screen orientation
  • bug 608268 URL bar larger than usual at sharing a page through twitter
  • bug 600816 Blank page at geolocation and strange behavior
  • bug 590602 Support input method changing in Fennec
  • bug 581596 Use different Android soft keyboards for URL, email, telephone, etc. fields
• Unreproducible issues:
  • This occurred when tapping the URL bar

n900 [aakashd]

• Build: Mozilla/5.0 (maemol Linux armv7l; rv:2.0b7pre) Gecko/20101029 Firefox/4.0b8pre Fennec/4.0b2
• Results: DONE

• Notes:
  • bug 608825 - Pressing down key on n900 directional pad moves a panned page down from the top of it
  • bug 608832 - Pressing backspace button on hardkeyboard while on a local pages locks the ability to open sidebars
  • bug 535793 - Connect in gtk port on n900 works, but you get a page load error directly after connection setup and need to try again.
  • bug 599811 - fn/alt/shift keys on android needs to stay pressed for the next key entry

L10n Results

Milestone [AaronMT]

• Build: Mozilla/5.0 (Android; Linux armv7l; rv:2.0b7pre) Gecko/20101101 Firefox/4.0b8pre Fennec/4.0b2
• Results: Done

• Notes:
• German:
  • about:rights - XML Parsing error @ http://mxr.mozilla.org/l10n-central/source/de/mobile/chrome/overrides/aboutRights.dtd#7 bug 609025
  • Bugs Found
    • bug 608870 German: "Give Feedback" link in about:home is in English
    • bug 608871 German: "Check for Updates" section is missing translations
    • bug 608875 German: Context menu is missing in browser.dtd
    • bug 608879 German: "Sync" section is missing from preferences.dtd
    • bug 608883 German: Fennec is missing translation for "What are Add-ons"
    • bug 608891 German: Page Actions are in English for Fennec
    • bug 608892 German: Feedback panel is in English
    • bug 608894 German: Awesome page for fennec is partially in English
    • bug 608898 Geolocation bar is not translated (browser.properties)
    • bug 608903 German: XML error when going to a wrong page in German
    • bug 608905 German: about:firstrun is partially translated in German for fennec
• French
  • No issues found
• Spanish
  • No issues found

n900 [nhirata]

• Build: Mozilla/5.0 (Maemo; Linux armv71; rv:2.0b7pre) Gecko/201001101 Firefox/4.0b8pre Fennec/4.0b2

• Results: Done

• Notes:
• German:
  • differences in http://mxr.mozilla.org/l10n-central/source/de/mobile/chrome/overrides/netError.dtd may be causing parse error
    • button id vs xul:button : need to test
    • offline mode ( lines are split up in German. shouldn't matter but should try to test anyhow, is the translation the same? )

• Bugs Found:
  • General:
    • bug 608908 Maemo: Fennec Multilanguage Beta Build is still branded Fennec
  • German
    • bug 608870 German : "Give Feedback" link in about:home is in English
    • bug 608871 German: "Check for Updates" section is missing translations
    • bug 608875 German : Context menu is missing in browser.dtd
    • bug 608879 German: "Sync" section is missing from preferences.dtd
    • bug 608883 German: Fennec is missing translation for "What are Add-ons"
    • bug 608891 German: Page Actions are in English for Fennec
    • bug 608892 German: Feedback panel is in English
    • bug 608894 German: Awesome page for fennec is partially in English
    • bug 608898 Geolocation bar is not translated (browser.properties)
    • bug 608903 XML error when going to a wrong page in German
    • bug 608905 about:firstrun is partially translated in German for fennec
  • Finnish
    • Nothing specific to Finnish
  • French
    • Nothing specific to French

Updates Results

HTC Desire [ioana]

• Build: Mozilla/5.0 (Maemo; Linux armv7l; rv:2.0b7pre) Gecko/20101101 Firefox/4.0b8pre Fennec/4.0b2
• Results: DONE

• Notes:
  • bug 608837 - 4.0b2 rc 1 does not update to 4.0b2 rc 2 :
  • The button doesn't exist in 4.0b1, so update button (test case 13745) isn't runnable unless bug 608837 is fixed.
  • Testcase ID #13530 - [Android Only][Update]Android Update with Auto Confirmation Setup -> following those steps the update notification doesn't appear; the test case was unclear/broken
  • Testcase ID #13745 - [Android Only][Update] About:Firefox update button beta build - The button doesn't exist in 4.0b1
• Unreproducible issues:
  • following the steps from testcase ID #13648 - [Android Only][Update] automatic update service testing for build channel with adjustments to timer first time occur this parse error

Droid 2 [nhirata]

• Build: Mozilla/5.0 (Android; Linux armv71; rv:2.0b7pre) Gecko20101101 Firefox/4.0b8pre Fennec/4.0b2

• Results: Done

• Notes:
  • App size is 44.59 MB after updating from 4.0b1 build 3 to 4.0b2 build 2; Changes within beta 2 to lower the size were made, however the size of the application will not change unless you uninstall and reinstall.
  • 4.0b2 rc 1 does not update to 4.0b2 rc 2 : bug 608837
  • The button doesn't exist in 4.0b1, so update button (test case 13745) isn't runnable unless bug 608837 is fixed.
  • build 4.0b1 build 3 => build 4.0b2 build 2 does work for AUS

• Bugs Found:
  • bug 608837 4.0b2 rc 1 does not update to 4.0b2 rc 2

n900 [ahoza]

• Build: Mozilla/5.0 (Maemo; Linux armv7l; rv:2.0b7pre) Gecko/20101101 Firefox/4.0b8pre Fennec/4.0b2
• Results: DONE

• Notes:
  • bug 565709 - Can't install Fennec from Mozilla repos after using Ovi store

n900 [aakashd]

• Build: Mozilla/5.0 (maemol Linux armv7l; rv:2.0b7pre) Gecko/20101029 Firefox/4.0b8pre Fennec/4.0b2
• Results: DONE

• Notes: