QA/Fennec/Milestones/2.0/ReleaseTest/Beta5: Difference between revisions

From MozillaWiki
< QA‎ | Fennec‎ | Milestones‎ | 2.0
Jump to navigation Jump to search
Line 140: Line 140:
** known bugs:
** known bugs:


==== n900 [Ioana] ====
==== n900 [ashah] ====
*Build: Mozilla/5.0 (Maemo;Linux armv7l;rv:2.0b12pre)Gecko/20110216 Firefox/4.0b12pre Fennec /4.0b5pre
*Build:  
*Results: '''DONE -> PASS'''
*Results: '''result'''


*Notes:
*Notes:
[ashah on build 3]
**
[Ioana on build 2]
** '''Form assistant'''
** '''Form assistant'''
*** There is no more search in form fill - talked to Vivien and I understood is intended.  
*** There is no more search in form fill - talked to Vivien and I understood is intended.  

Revision as of 00:14, 18 February 2011

Fennec 4.0 Beta 5 Test Results

The covered testing for this release will focus on smoketests, verifications and updates. For a list of new features coming in for Fennec 4.0, take a look at the Mobile Planning Page and for test coverage, look at our test plan.

Project contacts

PM: Stuart Parmenter (stuart)
Build: John O'duinn (oduinn)
QA: Aakash Desai (aakashd)

Schedule

Code Freeze
-- 2/15
Builds hand to QA
-- 2/17
QA test signoff
--

Build Location and IDs

  1. Go to the candidates folder in our ftp folders
  2. Go to the "4.0b5-candidates" folder
  3. Download the candidate:
    • For the n900, install the application catalog and update to the candidate build via your device App Manager.
    • For Android, download and install the actual build over any other instance

Test Coverage

Smoketests

Lite verification tests (or smoketests) will be first run when the builds are ready. Tests are available on litmus under the Fennec 2.0 Test Suite. In any case of failure in any Smoketest, blockers need to be raised ASAP before proceeding to the BFTs.

Please record your detailed results in the "Detailed Test Results" section below.

BFTs for 2.0 Features

BFTs are a more comprehensive set of litmus tests that cover functional testing of features that have landed on Fennec 2.0. Tests are available on litmus under the Fennec 2.0 Test Suite.

Please record your detailed results in the "Detailed Test Results" section below.

Here are the BFT's that need to be run:

  • Panning & Zooming (Screen Navigation)
  • Form Assistant
  • Sync

OS Integration

The Operating System Integration testsuite is a set of tests that target how Fennec works with the platform (i.e. Android, Maemo, etc.) and features of the device itself (i.e. Orientation, hard keyboard, soft keyboard, etc.). Tests are available on litmus under the Fennec 2.0 Test Suite under the "OS Integration Tests" testgroup.

Please record your detailed results in the "Detailed Test Results" section below.

Fixed Bugs Verifications

The following link contains a list of bugs that are fixed for beta 5 and need verifications:

L10n Checks

We don't have coverage of localized builds until the candidate builds are available, so we'll need to run through the tests within the Fennec 2.0 String Guide on the following locales:

  • German
  • Finnish
  • French

Updates

Test the update path for the released builds only, not the nightlies. (eg. 1.1->4.0b5 (maemo only) and 4.0b4->4.0b5)

Fennec 2.0 Beta 5 can be downloaded from the Mozilla Beta Catalog or the Android Marketplace.

Updates tests to perform for each build

Test Results

Types of Tests Maemo Android
Smoketests
  • Ioana - PASS
  • kbrosnan - result
BFTs
  • ashah - result
  • kbrosnan - result
OS Integration
  • aakashd - result
  • nhirata - result
L10n
  • Ioana - result
  • nhirata - result
Updates
  • Ioana- result
  • AaronMT - result

Detailed Test Results

Smoketests Results

G2 [kbrosnan]

  • Build:
  • Results: result
  • Notes:
    • Known bugs:

n900 [Ioana]

  • Build: Mozilla/5.0 (Maemo;Linux armv7l;rv:2.0b12pre)Gecko/20110216 Firefox/4.0b12pre Fennec /4.0b5pre
  • Results: Pass
  • Notes:
    • Known bugs:
      • bug 611294 - After sharing a page using Facebook, the browser returns to the shared page
    • New issue:
      • bug 634883 - Inconsistency at Share Link for 'About:' / System pages
    • Unreproducible issue:
      • The Return Arrow from preference sign remains over the closing X of the application

BFT Results

G2 [kbrosnan]

  • Build:
  • Results: result
  • Notes:
    • known bugs:

n900 [ashah]

  • Build:
  • Results: result
  • Notes:

[ashah on build 3]

[Ioana on build 2]

    • Form assistant
      • There is no more search in form fill - talked to Vivien and I understood is intended.
      • Known bugs:
        • bug 606466- Unnecessary ">" button in form autocomplete suggestions list
    • Sync
      • New Bug:
        • bug 634904 - "Wrong sync key" error message when trying to connect to a sync account using a 26 digit Sync key on Firefox 3.6.12
    • Panning&Zooming
      • Browser checkerboards everytime one pans up/down, zooms out. This gives a poor user experience.
      • Known bugs - checkerboarding problems still present:
        • bug 607777 - Make a good metric for checkerboarding
        • bug 629336 - Bad checkerboarding in Advanced search form on bugzilla.mozilla.org

OS Integration Results

Motorola Droid 2 [nhirata]

  • Build:
  • Results: result
  • Notes:

n900 [Ioana]

  • Build:
  • Results: result
  • Notes:

L10n Results

Motorola Droid 2 [nhirata]

  • Build:
  • Results: result
  • Notes:

n900 [Ioana]

  • Build: Mozilla/5.0 (Maemo;Linux armv7l;rv:2.0b12pre)Gecko/20110216 Firefox/4.0b12pre Fennec /4.0b5pre
  • Results: result
  • Notes:
    • No single locale builds: bug 630475 - Maemo single locale deb packaging broken

Updates Results

Nexus One [AaronMT]

  • Build:
  • Results: result
  • Notes:

n900 [Ioana]

  • Build:
  • Results: result
  • Notes:
Retrieved from "https://wiki.mozilla.org/index.php?title=QA/Fennec/Milestones/2.0/ReleaseTest/Beta5&oldid=285660"