MozillaWiki

QA/Fennec/Milestones/5.0a2

< QA‎ | Fennec‎ | Milestones
Revision as of 15:33, 16 May 2011 by Adesai (talk | contribs) (→‎5.0 Feature Quality Work)

Fennec 5.0 Aurora Test Plan

Overview

The goal of this Overall Test Plan is to lay out our testing strategy, communicate it to others, and track the status.

All of our releases are tested off of the "Fennec 6.0 Aurora Catch-All Test Run" on the Litmus TCM.

For more information about Fennec 5.0, take a look at the mobile team's Feature Planning page

Project contacts

PM: Stuart Parmenter (stuart)
Build: John Oduinn (oduinn)
QA: Aakash Desai (aakashd)

Schedule

  • Start Date: 4/11/2011
  • End Date: 5/17/2011

Bugs in Release

Build Location and IDs

  1. Go to the nightly builds folder in our ftp directory
  2. Go to the "latest-mozilla-aurora" folder
  3. Download and install the candidate onto your Android phone/device

Features Tracked

Feature Status ETA Owner
Optimized layout and interaction with some mobile web pages (improved position:fixed support) landed

SDR: N || SIR: N

Fx5 Thomas
Add images downloaded in Firefox to the Android Gallery immediately (before: images were visible only after reboot landed

SDR: N || SIR: C - 04/27

Fx5 Thomas
Add a "More" button to the Android Menu when needed) landed

SDR: N || SIR: N

Fx5 Thomas
Fix issue with color conversion for better display of images and video (Fix broken NEON Y'CbCr to RGB conversion) landed

SDR: N || SIR: P 

Fx5 Thomas
Resolves recent breakage that would show an "undefined" error when trying to load web pages while outside of wifi or network coverave (Add remoteXUL strings for Firefox Mobile) landed

SDR: N || SIR: N

Fx5 Thomas
Slight improvement of page load speed, especially on 3G network (e10s HTTP: Implement nsIProgressEventSink:part2) landed

SDR: N || SIR: N

Fx5 Thomas
Add user-visible pref for Do Not Track

SDR: N || SIR: N

landed Fx5 Thomas
Finish new theme styles for dialogs/prompts (prompts and confirms look like android dialogs) landed

SDR: N || SIR: C - 04-27

Fx5 Thomas
Smooth panning (resolves an issue where consecutive pans were a bit jumpy before) landed

SDR: N || SIR: N

Fx5 Thomas


Test Areas

Smoketests

Lite verification tests (or smoketests) will be first run when the builds are ready. Tests are available on litmus under the Fennec 5.0 Test Suite. In any case of failure in any Smoketest, blockers need to be raised ASAP before proceeding to the BFTs.

Please record your detailed results in the "Detailed Test Results" section below.

5.0 Feature Quality Work

Feature Area and Spec Litmus Testcases Needed/Added QA Contact Dev Contact Links
Do Not Track Yes/Yes AaronMT mbrubeck Bug 648654
Improve position:fixed support No/No mw22 romaxa Bug 607417
Tell Android to scan downloaded media No/No nhirata wesj Bug 646550
Handle option overflow in Android menu No/No ashah wesj Bug 610784
Fix broken color conversion No/No Andreea Pod derf Bug 641014
Add remoteXUL strings for Fennec No/No Anna Moldovan volkmar Bug 648268
Slightly improve page load performance No/No nhirata ehsan Bug 561694
Dialogs/Prompts look like Android dialogs No/No Anna Moldovan wesj Bug 618989
Consecutive pans should not be jumpy No/No kbrosnan stechz Bug 639179
No more fullscreen landscape keyboard Yes/Yes nhirata blassey Bug 614355

OS Integration

The Operating System Integration testsuite is a set of tests that target how Fennec works with the platform (i.e. Android, Maemo, etc.) and features of the device itself (i.e. Orientation, hard keyboard, soft keyboard, etc.). Tests are available on litmus under the Fennec 6.0 Test Suite under the "OS Integration Tests" testgroup.

Please record your detailed results in the "Detailed Test Results" section below.

Fixed Bugs Verifications

The following link contains a list of bugs that are fixed for 6.0 and need verifications:

  • Fixed Firefox Mobile 5.0a2 bugs (even verified bugs) should be checked to make sure the fix landed in the Mobile-5.0 Aurora tree.

Automation

QA is undertaking the task of porting the unit tests from Firefox to Fennec for each platform. This is a lengthy task, but our goal is to have 100% unit tests passing by the 6.0 ship.

We have created a tracking system for the unit tests which we update on a regular basis.

Retrieved from "https://wiki.mozilla.org/index.php?title=QA/Fennec/Milestones/5.0a2&oldid=308943"