QA/Firefox3.5/TestPlan

From MozillaWiki
Jump to navigation Jump to search

« Firefox3.1

Top Critical issues for QA

This is a working list that QA is using to request be fixed or completed for the Upcoming Fx3 Milestones.

If you have untracked issues in these areas, please enter them here:

  • Design still incomplete?
  • Major bugs blocking your feature that should be addressed?
  • Major bugs blocking overall regression of the trunk that should be fixed before shipping?

Overview

Firefox 3 QA Test Strategy

The goal of this Overall Test Plan is to lay out our testing strategy, communicate it to others, and track the status.

Major QA Activities:

  • New feature testing - see below
  • L10n testing
  • Milestone testing

Firefox 3.1 Central

Requirements and Scheduling

Test Results

Test Areas

Feature Focused Areas

Key: L = Large (3-6 weeks) M = Medium (2-4 weeks) S = Small (1-2 weeks)

Test Plan Template

Feature Area and Spec Test Plan Location QA Contact Dev Contact Size FF or Platform? Description
Downloadable Fonts (@font-face rule) here Akira, ctalbert jdaggett/zack L Pf
moz-transform (CSS Transform) ? martijn, ctalbert Keith Schwarz L Pf
NPAPI Cocoa Event Model ? marcia Josh Aas L Ff
Places ? Tracy dietrich L Ff
Query Selectors ? martijn, ctalbert bzbarsky@mit.edu L Pf
SVG CSS ? Martijn roc L Pf
WHATWG <canvas> text API ? Tchung ebutler L Pf
Border Image ? martijn, ctalbert robarnold, dbaron M Pf
Cross Site XHR ? bc, ctalbert sicking@mozilla.com M Pf
Drag and Drop of Tabs (to new Windows) ? juanb Bz M Ff
Media Queries ? hasham, ctalbert dbaron M Pf
  • Allows for html to query for a media type based on specific attributes in order to determine which style sheet or style rule to apply
  • Primary Bug: bug 156716
  • spec draft
Native JSON ? Mikeal rsayre@mozilla.com M Pf
Worker Threads ? Adam or bc bent@mozilla.com M Pf
  • currently, everything is on one UI thread. affects performance of browser if its a slow thread. Want Multi-threading
  • look for security sided, extra threads are well scoped.
  • look for browsers immune to threads that are slow in some places
  • Detect areas we can break the platform, regard to threading (eg. mxr causes slow threading, loading of all the text and linkifying and color coding -- all on the main UI thread)
  • bug 437152
  • Status: potential risk, still looking hard
  • WhatWG Specification
AwesomeBar here stephend dietrich/mardak S Ff
Ctrl-Tab Ctrl Tab Test Plan marcia Dao S Ff
Exiting the Browser Experience ? Tomcat ? S Ff ?
  • Need owner
Private Browsing Mode ? Tomcat ? S Ff
  • need owner
  • bug 248970 – global toggle for saving/caching everything
  • at severe risk
Search Text Widget whimboo Dao S Ff
SMIL ? Martijn dholbert S Pf
ACID 3 ? Tomcat Roc or dbaron M Pf
Add-on Update Addons Testplan Tchung/Tomcat ? M Pf
  • bug 445181 – Firefox upgrades don't check for remote extension compatability
  • bug 324121 – Extensions with available updates for the next version of the app should not be listed in app update extension will be disabled warning
  • waiting for rob on review, needs testing
  • bug 421470 – Software update does not download/update even it is set to automatic
  • bug 434155 – Help -> Check for Updates does not verify add-on compatibility
  • bug 434465 – Software update's background add-on update check ignores updated compatibility
  • bug 392180 – Provide force variable to use in the updateURL
  • Plugin blocklist - bug 391714, bug 449027, bug 391728
Memory Leaks Memory Leaks Test Plan Tomcat Tomcat L Pf
  • Checking for memory leaks and asserts on debug builds
Offline/Local Storage ? juanb dcamp Pf
Password Manager to mozStorage here harthur zpao ? Ff
Video Decoders here Tchung, ctalbert, mikeal roc/cdouble? Pf
  • bug 422538 – Ogg Theora backend for HTML5 video element (tracking bug)
  • Core element patch has landed
  • --enable-media on trunk?
  • Ogg Vorbis/Theora backend could get review, but legal issues may block
  • Need to push GStreamer bug 422540 and Quicktime bug 435298 backends to patch submission
  • DirectShow backend playing some movies, needs more work bug 435339
  • Primary bug: bug 382267
  • add on & related bugs: bug 448674, bug 448603
JavaScript 1.8.1 bc brendan Pf
  • bug 429508 - JavaScript 1.9/1.8.1 tracking bug
  • bug 380236 - JavaScript 1.8 tracking bug
  • Currently testing 1.9.1 mozilla-central and 1.9.1 tracemonkey branches.

Regression Areas

  • Top Web accessibility Tests
    • Plugins (eg. Flash, java, AJAX)
    • Extensions (eg. Firebug, NoScript, Fotofox)
    • Themes (eg. Vista, Joga, Simpsons)
    • Top Site Tests (eg. Alexa top 50)
    • Financial Sites (eg. banks, online trading)
  • Accessibility Tests
  • User Performance Testing
  • Major / Minor Update Testing
  • L10N Testing (may coincide with Feature area)
  • Distribution Testing (may coincide with Feature area)

Tiger Team Testing

Daily smoketests are ran against nightly trunk builds. Please see marcia for more information.

Link to Schedule and Assignments

Extensions

The following extensions in the list below will be ran through regression tests during selected milestone releases.

See examples here.

Top Crash reports

The main report is the easiest to view.

Banking and Financial Sites

For these types of sites, we’re asking community members and MoCo QA to state which banks and financial institutions they're willing to test. Please add your name to the list.

L10n Testing with Third Parties

For additional string testing, Mozilla will work with the l10n Team for localization and string testing.

Results link to be posted later.

Review Feedback

In this section, we will roll up all common feedback pulled from external sources that appears common and should be tracked by QA. Feedback sources can include:

Additional References

This section is left to add any additional references relevant to the Firefox 3.1 project

Retrieved from "https://wiki.mozilla.org/index.php?title=QA/Firefox3.5/TestPlan&oldid=104834"