QA/Fennec/Waverley: Difference between revisions

From MozillaWiki
< QA‎ | Fennec
Jump to navigation Jump to search
 
(104 intermediate revisions by 5 users not shown)
Line 212: Line 212:
| '''Verified bugs'''
| '''Verified bugs'''
| '''TC added'''
| '''TC added'''
|-
|-
| 09/10/12
| 10/18/12
| Firefox Mobile 15.0.1 build 2
| Firefox for Android 17.0b2 build2 2012-10-18
Samsung Galaxy Tab 2 7.0 (Android 4.0.4)/ Samsung Galaxy R (Android 2.3.4)
*Samsung Galaxy R (Android 2.3.4)
*Acer A500 (Android 3.2.1)
|
|
* Smoke and exploratory testing on RC - Android 4.0.4 (adrian.tamas)
* Smoketests, Bug verification and Exploratory on Firefox for Android 17.0b2 build2 (2012-10-18) (paul.feher)
** [https://moztrap.mozilla.org/results/cases/?filter-run=151 phone results]
**[https://moztrap.mozilla.org/results/cases/?filter-run=272 MozTrap smoketest results for ARMv7]
** [https://moztrap.mozilla.org/results/cases/?filter-run=150 tablet results]
**[https://moztrap.mozilla.org/results/cases/?filter-run=271 MozTrap smoketests results for Tablet]
|
|
|{{Bug|789885}}, {{Bug|789888}}
|
|
|{{bug|798942}}, {{bug|787188}}
|
|
|-
|-
| 09/10/12
| 10/18/12
| Firefox Mobile 15.0.1 build 2
| Firefox for Android 17.0b2 build2 Samsung Galaxy Nexus (Android 4.1.1)
Samsung Galaxy Tab (Android 3.1)/ HTC Desire Z (Android 2.3.3)
|
|
* Smoke and exploratory testing on RC - Android 3.1 (paul.feher)
* Smoketests and exploratory on Firefox for Android 17.0b2 build2 - Android 4.1.1, Android 3.1, Android 2.3.4, ARMv6 (andreea.pod)
** [https://moztrap.mozilla.org/results/cases/?filter-run=151 phone results]
* [https://moztrap.mozilla.org/results/cases/?filter-run=272 Smoke on phone]
** [https://moztrap.mozilla.org/results/cases/?filter-run=150 tablet results]
* [https://moztrap.mozilla.org/results/cases/?filter-run=271 Smoke on tablet]
|
|
|{{Bug|789926}}
|{{bug|803024}}
|
|
|
|
|-
|-
| 09/11/12
| 10/23/12
| Firefox Mobile Nightly 18.a1 2012-09-11
| Firefox for Android 17.0b3 build1 Samsung Galaxy R (Android 2.3.4)
Samsung Galaxy Tab 2 7.0 (Android 4.0.4)
Acer A500 (Android 3.2.1)
|
|
* Qawanted Bugs and Bug Fix/Verification - Android 4.0.4 (paul.feher)
* Smoketests and Exploratory on Firefox for Android 17.0b3 build1 - Android 2.3.4,Android 3.2.1 ARMv7 (paul.feher)
* [https://moztrap.mozilla.org/results/cases/?filter-run=281 MozTrap smoketest results for ARMv7]
* [https://moztrap.mozilla.org/results/cases/?filter-run=279 MozTrap smoketests results for Tablet]
|
|{{bug|804964}}
|
|
|{{Bug|790245}}
|{{Bug|703279}}
|
|
|-
|-
| 09/11/12
| 11/01/12
| Firefox Mobile Nightly 18.a1 2012-09-11
| Firefox for Android 17.0b3 build1 Samsung Galaxy R (Android 2.3.4)
Samsung Galaxy Ace  (Android 2.3.6)
Acer A500 (Android 3.2.1)
LG Slider (Android 2.3.4)
|
| ARMv6 Compatibility (ioana.chiorean)
* Smoketests and Permissions on Firefox for Android 17.0b4 build1 - Android 2.3.4,Android 3.2.1 ARMv7 (paul.feher)
* [https://moztrap.mozilla.org/results/cases/?filter-run=301 MozTrap smoketest results for ARMv7]
|
|
|
|
Line 259: Line 260:
|
|
|-
|-
| 09/11/12
| 11/01/12
| Firefox for Android (18.0a1)
| Firefox for Android 17.0b3 build1 Samsung Galaxy S2 (Android 4.0.4)
Samsung Galaxy Note (Android 4.0.4)
|
* Smoketests and Exploratory on Firefox for Android 17.0b4 build1 - Android 4.0.4 ARMv7 (adrian.tamas)
* [https://moztrap.mozilla.org/results/cases/?filter-run=301 MozTrap smoketest results for ARMv7]
|
|
|
* Bug verification & Exploratory (nicolae.cristian)
|
|
|{{Bug|790210}}, {{Bug|790219}}
|{{Bug|787416}}, {{Bug|771575}}, {{Bug|786240}}, {{Bug|790055}}, {{Bug|787497}}, {{Bug|757489}}, {{Bug|786380}}, {{Bug|768268}}, {{Bug|770912}}, {{Bug|779920}}
|
|
|-
|-
| 09/11/12
| 11/07/12
| Samsung Galaxy Tab 2 7.0 (Android 4.0.4)/ Samsung Galaxy R (Android 2.3.4)
| Smoke tests & Run BFT on Mobile Firefox for Android 17 Beta 5 build 1 Tablet Acer A500 (Android 3.2.1)
|
|
* Created Robocop automated test case for the Add-on Manager (adrian.tamas)
* Smoketests and BFT's on Firefox for Android 17.0b5 build1 - Android 3.2.1 ARMv7 (paul.feher)
* [https://moztrap.mozilla.org/results/cases/?filter-run=319 MozTrap smoketest results for Tablets]
* [https://moztrap.mozilla.org/results/cases/?filter-run=320 MozTrap BFT's results for Tablets]
|
|
|
|
Line 278: Line 281:
|
|
|-
|-
| 09/12/12
| 11/08/12
| Samsung Galaxy Tab 2 7.0 (Android 4.0.4)/ Samsung Galaxy R (Android 2.3.4)
| Bug verification & Run BFT on Mobile Firefox for Android 17 Beta 5 build 1 Tablet Acer A500 (Android 3.2.1)
|
|
* Created Robocop automated test case for Opening the AMO page from the Add-on Manager (adrian.tamas)
* Smoketests and BFT's on Firefox for Android 17.0b5 build1 - Android 3.2.1 ARMv7 (paul.feher)
* [https://moztrap.mozilla.org/results/cases/?filter-run=319 MozTrap smoketest results for Tablets]
* [https://moztrap.mozilla.org/results/cases/?filter-run=320 MozTrap BFT's results for Tablets]
|
|
|
|
|{{bug|801627}}
|
|-
| 11/09/12
| Virtual Keyboard and IME  verification around bug 805162 Tablet Samsung Galaxy Tab (Android 3.1)
|
* QA-wanted bug investigation and Virtual Keyboard and IME  verification around bug 805162 - Android 3.1 ARMv7 (paul.feher)
|
|{{bug|810291}}, {{bug|810284}}, {{bug|810236}}, {{bug|810266}}
|
|
|
|
|-
|-
| 09/12/12
| 11/12/12
| Firefox Mobile Nightly 18.a1 2012-09-12
| Virtual Keyboard and IME  verification around bug 805162 Tablet Samsung Galaxy Tab (Android 3.1)
Samsung Galaxy Tab (Android 3.1)
|
|
* Regression-wanted Bugs, Bug Fix/Verification  and Smoke Test on Nightly 18.a1 2012-09-12 - Android 3.1 (paul.feher)
* QA-wanted bug investigation and Virtual Keyboard and IME verification around bug 805162 - Android 3.1 ARMv7 (paul.feher)
** [https://moztrap.mozilla.org/results/cases/?filter-run=154 Smoke Test results]
|
|
|{{bug|810792}}, {{bug|810816}}
|
|
|{{Bug|789791}}
|
|
|-
|-
| 09/12/12
| 11/13/12
| Firefox for Android (18.0a1)
| QA-wanted bug investigation, Regression-window and Exploratory on Samsung Galaxy R (Android 2.3.4)
Samsung Galaxy Note (Android 4.0.4)
|
|
* Bug verification, Unconfirmed bugs & Exploratory (nicolae.cristian)
* QA-wanted bug investigation, Regression-window and Exploratory - Android 2.3.4 ARMv7 (paul.feher)
|
|{{bug|811238}}, {{bug|811231}}, {{bug|811304}}
|
|
|{{Bug|790563}}
|{{Bug|786073}}, {{Bug|788119}}, {{Bug|760229}}, {{Bug|788609}}, {{Bug|733149}}, {{Bug|765213}}, {{Bug|733842}}, {{Bug|721214}}, {{Bug|710683}}, {{Bug|708745}}, {{Bug|787060}}
|
|
|-
|-
| 09/13/12
| 11/14/12
| Firefox for Android (16.0b3)
| Smoke tests & Run BFT on Mobile Firefox for Android 17 Beta 6 build 1 Samsung Galaxy Tab (Android 3.1.1)
Samsung Galaxy Note (Android 4.0.4)
|
* Smoketests and BFT's on Firefox for Android 17.0b6 build1 - Android 3.1.1 ARMv7 (paul.feher)
* [https://moztrap.mozilla.org/results/cases/?filter-run=328 MozTrap smoketest results for Phones]
* [https://moztrap.mozilla.org/results/cases/?filter-run=330 MozTrap smoketest results for Tablets]
|
|{{bug|811707}}
|
|
|-
| 11/15/12
| Bug triage and Exploratory on Samsung Galaxy R (Android 2.3.4)
|
* Bug triage and Exploratory - Android 2.3.4 ARMv7 (paul.feher)
|
|{{bug|812118}}
|
|
|-
| 11/16/12
| Bug triage and Smoke tests on Mobile Firefox for Android 17 Beta 7 build 1 Samsung Galaxy Tab (Android 3.1.1)
|
* Bug triage and Smoketests on Firefox for Android 17.0b7 build1 - Android 3.1.1 ARMv7 (paul.feher)
* [https://moztrap.mozilla.org/results/cases/?filter-run=390 MozTrap smoketest results for Tablets]
|
|
|
* BFTs (nicolae.cristian)
** [https://moztrap.mozilla.org/results/cases/?filter-run=157 phone results]
|
|
|{{Bug|790880}}, {{Bug|790898}}, {{Bug|790920}},{{Bug|790974}}
|{{Bug|785731}}, {{Bug|763396}}
|
|
|-
|-
| 09/13/12
| 11/19/12
| Firefox Mobile 16.0b3
| Bug triage and Smoke tests on Mobile Firefox 17.0 RC Samsung Galaxy R (Android 2.3.4)
Samsung Galaxy Tab 2 7.0 (Android 4.0.4)
|
|
* BFTs on Beta (adrian.tamas)
* Bug triage and Smoketests on Mobile Firefox 17.0 RC Samsung Galaxy R - Android 2.3.4 ARMv7 (paul.feher)
** [https://moztrap.mozilla.org/results/cases/?filter-run=159 Tablet BFTs Results]
* [https://moztrap.mozilla.org/results/cases/?filter-run=396 MozTrap smoketest results for Phones]
** [https://moztrap.mozilla.org/results/cases/?filter-run=158 Tablet Smoke Results]
|
|
|{{Bug|790897}}, {{Bug|790931}}, {{Bug|790877}},{{Bug|790900}},{{Bug|790983}}
|
|
|{{bug|802549}}
|
|
|}
|}

Latest revision as of 15:48, 19 November 2012

Weekly Meetings

Conference room details will vary team, but they will be held at 8am on Tuesdays.

Tuesdays, 8am PT / 4pm GMT
All-Team Meeting
Dial in: 800-707-2533
Password 369, conference #245
Tuesdays, 8am PT / 4pm GMT
Firefox (Desktop Firefox): Juan Becerra
Dial in: 650-903-0800 (US), x92 then 9 and extension number 262
Or: 800-707-2533, pin 369, then 9 and extension number 262
Tuesdays, 8am PT / 4pm GMT
Automation WebQA
Dial in: 800-707-2533
Password 369, conference #
Mondays, 8am PT / 4pm GMT
Desktop Automation
Dial in: 800-707-2533
Password 369, conference #654
Tuesdays, 8am PT / 4pm GMT
Fennec
Dial in: 800-707-2533
Password 369, conference #

Every two weeks we will hold meetings to go over highlights with all the teams. The time for this meeting has not yet been decided.

All-Team Meetings

  • Bi-weekly Team Agenda
    • We will hold bi-weekly meetings to catch up on work from all teams. Time and format to be decided.


Individual Team Meetings


Desktop

Mobile

WebQA Manual

  • (Park your URL accordingly and use the template above)


Desktop Automation
Date Summary
2011-11-14 Release automation execution, Failing Test policy, Pivotal Tracker usefulness
2011-10-04 Q3 Goals Review, Q4 Goals Proposal, Discovery Pane and Places tests

Mozilla Stand-Up Rotation

Mozilla Mobile team will participate in a rolling standup that Waverley Mobile holds every week

  • URL: https://mozqa.sync.in/mozbtech-standup-<Friday Date>
  • Dial in: 800-707-2533, password 369, conference #245
  • When: Every Thursday, 5:30pm - 5:45pm Romanian Time (7:30am PST, 10:30am EST)
  • Rotation:
    • Tony - Jan 5, 2012
    • Kevin - Jan 12
    • Aaron - Jan 19
    • Naoki - Jan 26
    • Martijn - Feb 2
    • Tony - Feb 9
    • Kevin - Feb 16
    • Aaron - Feb 23
    • Naoki - Mar 1
    • Martijn - Mar 8
    • Tony...Kevin... Aaron... Etc..

Team Members

Name Contact IRC Nickname Availability Project Assignments
Ioana Chiorean ioana.chiorean@softvision.ro ioanachiorean Contractor
Andreea Pod andreea.pod@softvision.ro AndreeaPod Contractor
Nicolae Cristian nicolae.cristian@softvision.ro xti Contractor
Catalin Suciu catalin.suciu@softvision.ro CataSuciu Contractor
Adrian Tămaș adrian.tamas@softvision.ro AdrianT Contractor
Paul Feher paul.feher@softvision.ro PaulFeher Contractor

Top issues

Bugs blocking Fennec 2.0b2

Get Setup

Register Accounts

  • Guide on how to install/update Mobile Firefox nightly builds, Clear your Profile and Uninstall can be found here
  • Go to Litmus, register an account.
  • Go to Bugzilla, register an account. In the future, to file a bug you can fill out this form: File a Bug.
  • Register for edit privileges for wiki.mozilla.org. See Account Creation

Communication

Run Testcases

From here, there's a number of testgroups available to run testcases on:

Run Smoketests

  1. Click on the Smoketest Testgroup
  2. Run the testcases in "Install and Startup"
  3. Run the testcases in "Functionality"
  4. Run the testcases in "Uninstall"

Run BFTs (Basic Functional Tests)

  1. Click on the Basic Functional Test Testgroup
  2. Run the testcases in each subgroup

Results

Date Build Identifier Testcases Run Non-Reproducible Issues Found Bugs Filed Verified bugs TC added
10/18/12 Firefox for Android 17.0b2 build2 2012-10-18
  • Samsung Galaxy R (Android 2.3.4)
  • Acer A500 (Android 3.2.1)
bug 798942, bug 787188
10/18/12 Firefox for Android 17.0b2 build2 Samsung Galaxy Nexus (Android 4.1.1)
  • Smoketests and exploratory on Firefox for Android 17.0b2 build2 - Android 4.1.1, Android 3.1, Android 2.3.4, ARMv6 (andreea.pod)
  • Smoke on phone
  • Smoke on tablet
bug 803024
10/23/12 Firefox for Android 17.0b3 build1 Samsung Galaxy R (Android 2.3.4)

Acer A500 (Android 3.2.1)

bug 804964
11/01/12 Firefox for Android 17.0b3 build1 Samsung Galaxy R (Android 2.3.4)

Acer A500 (Android 3.2.1)

11/01/12 Firefox for Android 17.0b3 build1 Samsung Galaxy S2 (Android 4.0.4)
11/07/12 Smoke tests & Run BFT on Mobile Firefox for Android 17 Beta 5 build 1 Tablet Acer A500 (Android 3.2.1)
11/08/12 Bug verification & Run BFT on Mobile Firefox for Android 17 Beta 5 build 1 Tablet Acer A500 (Android 3.2.1) bug 801627
11/09/12 Virtual Keyboard and IME verification around bug 805162 Tablet Samsung Galaxy Tab (Android 3.1)
  • QA-wanted bug investigation and Virtual Keyboard and IME verification around bug 805162 - Android 3.1 ARMv7 (paul.feher)
bug 810291, bug 810284, bug 810236, bug 810266
11/12/12 Virtual Keyboard and IME verification around bug 805162 Tablet Samsung Galaxy Tab (Android 3.1)
  • QA-wanted bug investigation and Virtual Keyboard and IME verification around bug 805162 - Android 3.1 ARMv7 (paul.feher)
bug 810792, bug 810816
11/13/12 QA-wanted bug investigation, Regression-window and Exploratory on Samsung Galaxy R (Android 2.3.4)
  • QA-wanted bug investigation, Regression-window and Exploratory - Android 2.3.4 ARMv7 (paul.feher)
bug 811238, bug 811231, bug 811304
11/14/12 Smoke tests & Run BFT on Mobile Firefox for Android 17 Beta 6 build 1 Samsung Galaxy Tab (Android 3.1.1) bug 811707
11/15/12 Bug triage and Exploratory on Samsung Galaxy R (Android 2.3.4)
  • Bug triage and Exploratory - Android 2.3.4 ARMv7 (paul.feher)
bug 812118
11/16/12 Bug triage and Smoke tests on Mobile Firefox for Android 17 Beta 7 build 1 Samsung Galaxy Tab (Android 3.1.1)
11/19/12 Bug triage and Smoke tests on Mobile Firefox 17.0 RC Samsung Galaxy R (Android 2.3.4) bug 802549


Other useful stuff

Testplan for the next release

Meetings

Waverley/Mozilla Office Hours

There will be a short meeting daily on IRC/gTalk/Phone explaining status and mentioning any issues.

Details:

  • Daily @ 8AM
  • +1.641.715.3200 x120740
  • IRC: #mobile

Waverley/Mozilla Status Meetings

There will be a meeting weekly to discuss the general status of Tests Run over the past week and goals for the upcoming week.

Details:

  • Tuesdays @ 8am, 6:00pm Romania
  • 650-903-0800 or 650-215-1282 x92 Conf# 245 (US/INTL)
  • 1-800-707-2533 (pin 369) Conf# 245 (US)
  • Backchannel: #mobile

Mozilla Mobile Engineering Meeting

There will be a meeting each week to discuss the general status of Mobile. Please use #mobile, dev-platforms-mobile@mozilla.org or mozilla.dev.platforms.mobile for communication

Meeting Details:

  • Wednesdays @ 9:30AM PST
  • +1 650-903-0800 (US/Intl) x92 conference number 8605#
  • +1 800 707 2533 (US) pin 369 conference number 8605#
  • #mobile for backchannel

Resources

Contacts

  • Aakash Desai: email, [irc: aakashd]
  • Patti Gosselin: email, [irc: PattiG]
  • Matt Evans: email, [irc: mevans]