QA/StaffMeetings/QA-Staff-06-23-2010: Difference between revisions

From MozillaWiki
Jump to navigation Jump to search
 
(28 intermediate revisions by 8 users not shown)
Line 11: Line 11:
* Overview (2 min brief update)
* Overview (2 min brief update)
==Desktop Firefox (Juan)==
==Desktop Firefox (Juan)==
* Fx 4
** [https://wiki.mozilla.org/Firefox/Planning/2010-06-23#Schedule_.26_Progress Code freeze: possibly tonight, or tomorrow].
** Where are we in regards to Beta 1 features?
** Estimates: Will we be able to test the functionality scheduled for Beta 1 by next week.
** Must have: list of test cases intended for a wide audience, such that we can share and have people help us test. For example, google docs spreadsheet, etherpad
==Maintenance and Security (Al)==
==Maintenance and Security (Al)==
==Browser Technologies (Tony) ==  
* Firefox 3.6.4 and 3.5.10 shipped yesterday (6/22)
* Code complete for Firefox 3.6.6 and 3.5.11 is scheduled for Friday, 6/25.
** We plan to ship this release before Black Hat at the end of July.
* Current focus is on verifying 1.9.2.6 and 1.9.1.11 bugs and waiting for OOPP bugs to come in.
 
==Browser Technologies (Tony) ==
* Q3 goals [https://intranet.mozilla.org/QA/Q32010_QAgoals#Mobile_QA_Goals defined]
;Mobile
* This week's [https://wiki.mozilla.org/Mobile/Notes/23-Jun-2010#QA notes]
* 1.1 rc is out
* 2.0 code freeze targeting 6/25.  working on flushing out 2.0 testplans (awaiting doc ready)
* android nightlies still busted
;Jetpack
* Sdk 0.5 to ship tomorrow
* Ayan to complete installer check this week
;Sync
* Sync 1.4 will land on trunk this week, {{Bug|571902}} 
* need to confirm this is targeting fx4b2, not b1
;Test pilot
* the feedback extension (input+testpilot) is at 1.0b9, and in testing now
* to test it out, grab from the [http://hg.mozilla.org/labs/testpilot/file/e3cda3db9856 tip in hg]
 
==WebQA (Stephen) ==
==WebQA (Stephen) ==
* Shipped AMO 5.11.2 last night @ 4pm
* Shipped [https://bugzilla.mozilla.org/buglist.cgi?resolution=FIXED&classification=Server%20Software&query_format=advanced&product=addons.mozilla.org&target_milestone=5.11.2 AMO 5.11.2] last night @ 4pm
* On-track to ship SUMO 2.1/1.5.5 tonight @ 4pm
* On-track to ship SUMO [https://bugzilla.mozilla.org/buglist.cgi?resolution=FIXED&classification=Other&query_format=advanced&product=support.mozilla.com&target_milestone=2.1 2.1]/[https://bugzilla.mozilla.org/buglist.cgi?resolution=FIXED&classification=Other&query_format=advanced&product=support.mozilla.com&target_milestone=1.5.5 1.5.5] tonight @ 4pm
* Shipping [https://bugzilla.mozilla.org/buglist.cgi?classification=Server%20Software&query_format=advanced&product=addons.mozilla.org&target_milestone=5.11.3 AMO 5.11.3] next Tuesday
* We're testing the [http://www-trunk.stage.mozilla.com/en-US/firefox/beta/ Firefox 4 beta pages]
* Launching the [http://studentreps.stage.mozilla.com/en/ Student Reps mini-site] next Tuesday
* [http://weblogs.mozillazine.org/stephend/archives/2010/06/ive_alluded_to.html Blogged] about our automation setup/efforts


==QA Services (Marcia)==
==QA Services (Marcia)==


*Crash/Feedback Analysis
*Crash/Feedback Analysis
**Awaiting feedback from the 3.6.4 release. https://wiki.mozilla.org/Releases/Firefox_3.6.4/RRRT will track feedback
**Awaiting feedback from the 3.6.4 release. https://wiki.mozilla.org/Releases/Firefox_3.6.4/RRRT will track possible issues. If YOU see any pattern for a issue, let me (-> Tomcat) as RRRT TeamLead now.
**Continue efforts to have bugs on file for top 20 trunk crashes. Continuously monitoring new crashes as bugs are checked in.
**Continue efforts to have bugs on file for top 20 trunk crashes. Continuously monitoring new crashes as patches are checked in.
*Accessibility
**Since the Tuesday nightly build, Firefox 4 with accessibility and NVDA or Orca as the screen readers loads pages like [http://www.blindcooltech.com BlindCoolTech] faster by 30% compared to Monday's nightly, even 3 times faster than Firefox 3.6.x (2 seconds instead of 3 and 6 respectively).
**Other perf and memory improvements landed last week that make Firefox 4 with accessibility use less memory and hopefully stopped a memory leak that could hit under certain not even rare conditions when closing tabs.
**Also have landed 1 accessibility crash fix for 3.6.6 {{bug|529192}}, primarily important for Thunderbird 3.1.1 since they already took this patch on their relbranch. Also have another patch in the pipeline that just landed on m-c which we want to get into 1.9.2 which will fix a long-standing issue with Thunderbird when tabbing from the message body to the subject field and vice versa ({{bug|503428}}).
*Mozilla Summit
*Mozilla Summit
**https://wiki.mozilla.org/Summit2010/Schedule is up. Newsletter indicating we will know more about which proposals were submitted on June 28
**https://wiki.mozilla.org/Summit2010/Schedule is up. Newsletter indicating we will know more about which proposals were submitted on June 28
Line 33: Line 68:


==Test Automation(Henrik)==
==Test Automation(Henrik)==
* Mozmill Tests
** New tests: 2 BFT tests
** Shared Modules: 4 enhancements / fixes (Update tests, non modal Windows)
** Fixes: 14 fixes
** Status 3.5/3.6: Todays test-run is green for nearly all vm's
** Status 3.7: About 6 broken tests still to fix
** Still investigating mystical hangs
** License updates to Public Domain
** Started to use/create local test cases (litmus data)
* L10n: Adrian will fully start next week
* [https://wiki.mozilla.org/QA/Mozmill_Test_Automation/Results_Data Test result data] project: Finished design phase, needs implementation for Mozmill
* Mozmill Crowd extension: UI ready, working on backend (can already spawn a Mozmill test-run)
* [https://intranet.mozilla.org/QA/Q32010_QAgoals#Automation_QA_Goals Q3 goals] ([https://spreadsheets.google.com/ccc?key=tzAunY5EJuoF5cZqKOlMbDA#gid=0 complete list] of goals)


= Discussion Items =  
= Discussion Items =  
* Director's goals discussion update (matt)
* Director's goals discussion update (matt)
*
** '''update''' QA got an A- rating!  Special attention to outsourcing, QMO2, and improved developer-qa communication.  Litmus 2 was a big miss, and promised more attention next quarter by testdev
* [https://intranet.mozilla.org/2010Q3Goals#QA Q3 Goals] (company intranet)
** '''discussion''' Firefox 4 is the company goal
** re-emphasize continuous testing on nightlies
** crowdsourcing and community building focus (target summit folks to start, QMO to be a larger use of the platform)
** more attention on web compatibility level of testing
*How to test Fx 4 Beta 1? (juanb)
** Usually
*** BFTs across the board
** Feature Testing
*** Anything that is ready for Beta 1 should be tested, between now and July 1st
*** If we have more time and resources: BFTs (outsourced?)
** [https://spreadsheets.google.com/ccc?key=0Aquwp3mZwJu2dGRzTjdteDJTTi0yRTV1azNrbmY2SGc&hl=en Website compatibility] suites
*** Need to categorize by types of sites (email, video, banking, social, etc...)
*** Need to come up with list of most popular, high priority


= Round Table =
= Round Table =
Line 50: Line 111:
  | style="background: rgb(239, 239, 239); width: 33%" | '''Done?'''
  | style="background: rgb(239, 239, 239); width: 33%" | '''Done?'''
  |- valign="top"
  |- valign="top"
| Fx4 Beta 1 Features Testing
| Everyone with a feature scheduled for b1 or alpha5
| Feature must be tested by end of the week next week
|
|- valign="top"
| Fx4 Beta 1 Test Plan Draft
| juanb
| today
|
  |}
  |}

Latest revision as of 21:19, 23 June 2010

« previous mtg | QA Staff Home | next mtg »

QA Staff Meeting Notes June 23, 2010

New Hires

  • Welcome Aaron Train as a consultant working remotely from Toronto

Project Status

  • Overview (2 min brief update)

Desktop Firefox (Juan)

  • Fx 4
    • Code freeze: possibly tonight, or tomorrow.
    • Where are we in regards to Beta 1 features?
    • Estimates: Will we be able to test the functionality scheduled for Beta 1 by next week.
    • Must have: list of test cases intended for a wide audience, such that we can share and have people help us test. For example, google docs spreadsheet, etherpad

Maintenance and Security (Al)

  • Firefox 3.6.4 and 3.5.10 shipped yesterday (6/22)
  • Code complete for Firefox 3.6.6 and 3.5.11 is scheduled for Friday, 6/25.
    • We plan to ship this release before Black Hat at the end of July.
  • Current focus is on verifying 1.9.2.6 and 1.9.1.11 bugs and waiting for OOPP bugs to come in.

Browser Technologies (Tony)

Mobile
  • This week's notes
  • 1.1 rc is out
  • 2.0 code freeze targeting 6/25. working on flushing out 2.0 testplans (awaiting doc ready)
  • android nightlies still busted
Jetpack
  • Sdk 0.5 to ship tomorrow
  • Ayan to complete installer check this week
Sync
  • Sync 1.4 will land on trunk this week, bug 571902
  • need to confirm this is targeting fx4b2, not b1
Test pilot
  • the feedback extension (input+testpilot) is at 1.0b9, and in testing now
  • to test it out, grab from the tip in hg

WebQA (Stephen)

QA Services (Marcia)

  • Crash/Feedback Analysis
    • Awaiting feedback from the 3.6.4 release. https://wiki.mozilla.org/Releases/Firefox_3.6.4/RRRT will track possible issues. If YOU see any pattern for a issue, let me (-> Tomcat) as RRRT TeamLead now.
    • Continue efforts to have bugs on file for top 20 trunk crashes. Continuously monitoring new crashes as patches are checked in.
  • Accessibility
    • Since the Tuesday nightly build, Firefox 4 with accessibility and NVDA or Orca as the screen readers loads pages like BlindCoolTech faster by 30% compared to Monday's nightly, even 3 times faster than Firefox 3.6.x (2 seconds instead of 3 and 6 respectively).
    • Other perf and memory improvements landed last week that make Firefox 4 with accessibility use less memory and hopefully stopped a memory leak that could hit under certain not even rare conditions when closing tabs.
    • Also have landed 1 accessibility crash fix for 3.6.6 bug 529192, primarily important for Thunderbird 3.1.1 since they already took this patch on their relbranch. Also have another patch in the pipeline that just landed on m-c which we want to get into 1.9.2 which will fix a long-standing issue with Thunderbird when tabbing from the message body to the subject field and vice versa (bug 503428).
  • Mozilla Summit
  • QA Videos
    • Some feedback that QA promotional video was too MV-Centric and needs to be more global in nature
  • Upcoming Conferences, Events and Events

Test Automation(Henrik)

  • Mozmill Tests
    • New tests: 2 BFT tests
    • Shared Modules: 4 enhancements / fixes (Update tests, non modal Windows)
    • Fixes: 14 fixes
    • Status 3.5/3.6: Todays test-run is green for nearly all vm's
    • Status 3.7: About 6 broken tests still to fix
    • Still investigating mystical hangs
    • License updates to Public Domain
    • Started to use/create local test cases (litmus data)
  • L10n: Adrian will fully start next week
  • Test result data project: Finished design phase, needs implementation for Mozmill
  • Mozmill Crowd extension: UI ready, working on backend (can already spawn a Mozmill test-run)
  • Q3 goals (complete list of goals)

Discussion Items

  • Director's goals discussion update (matt)
    • update QA got an A- rating! Special attention to outsourcing, QMO2, and improved developer-qa communication. Litmus 2 was a big miss, and promised more attention next quarter by testdev
  • Q3 Goals (company intranet)
    • discussion Firefox 4 is the company goal
    • re-emphasize continuous testing on nightlies
    • crowdsourcing and community building focus (target summit folks to start, QMO to be a larger use of the platform)
    • more attention on web compatibility level of testing
  • How to test Fx 4 Beta 1? (juanb)
    • Usually
      • BFTs across the board
    • Feature Testing
      • Anything that is ready for Beta 1 should be tested, between now and July 1st
      • If we have more time and resources: BFTs (outsourced?)
    • Website compatibility suites
      • Need to categorize by types of sites (email, video, banking, social, etc...)
      • Need to come up with list of most popular, high priority

Round Table

Takeaways and Action Items

Item Owner Due Done?
Fx4 Beta 1 Features Testing Everyone with a feature scheduled for b1 or alpha5 Feature must be tested by end of the week next week
Fx4 Beta 1 Test Plan Draft juanb today
Retrieved from "https://wiki.mozilla.org/index.php?title=QA/StaffMeetings/QA-Staff-06-23-2010&oldid=233157"