QA/StaffMeetings/QA-Staff-03-30-2011: Difference between revisions

From MozillaWiki
Jump to navigation Jump to search
No edit summary
 
(38 intermediate revisions by 14 users not shown)
Line 6: Line 6:


== Upcoming Test Events ==
== Upcoming Test Events ==
* Friday, April 1st: [http://quality.mozilla.org/events/2011/03/28/unconfirmed-bug-triage-for-firefox-4/ Unconfirmed Firefox 4 Bugs bugday] (juanb)


= Project Status  =
= Project Status  =
Line 13: Line 14:
== Desktop Firefox (Juan)  ==
== Desktop Firefox (Juan)  ==


*  
* Fx-Next:
** April 12, mozilla-experimental
** How do we assure quality in new releases, brainstorm: http://mozqa.sync.in/faster-firefox-releases


== Maintenance and Security (Al)  ==
== Maintenance and Security (Al)  ==
 
* Firefox 3.5.19 and 3.6.16 moved out to April 26 for release to coincide with Firefox 4.0.1 (or whatever we call it).
* {{bug|646054}} causing complications since it breaks 3.6 advertised major updates to 4.0.1.
** Firefox 3.6.16 needs to ship and be used by people before they can get an advertised (prompted) 4.0.1 update.
** This has potential schedule repercussions since people may not want to wait until early May for 4.0.1 prompted updates.


== Browser Technologies (Tony)  ==
== Browser Technologies (Tony)  ==
Line 27: Line 33:
** Sync out to the world in Fx4
** Sync out to the world in Fx4
*** Approximately 2% of downloads are creating new Sync accounts.  We hit 1 million ADU's earlier this week.
*** Approximately 2% of downloads are creating new Sync accounts.  We hit 1 million ADU's earlier this week.
** scl2 currently holding up well in the round robin of new user accounts
** Servers are  holding up well with scl2 in the round robin of new user accounts
*** New users we're being added at 1-2 per second. Server ops had prepared to handle well above that rate.


*Test pilot (tracy)
*Test pilot (tracy)
Line 33: Line 40:


*Jetpack (ayan)
*Jetpack (ayan)
 
** SDK 1.0b4 released last thursday.
** Flightdeck 0.9.1 push delayed last week. Rescheduled for tomorrow.
** Selenium scripts on github now.


*Firefox Home (tony)
*Firefox Home (tony)
** more work developing and specs are forming.  nothing to test yet.


== WebQA (Stephen)  ==
== WebQA (Stephen)  ==
Line 44: Line 54:


=== FF Engagement Projects  ===
=== FF Engagement Projects  ===
*[http://twitterparty.mozilla.org/en-US Twitterparty] desktop went live 3/21
**Twitterparty mobile went live 3/29
*[https://www.facebook.com/Firefox Facebook badges] went live 3/22
**Updated for mobile release - went live 3/29
* Now working on:
** WebifyMe
** Signatures/MarkUp
** "Influencer"


=== MDN  ===
=== MDN  ===
*0.9.4  planning for late April Release
*[https://bugzilla.mozilla.org/buglist.cgi?classification=Other&query_format=advanced&product=Mozilla%20Developer%20Network&target_milestone=0.9.4 0.9.4] planning for late April Release


=== Mozilla.com  ===
=== Mozilla.com  ===
*[http://bit.ly/i2mXw1 fx4Launch] shipped
*[http://bit.ly/gGvz9D fx4MobileLaunch] shipped


=== Web of Wonder ===
=== Web of Wonder ===
*[http://bit.ly/etW0KN shipped] mobile version last week


===Spark===
===Spark===
* [http://bit.ly/idpIz4 shipped] Spark on Monday


=== Socorro  ===
=== Socorro  ===
*[http://goo.gl/3L3mh 1.7.7] slated for 4.15.11 release


=== SUMO  ===
=== SUMO  ===
* [http://moxie.jamessocol.com/bugstats/sumo/2.7 SUMO 2.7] release, first installment of Users and Groups, slated to release 3/31


=== WebQA Automation  ===
=== WebQA Automation  ===
* Held a Test Day yesterday and have picked up a new contributor
* Held a [http://quality.mozilla.org/events/2011/03/23/upcoming-event-webqa-automation-test-day/ Test Day] yesterday and have picked up a new contributor


== Input ==  
== Input ==
* 500s still plaguing us - with IT
 
* [http://goo.gl/VIBf2 3.4] release slated for 4/12
* [https://bugzilla.mozilla.org/show_bug.cgi?id=636173 500s still plaguing us] - with IT  
* Test day was a success
* Test day was a success
** Three new tests pending!


== AMO ==  
== AMO ==  
* 500s still plaguing us - with IT
* [https://bugzilla.mozilla.org/show_bug.cgi?id=645739 500s still plaguing us] - with IT
 
== SUMO ==
* [https://bugzilla.mozilla.org/show_bug.cgi?id=646211 Investigating 500 errors on staging] with IT


== QA Services (Marcia)  ==
== QA Services (Marcia)  ==
Line 75: Line 107:


* Community Planning  
* Community Planning  
** There will be a session next week during the Work Week related to Community Planning and Brainstorming
** There will be a session next week during the Work Week related to Community Planning and Brainstorming. Target day will be Wednesday and room information should be available when the whiteboard comes up on Monday AM.
 
* Video Work
** Rainer is back and we are discussing plans for other video work in this quarter. We will likely produce one video from Mozilla Summit footage.


* Accessibility (Marco):  
* Accessibility (Marco):  


*QMO.next (Al):
*QMO.next (Al):
** Waiting for a review on QMO 4.0 plan from Morgamic.
** We need people to get forums for their teams every couple of days, please.


== Test Automation (Henrik)  ==
== Test Automation (Henrik)  ==
;General  
;General  
* [http://www.hskupin.info/2011/03/24/mozmill-crowd-0-1-2-released/ MozMill Crowd 0.1.2] has been released
* Dashboard now also covers results for add-on tests


;Mozmill  
;Mozmill  
* No updates
* Some issues have been found which requires another 1.5.x release; expected later this week or early next week


;Project updates
;Project updates
* [https://wiki.mozilla.org/QA/Mozmill_Test_Automation/On_Demand_Update_Testing On Demand Updates]
* [https://wiki.mozilla.org/QA/Mozmill_Test_Automation/On_Demand_Update_Testing On Demand Updates]
** Deployed on qa-set
** Added ability to target a single platform for test runs/re-runs


* [[QA/Mozmill_Test_Automation/Endurance_Tests|Endurance Tests]]
* [[QA/Mozmill_Test_Automation/Endurance_Tests|Endurance Tests]]
** Dashboard for endurance went live ahead of testday
** Blog post: [http://blargon7.com/2011/03/running-endurance-tests-with-mozmill-crowd/ Running endurance tests with Mozmill Crowd]


* [https://wiki.mozilla.org/QA/Mozmill_Test_Automation/Panorama_Testing#Overview Panorama] (ashughes)  
* [https://wiki.mozilla.org/QA/Mozmill_Test_Automation/Panorama_Testing#Overview Panorama] (ashughes)
** 3 LANDED, 5 IN-REVIEW, 1 PENDING, 13 BLOCKED
** Pushing hard to get as much done as we can
** Likely won't achieve goal of 50%
** Given recent distractions and natural overhead 25% is more realistic


* [https://wiki.mozilla.org/QA/Mozmill_Test_Automation/Shared_Modules_Refactor Shared Module Refactoring]
* [https://wiki.mozilla.org/QA/Mozmill_Test_Automation/Shared_Modules_Refactor Shared Module Refactoring]
** Work continues, with L10N and preference handling added
** Test porting continues to build UI proxy classes


;Events
;Events
* Mozmill and Mozmill Crowd testday planned on Friday, March 25th
* Endurance/Mozmill Crowd testday Friday, March 25th: [http://quality.mozilla.org/qmo-news/2011/03/28/results-of-the-mozmill-crowd-testday/ results]
** 11 General testruns across 3 locales producing over 1409 results
** 11 l10n testruns across 7 locales producing 44 results
** 331 Endurance testruns across 9 locales producing 13,964 results
** 9 bugs found


= Discussion Items  =
= Discussion Items  =

Latest revision as of 20:37, 30 March 2011

« previous mtg | QA Staff Home | next mtg »

QA Staff Meeting Notes Mar 30, 2011

New Hires

Upcoming Test Events

Project Status

  • Overview (2 min brief update)

Desktop Firefox (Juan)

Maintenance and Security (Al)

  • Firefox 3.5.19 and 3.6.16 moved out to April 26 for release to coincide with Firefox 4.0.1 (or whatever we call it).
  • bug 646054 causing complications since it breaks 3.6 advertised major updates to 4.0.1.
    • Firefox 3.6.16 needs to ship and be used by people before they can get an advertised (prompted) 4.0.1 update.
    • This has potential schedule repercussions since people may not want to wait until early May for 4.0.1 prompted updates.

Browser Technologies (Tony)

  • Fennec (aakash)
  • Automation (martijn)
  • Sync (Tracy)
    • Sync out to the world in Fx4
      • Approximately 2% of downloads are creating new Sync accounts. We hit 1 million ADU's earlier this week.
    • Servers are holding up well with scl2 in the round robin of new user accounts
      • New users we're being added at 1-2 per second. Server ops had prepared to handle well above that rate.
  • Test pilot (tracy)
    • TP team is still working out plan for 1.2. It will be mainly focused on change over of the notification system to built in Fx door hangers.
  • Jetpack (ayan)
    • SDK 1.0b4 released last thursday.
    • Flightdeck 0.9.1 push delayed last week. Rescheduled for tomorrow.
    • Selenium scripts on github now.
  • Firefox Home (tony)
    • more work developing and specs are forming. nothing to test yet.

WebQA (Stephen)

AMO

FF Engagement Projects

  • Twitterparty desktop went live 3/21
    • Twitterparty mobile went live 3/29
  • Facebook badges went live 3/22
    • Updated for mobile release - went live 3/29
  • Now working on:
    • WebifyMe
    • Signatures/MarkUp
    • "Influencer"

MDN

  • 0.9.4 planning for late April Release

Mozilla.com

Web of Wonder

Spark

Socorro

  • 1.7.7 slated for 4.15.11 release

SUMO

  • SUMO 2.7 release, first installment of Users and Groups, slated to release 3/31

WebQA Automation

  • Held a Test Day yesterday and have picked up a new contributor

Input

AMO

SUMO

QA Services (Marcia)

  • Community Planning
    • There will be a session next week during the Work Week related to Community Planning and Brainstorming. Target day will be Wednesday and room information should be available when the whiteboard comes up on Monday AM.
  • Video Work
    • Rainer is back and we are discussing plans for other video work in this quarter. We will likely produce one video from Mozilla Summit footage.
  • Accessibility (Marco):
  • QMO.next (Al):
    • Waiting for a review on QMO 4.0 plan from Morgamic.
    • We need people to get forums for their teams every couple of days, please.

Test Automation (Henrik)

General
Mozmill
  • Some issues have been found which requires another 1.5.x release; expected later this week or early next week
Project updates
  • On Demand Updates
    • Deployed on qa-set
    • Added ability to target a single platform for test runs/re-runs
  • Panorama (ashughes)
    • 3 LANDED, 5 IN-REVIEW, 1 PENDING, 13 BLOCKED
    • Pushing hard to get as much done as we can
    • Likely won't achieve goal of 50%
    • Given recent distractions and natural overhead 25% is more realistic
  • Shared Module Refactoring
    • Work continues, with L10N and preference handling added
    • Test porting continues to build UI proxy classes
Events
  • Endurance/Mozmill Crowd testday Friday, March 25th: results
    • 11 General testruns across 3 locales producing over 1409 results
    • 11 l10n testruns across 7 locales producing 44 results
    • 331 Endurance testruns across 9 locales producing 13,964 results
    • 9 bugs found

Discussion Items

Takeaways and Action Items

Item Owner Due Done?



Notes

Retrieved from "https://wiki.mozilla.org/index.php?title=QA/StaffMeetings/QA-Staff-03-30-2011&oldid=295293"