QA/Execution/Meetings/2010-01-27: Difference between revisions

From MozillaWiki
< QA‎ | Execution‎ | Meetings
Jump to navigation Jump to search
mNo edit summary
 
Line 1: Line 1:
<small>[[QA/Execution/Meetings/2010-01-13|« previous mtg]] | [[QA/Execution/Meetings|index]] | [[QA/Execution/Meetings/2010-02-10|next mtg »]]</small>
<small>[[QA/Execution/Meetings/2010-01-13|« previous mtg]] | [[QA/Execution/Meetings|index]] | [[QA/Execution/Meetings/2010-02-10|next mtg »]]</small>  


= Discussion Items =  
= Discussion Items =
* Welcome Matt and Anthony!


* Firefox 3.6 QA post mortem (juan)
*Welcome Matt and Anthony!
** Notes: Postmortem discussion tomorrow at 11am meeting.
** Will defer thoughts until after the postmortem


* Revisiting FFT level tests (juan)
*Firefox 3.6 QA post mortem (juan)  
** Feedback says some of these tests are not the best use of time, functionality.  Approach to reaccessing them for 3.next?
**Notes: Postmortem discussion tomorrow at 11am meeting.  
** '''discussion''' tests are outdated, and some are already automated.  We have not found regressions on them in awhile.  Firefox team gets frustrated.
**Will defer thoughts until after the postmortem
** Suggest taking existing tests, and revise them.
** Start with focus on one area.  Easy to question the P1 areas, but what about the P2 and P3s?
** Question: what do we want out of the FFT level testcases?
** Continue using the QA ownership list found [http://spreadsheets.google.com/ccc?key=0AkSa2kZ0OBffdE94NTdKcFFENEdfRE9OcmswUTFyM3c&hl=en here].
* Mozmill lab update (henrik)
** Mac Mini with OS X 10.5 and 10.6 as host system
** Ubuntu 9.10, Win2000, WinXP, WinVista, and Win7 as guests
** Daily Mozmill test-runs on OS X, Ubuntu, and WinXP ({{bug|537840}})
*** Cover Namoroka and Shiretoko
*** Software update tests (nightly channel), normal tests, and restart tests
*** Reporting to [http://brasstacks.mozilla.com/couchdb/mozmill/_design/reports/_list/summary/summary brasstacks]
** Todos
*** Fix smaller issues with Mozmill to send as much as possible test information
*** Update software update tests to report all results and the build info
*** Rework all design views for the Mozmill Couchdb database


* bugday discussion (tracy)
*Revisiting FFT level tests (juan)  
** ETA on start? Thursday Feb 4th
**Feedback says some of these tests are not the best use of time, functionality. Approach to reaccessing them for 3.next?  
** ''Last week's notes:''
**'''discussion''' tests are outdated, and some are already automated. We have not found regressions on them in awhile. Firefox team gets frustrated.
** Alternate every other friday with testdays?  or move to another day?
**Suggest taking existing tests, and revise them.
** discussion: not a large event like triaging every time, but place with good documentation, a list of tasks, and a lot of hands off work
**Start with focus on one area. Easy to question the P1 areas, but what about the P2 and P3s?
** Be more active in the channel, doling out bugs, and getting people to work on them for the day
**Question: what do we want out of the FFT level testcases?
** Shoot for thursdays this quarter. Pending when Tracy is ready.
**Continue using the QA ownership list found [http://spreadsheets.google.com/ccc?key=0AkSa2kZ0OBffdE94NTdKcFFENEdfRE9OcmswUTFyM3c&hl=en here].


* QA Work week
*Mozmill lab update (henrik)
** March 1-5
**Mac Mini with OS X 10.5 and 10.6 as host system
**Ubuntu 9.10, Win2000, WinXP, WinVista, and Win7 as guests
**Daily Mozmill test-runs on OS X, Ubuntu, and WinXP ({{bug|537840}})
***Cover Namoroka and Shiretoko
***Software update tests (nightly channel), normal tests, and restart tests
***Reporting to [http://brasstacks.mozilla.com/couchdb/mozmill/_design/reports/_list/summary/summary brasstacks]
**Todos
***Fix smaller issues with Mozmill to send as much as possible test information
***Update software update tests to report all results and the build info
***Rework all design views for the Mozmill Couchdb database


= Project Updates =
*bugday discussion (tracy)  
* Firefox 3.0.18, 3.5.8 (abillings)
**ETA on start? Thursday Feb 4th
** update?
**''Last week's notes:''
**Alternate every other friday with testdays? or move to another day?
**discussion: not a large event like triaging every time, but place with good documentation, a list of tasks, and a lot of hands off work
**Be more active in the channel, doling out bugs, and getting people to work on them for the day
**Shoot for thursdays this quarter. Pending when Tracy is ready.


* Firefox 3.6, 3.next (juanb)
*QA Work week
** 3.0->3.6 Major update?
**March 1-5
** update?


* Fennec (aakashd)
= Project Updates  =
** Finished [https://wiki.mozilla.org/QA/Fennec1.0/ReleaseTest/1.0Maemo_RC3 release testing RC3]


* WebQA (stephend)
*Firefox 3.0.18, 3.5.8 (abillings)
** Working on [https://wiki.mozilla.org/QA/Execution/Web_Testing/AMO/Current_Release/5.6 certifying] [https://wiki.mozilla.org/AMO:Meeting_Notes AMO 5.6]
** Targeting Feb 16. See [https://wiki.mozilla.org/Releases schedule]
** Working on [https://wiki.mozilla.org/Support/SUMOdev_Meeting_Notepad SUMO 1.5.1]
** Testing the [https://wiki.mozilla.org/QA/Execution/Web_Testing/EU_Ballot/Test_Plan EU browser-ballot page]
** Pushed the [http://jetpackgallery.mozillalabs.com/ Jetpack gallery]
** Working on a few enhancements to the Mozilla Creative Collective
** Working on updates to the Mozilla Developer Center


* Labs (Weave/Test Pilot) (tracy)
*Firefox 3.6, 3.next (juanb)
** Weave rc4 is out - lots of good feedback about previous problems no longer occurring
** Planning has started for feature analysis.  See Firefox features [https://wiki.mozilla.org/Firefox/Projects here.]
** Tentative Test Pilot test plan is up. Will discuss and adjust it as needed during the next Test Pilot status meeting (todays meeting was postponed)
**3.0.x ->3.6 Major update?
**Planning for testing on "majortest" channel early next week. RelEng awaits outcome


* Mozmill Testcase automation (henrik)
** [http://www.hskupin.info/2010/01/25/mozmill-1-4-released/ Mozmill 1.4] has been released
** Overall Status ([http://spreadsheets.google.com/ccc?key=pAP5Y5AH3-Tl-wRoNgBujUQ&hl=en spreadsheet]
** Detailed Status:
*** Smoketests: Blocked (9), Assigned (1), Fixed (23 - 68%), Not Doable (3 - 8%)
*** BFT: Blocked (17), Assigned (13), Fixed (77 - 31%)[+0], Not Doable (26) => Target Q1 (~110)
*** FFT: Blocked (12), Assigned (12), Fixed (83)
** Most of the API work has been landed. Ongoing work with Anthony for Session Restore subgroup


* QMO & Community (marcia, aakashd)
*Fennec (aakashd)  
** Testdays
**Finished [https://wiki.mozilla.org/QA/Fennec1.0/ReleaseTest/1.0Maemo_RC3 release testing RC3]
** Meetups
***Firefox Weave Meetup on February 10: http://quality.mozilla.org/events/2010/feb/10/firefox-weave-10-meetup
***Need a Meetup topic for March meetup
** Other activity?


* Accessibility (marcoz)
*WebQA (stephend)
** update?
**Working on [https://wiki.mozilla.org/QA/Execution/Web_Testing/AMO/Current_Release/5.6 certifying] [https://wiki.mozilla.org/AMO:Meeting_Notes AMO 5.6]
**Working on [https://wiki.mozilla.org/Support/SUMOdev_Meeting_Notepad SUMO 1.5.1]
**Testing the [https://wiki.mozilla.org/QA/Execution/Web_Testing/EU_Ballot/Test_Plan EU browser-ballot page]
**Pushed the [http://jetpackgallery.mozillalabs.com/ Jetpack gallery]
**Working on a few enhancements to the Mozilla Creative Collective
**Working on updates to the Mozilla Developer Center
 
*Labs (Weave/Test Pilot) (tracy)
**Weave rc4 is out - lots of good feedback about previous problems no longer occurring
**Tentative Test Pilot test plan is up. Will discuss and adjust it as needed during the next Test Pilot status meeting (todays meeting was postponed)
 
*Mozmill Testcase automation (henrik)
**[http://www.hskupin.info/2010/01/25/mozmill-1-4-released/ Mozmill 1.4] has been released
**Overall Status ([http://spreadsheets.google.com/ccc?key=pAP5Y5AH3-Tl-wRoNgBujUQ&hl=en spreadsheet]
**Detailed Status:
***Smoketests: Blocked (9), Assigned (1), Fixed (23 - 68%), Not Doable (3 - 8%)
***BFT: Blocked (17), Assigned (13), Fixed (77 - 31%)[+0], Not Doable (26) =&gt; Target Q1 (~110)
***FFT: Blocked (12), Assigned (12), Fixed (83)
**Most of the API work has been landed. Ongoing work with Anthony for Session Restore subgroup
 
*QMO &amp; Community (marcia, aakashd)
**Testdays
**Meetups
***Firefox Weave Meetup on February 10: http://quality.mozilla.org/events/2010/feb/10/firefox-weave-10-meetup
***Need a Meetup topic for March meetup
**Other activity?
 
*Accessibility (marcoz)  
**update?


= Round Table =
= Round Table =

Latest revision as of 17:40, 28 January 2010

« previous mtg | index | next mtg »

Discussion Items

  • Welcome Matt and Anthony!
  • Firefox 3.6 QA post mortem (juan)
    • Notes: Postmortem discussion tomorrow at 11am meeting.
    • Will defer thoughts until after the postmortem
  • Revisiting FFT level tests (juan)
    • Feedback says some of these tests are not the best use of time, functionality. Approach to reaccessing them for 3.next?
    • discussion tests are outdated, and some are already automated. We have not found regressions on them in awhile. Firefox team gets frustrated.
    • Suggest taking existing tests, and revise them.
    • Start with focus on one area. Easy to question the P1 areas, but what about the P2 and P3s?
    • Question: what do we want out of the FFT level testcases?
    • Continue using the QA ownership list found here.
  • Mozmill lab update (henrik)
    • Mac Mini with OS X 10.5 and 10.6 as host system
    • Ubuntu 9.10, Win2000, WinXP, WinVista, and Win7 as guests
    • Daily Mozmill test-runs on OS X, Ubuntu, and WinXP (bug 537840)
      • Cover Namoroka and Shiretoko
      • Software update tests (nightly channel), normal tests, and restart tests
      • Reporting to brasstacks
    • Todos
      • Fix smaller issues with Mozmill to send as much as possible test information
      • Update software update tests to report all results and the build info
      • Rework all design views for the Mozmill Couchdb database
  • bugday discussion (tracy)
    • ETA on start? Thursday Feb 4th
    • Last week's notes:
    • Alternate every other friday with testdays? or move to another day?
    • discussion: not a large event like triaging every time, but place with good documentation, a list of tasks, and a lot of hands off work
    • Be more active in the channel, doling out bugs, and getting people to work on them for the day
    • Shoot for thursdays this quarter. Pending when Tracy is ready.
  • QA Work week
    • March 1-5

Project Updates

  • Firefox 3.0.18, 3.5.8 (abillings)
  • Firefox 3.6, 3.next (juanb)
    • Planning has started for feature analysis. See Firefox features here.
    • 3.0.x ->3.6 Major update?
    • Planning for testing on "majortest" channel early next week. RelEng awaits outcome


  • Labs (Weave/Test Pilot) (tracy)
    • Weave rc4 is out - lots of good feedback about previous problems no longer occurring
    • Tentative Test Pilot test plan is up. Will discuss and adjust it as needed during the next Test Pilot status meeting (todays meeting was postponed)
  • Mozmill Testcase automation (henrik)
    • Mozmill 1.4 has been released
    • Overall Status (spreadsheet
    • Detailed Status:
      • Smoketests: Blocked (9), Assigned (1), Fixed (23 - 68%), Not Doable (3 - 8%)
      • BFT: Blocked (17), Assigned (13), Fixed (77 - 31%)[+0], Not Doable (26) => Target Q1 (~110)
      • FFT: Blocked (12), Assigned (12), Fixed (83)
    • Most of the API work has been landed. Ongoing work with Anthony for Session Restore subgroup
  • Accessibility (marcoz)
    • update?

Round Table