QA/Fennec/Waverley/2012-02-01: Difference between revisions

From MozillaWiki
< QA‎ | Fennec‎ | Waverley
Jump to navigation Jump to search
 
(10 intermediate revisions by 6 users not shown)
Line 15: Line 15:
== Round Table ==  
== Round Table ==  
<i> (eg. Other items to discuss) </i>
<i> (eg. Other items to discuss) </i>
* Friday, February 2nd: [https://etherpad.mozilla.org/testday-20120203 Firefox 11b1] testday
** Please help moderate and test


== Firefox Updates ==
== Firefox Updates ==
<i> (eg. Status, top issues) </i>
<i> (eg. Status, top issues) </i>
* Mozilla (test lead)
* Mozilla (test lead)
** Firefox 10, 10 ESR, and 3.6.26 shipped; thanks everyone who helped
*** currently throttled at 65%, will evaluate on Thursday if we can unthrottle
** Firefox 11, 12, 13 merging into beta, aurora, and nightly
** Firefox 11b1 delayed due to an issue during build (probably have builds later today)
* Waverley (Paul, Ioana, Mihaela, Virgil, Simona, VladG)
* Waverley (Paul, Ioana, Mihaela, Virgil, Simona, VladG)
** Firefox 3.6.26 build 2 [http://mzl.la/zfHKYt Test Plan]
** Firefox 3.6.26 build 2 [http://mzl.la/zfHKYt Test Plan]
Line 75: Line 81:
* Waverley (Alex, Vlad, Remus)
* Waverley (Alex, Vlad, Remus)
** Work continues as usual in the following priority  
** Work continues as usual in the following priority  
*** Fix failing tests (or skip within 24h) [http://bit.ly/zHumqg click for query]
*** Fix failing tests (or skip within 24h) [http://bit.ly/yMYmpt click for query]
*** New tests : focus is on endurance tests  
*** New tests : focus is on endurance tests
**** {{bug|710245}} needs landing
*** Refactoring: change waitForEval into waitFor
*** Refactoring: change waitForEval into waitFor
*** Bug cleanup started yesterday [http://bit.ly/xNxoUc click for query]
*** Bug cleanup started yesterday [http://bit.ly/xNxoUc click for query]
Line 85: Line 92:
*** Action item (Vlad): Contact Krupa in a webqa meeting to find out if there are any discovery pane collection panels not changing (content or position) P3   
*** Action item (Vlad): Contact Krupa in a webqa meeting to find out if there are any discovery pane collection panels not changing (content or position) P3   
*** Team is discussing a method to handle {{bug|716528}}: can we simulate a twitter feed?  
*** Team is discussing a method to handle {{bug|716528}}: can we simulate a twitter feed?  
*** '''Backlog''':  
*** '''Backlog''':  {{bug|710143}} Investigate why we fail aom tests with "Modal dialog has been found and processed"
  {{bug|710143}} Investigate why we fail aom tests with "Modal dialog has been found and processed" - Firefox bug or Mozmill bug?  
****Firefox bug or Mozmill bug?  
Bookmarks and History functional tests - very low priority at the moment (and lack of API), perhaps to be handled after Mozmill 2.0  
**** Bookmarks and History functional tests - very low priority at the moment (and lack of API), perhaps to be handled after Mozmill 2.0  
* Mozilla (Anthony)
* Mozilla (Anthony)
** We now have an mozmill-esr10 branch
*** merged out of the mozmill-release branch with every major version bump of Firefox ESR (next is Firefox 17 ESR)
*** we will not land patches here unless it's a critical fix
** Development priority right now needs to be fixing broken and disabled tests (~40 open issues right now)


== WebQA Manual Updates ==
== WebQA Manual Updates ==
Line 95: Line 106:
** Work on Default to compatible - perform scenarios from [http://bit.ly/w4XYFG spreadhseet]
** Work on Default to compatible - perform scenarios from [http://bit.ly/w4XYFG spreadhseet]
** Release testing on [https://litmus.mozilla.org/run_tests.cgi?test_run_id=370 addons-dev.allizom.org] and [https://litmus.mozilla.org/run_tests.cgi?test_run_id=370 apps-preview-dev.allizom.org]
** Release testing on [https://litmus.mozilla.org/run_tests.cgi?test_run_id=370 addons-dev.allizom.org] and [https://litmus.mozilla.org/run_tests.cgi?test_run_id=370 apps-preview-dev.allizom.org]
** Update test cases for AMO and APPS in Litmus
** Sanity testing on AMO and Apps pages
** Update test cases for AMO and Apps in Litmus
** Verify fixed bugs
** Verify fixed bugs
* Mozilla
* Mozilla


== Fennec Updates ==
<i> (eg. Status, top issues) </i>
<i> (eg. Status, top issues) </i>
* Mozilla (test lead)
* Mozilla (test lead)
** Firefox 11 beta 1 will likely be XUL still.  this will include tablets and phones.  Ioana, please work with Aaron on a testplan.
** Firefox nightly is now version 13.
** Testing of GL layers in a special APK to determine if there are startup crashers.  Due friday. Martijn will lead efforts
** String freeze as of last night.  need about a week to generate localized builds.  SV to lead efforts


* Waverley (Ioana, Andreea, Catalin, Camelia, Carla, Nicolae)  
* Waverley (Ioana, Andreea, Catalin, Camelia, Carla, Nicolae)  
Line 109: Line 126:
**[http://goo.gl/9E6d1  Logged issues]  
**[http://goo.gl/9E6d1  Logged issues]  
** watch assigned features - add new one to the [https://docs.google.com/spreadsheet/ccc?key=0AocUyLHteCtSdHQ5Q2tIZVhMT3NNY0lPYzhHT2MyZXc#gid=0 spreadsheet]
** watch assigned features - add new one to the [https://docs.google.com/spreadsheet/ccc?key=0AocUyLHteCtSdHQ5Q2tIZVhMT3NNY0lPYzhHT2MyZXc#gid=0 spreadsheet]
** bug verification on Firefox 11.0a2 and Firefox 12.0a1
** bug verification on Firefox 11.0a2 and Firefox 12.0a1 (Aaron's email - done)
** in-litmus TCs
** in-litmus TCs
** on site and DA test for Gralloc Testing. Results [https://wiki.mozilla.org/Mobile/GrallocWhiteList here]
** on site and DA test for Gralloc Testing. Results [https://wiki.mozilla.org/Mobile/GrallocWhiteList here]
** Profile migration testing: Results [http://goo.gl/AP8GJ here]
** BFTs - Aurora XUL - tablet [in Litmus]
** Exploratory - Aurora XUL - tablet: Results [http://goo.gl/WoZ2E here]
** Aurora -  new Sync drop exploratory testing - e-mail for results
** downgraded Samsung Galaxy S to Android 2.1-update1 - bug 705874 reproducing


*'''Important bugs:'''
*'''Important bugs:'''
Line 118: Line 140:
** {{Bug|721328}} - Nightly crashes at first start-up @ _ZN12SkGlyphCache10VisitCacheEPK12SkDescriptorPFbPKS_PvES5_
** {{Bug|721328}} - Nightly crashes at first start-up @ _ZN12SkGlyphCache10VisitCacheEPK12SkDescriptorPFbPKS_PvES5_
** {{Bug|721356}} - Zooming issues for Google Maps Classic
** {{Bug|721356}} - Zooming issues for Google Maps Classic
 
** {{Bug|722808}} - XUL Fennec nightly build fails with "L10NBASEDIR not defined by configure" in embedding/android/locales
*'''Issues/Questions/ Proposals'''
*'''Issues/Questions/ Proposals'''



Latest revision as of 16:32, 1 February 2012

Meeting Notes for <02-01/2012>

Welcome

(eg. headcount, updates with staffing, vacation/away time)

  • Welcome to Paul Feher who joined the Mobile team starting Monday January 30.
  • PTO:
    • Vlad Ghetiu - PTO next week (February 6-10). He will return to office on Monday, February 13.

Take Ways From Last Week

(eg. Action items from last weeks's Take Aways)

  • [DONE] Mobile: mozilla to give SV feedback on testcase password manager, awesomebar, and sync testscases
  • [DONE] Mobile: SV to prepare testing for Website compatibility, comparing screenshots on major sites (stock vs native)
  • [DONE] Mobile: SV to finish merging their testcases into litmus

Round Table

(eg. Other items to discuss)

  • Friday, February 2nd: Firefox 11b1 testday
    • Please help moderate and test

Firefox Updates

(eg. Status, top issues)

  • Mozilla (test lead)
    • Firefox 10, 10 ESR, and 3.6.26 shipped; thanks everyone who helped
      • currently throttled at 65%, will evaluate on Thursday if we can unthrottle
    • Firefox 11, 12, 13 merging into beta, aurora, and nightly
    • Firefox 11b1 delayed due to an issue during build (probably have builds later today)
  • Waverley (Paul, Ioana, Mihaela, Virgil, Simona, VladG)
    • Firefox 3.6.26 build 2 Test Plan
      • Smoketests across platforms Link
    • Firefox 10 beta 6 Test Plan
      • Smoketests across platforms Link
      • Focused Tests Link
      • Fixed bugs verification Link
      • Feature ownership
    • Firefox 10 RC Test Plan
    • Firefox 10 ESR Test Plan
      • Smoketests across platforms Link
      • Exploratory testing on major sites Link
      • Branding tests across platforms Link
    • Firefox 11 Test Plan
    • Firefox 12 Test Plan
    • Feature - Silent Update Link
      • Lessen the showing of the what's new page Link - Mihaela
        • Status: SHIPPED
      • Removal of OS security dialog for Windows Link - Simona
        • Status: Health ok. Added new testcases in Litmus and ran testcases on all platforms.
      • Add-ons default to compatible Link - Virgil
        • Status: SHIPPED
      • Background updates Link - VladG
        • Status: Health ok. Testing is in progress on the oak branch on Windows platforms.
      • Workflow with Incompatible Add-ons Link - Ioana
        • Status: Updated workflow for updating users with incompatible add-ons - reviewed feature wiki page and meeting notes; no updates.
      • Lessen the display of app update UI Link - Paul
        • Status: SHIPPED
      • component watching Tabbed Browser, Session Restore, Panorama

Automation Updates

(eg. Status, top issues)

WebQA (Selenium)
  • Waverley (Teodosia, Florin, Alin)
    • Refactoring tasks on AMO
    • Migrated AMO license to MPL2
    • PayPal test was merged in
    • Code review
  • Mozilla (Marlena)
Desktop (Mozmill)
  • Waverley (Alex, Vlad, Remus)
    • Work continues as usual in the following priority
    • Highlights
      • Commit access for Vlad and Alex (discussed terms and patch policy via e-mails with Anthony)
      • Work is not blocked, there are lots of stuff to lay hands on (yay!)
      • Action item (Vlad): Contact Krupa in a webqa meeting to find out if there are any discovery pane collection panels not changing (content or position) P3
      • Team is discussing a method to handle bug 716528: can we simulate a twitter feed?
      • Backlog: bug 710143 Investigate why we fail aom tests with "Modal dialog has been found and processed"
        • Firefox bug or Mozmill bug?
        • Bookmarks and History functional tests - very low priority at the moment (and lack of API), perhaps to be handled after Mozmill 2.0
  • Mozilla (Anthony)
    • We now have an mozmill-esr10 branch
      • merged out of the mozmill-release branch with every major version bump of Firefox ESR (next is Firefox 17 ESR)
      • we will not land patches here unless it's a critical fix
    • Development priority right now needs to be fixing broken and disabled tests (~40 open issues right now)

WebQA Manual Updates

(eg. Status, top issues)

Fennec Updates

(eg. Status, top issues)

  • Mozilla (test lead)
    • Firefox 11 beta 1 will likely be XUL still. this will include tablets and phones. Ioana, please work with Aaron on a testplan.
    • Firefox nightly is now version 13.
    • Testing of GL layers in a special APK to determine if there are startup crashers. Due friday. Martijn will lead efforts
    • String freeze as of last night. need about a week to generate localized builds. SV to lead efforts
  • Waverley (Ioana, Andreea, Catalin, Camelia, Carla, Nicolae)
    • run BFTs and daily smoke tests on following devices ( Galaxy Tab, LG Optimus 2X P990, HTC Desire Z, Google Nexus S, Motorola Droid 2, Motorola Droid Pro, Samsung Galaxy SII) daily results ; archive .
    • bug validation Commented bugs;
    • Firefox 10 Beta 6 results: here
    • Firefox 10 RC 1 results: here
    • Logged issues
    • watch assigned features - add new one to the spreadsheet
    • bug verification on Firefox 11.0a2 and Firefox 12.0a1 (Aaron's email - done)
    • in-litmus TCs
    • on site and DA test for Gralloc Testing. Results here
    • Profile migration testing: Results here
    • BFTs - Aurora XUL - tablet [in Litmus]
    • Exploratory - Aurora XUL - tablet: Results here
    • Aurora - new Sync drop exploratory testing - e-mail for results
    • downgraded Samsung Galaxy S to Android 2.1-update1 - bug 705874 reproducing
  • Important bugs:
    • bug 721782 - Add-ons are migrated as disabled from XUL to Native
    • bug 721784 - Installed add-ons migrated from XUL to Native are visible only after restart
    • bug 721328 - Nightly crashes at first start-up @ _ZN12SkGlyphCache10VisitCacheEPK12SkDescriptorPFbPKS_PvES5_
    • bug 721356 - Zooming issues for Google Maps Classic
    • bug 722808 - XUL Fennec nightly build fails with "L10NBASEDIR not defined by configure" in embedding/android/locales
  • Issues/Questions/ Proposals

BrowserID Updates

(eg. Status, top issues)

  • Waverley (Ioana)
    • BrowserID train-2012.01.18 was signed off Details
      • Full regression testing on Android 2.2 with Firefox 12.0
      • Primary support testing on Windows 7 with Firefox 12.0, IE9, Opera 11.61 and Chrome 16.0.912.77 m
      • Testing of required email and persistent sign in features on Windows 7 with Firefox 12.0

Take Aways This Week

(eg. Action items)