FirefoxOS/DeviceQA/2015-03-02WeeklyReport: Difference between revisions

From MozillaWiki
Jump to navigation Jump to search
No edit summary
No edit summary
 
(16 intermediate revisions by 13 users not shown)
Line 10: Line 10:
||
||
* Week W10 (03/02~03/06)
* Week W10 (03/02~03/06)
 
**MCTS v2.2
**[https://bugzilla.mozilla.org/show_bug.cgi?id=1116878 Bug 1116878] - [2.1] Most bluetooth tests fail with "app = null" error
*** reopened....
**Discuss about Security tests in MCTS
||
||
* Week W11 (03/09~03/13)
* Week W11 (03/09~03/13)
 
**MCTS v2.2
**[https://bugzilla.mozilla.org/show_bug.cgi?id=1116878 Bug 1116878] - [2.1] Most bluetooth tests fail with "app = null" error
*** attempting to resolve it again \_/#
**Discuss about Security tests in MCTS
*** support Christian pick it up
**[https://bugzilla.mozilla.org/show_bug.cgi?id=1137065 Bug 1137065] - [MCTS][2.2] Identify new IDL and writing test cases
|-
|-
| Alison
| Alison
||
||
* Week W10 (03/02~03/06)
* Week W10 (03/02~03/06)
 
** Bugs verify
** NFC full run test - Flame-KK
** Monitor Nexus-5-L MTBF testing
||
||
* Week W11 (03/09~03/13)
* Week W11 (03/09~03/13)
 
** Bugs verify
** Monitor Nexus-5-L MTBF testing
** NFC regression test - Nexus5-L
** Prepare NFC workweek QA session
|-
|-
|Askeing
|Askeing
||
||
* Week W10 (03/02~03/06)
* Week W10 (03/02~03/06)
 
** MCTS issues fixing.
** Bug 1133394 - Add image support for semiauto tests
** Bug 1135094 - "make test" fails with "No module named semiauto"
** Bug 1016970 - sms.test_sms_incoming.TestSmsIncoming.test_sms_incoming should have a yes/no prompt
** Bug 1037536 - Update the semiauto screen orientation test to use the latest api changes
** tracking Bug 1131470 - w3c screen orientation api has changed
||
||
* Week W11 (03/09~03/13)
* Week W11 (03/09~03/13)
 
** Assist Edward for Bug 1132515.
** MCTS issues fixing.
** Bug 1135094 - "make test" fails with "No module named semiauto"
** Bug 1142409 - [MCTS] add v2.2 to supported versions
** Bug 1142421 - marionette-extension should support v2.2
** Bug 1142422 - fxosapp-gen should support v2.2 officially
** Bug 1142430 - [MCTS] The semiauto tests will show "Could not close CertTest App automatically..." error message.
|-
|-
| Cynthia
| Cynthia
||
||
* Week W10 (03/02~03/06)
* Week W10 (03/02~03/06)
 
** Take care of Flame KK v2.1 automation reports (Daily)
** Identify apps performance drop down issue
** Prepare to setup raptor for 2.2
** [Stingray] Create test cases
||
||
* Week W11 (03/09~03/13)
* Week W11 (03/09~03/13)
 
** Take care of Flame KK v2.1 automation reports (Daily)
** Assist Edward in identifying Bug 1132515
*** Understand build processes and roles
*** Prepare script for cloning Geckos during 1/26
*** Prepare build scripts for each Gecko (#100)
*** Rebuild Gecko system images (#100)
*** Flash system images in devices (#100)
*** Run performance testing for devices (#100)
*** Collect analysis result
|-
|-
| Edward
| Edward
||
||
* Week W10 (03/02~03/06)
* Week W10 (03/02~03/06)
 
** Set up done for performance environment in v2.2
** identify performance drop down issue
** Rework Nexus 5 for power consumption of apps
||
||
* Week W11 (03/09~03/13)
* Week W11 (03/09~03/13)
 
** Bug 1132515
*** Understand build processes and roles
*** Prepare script for cloning Geckos during 1/26
*** Prepare build scripts for each Gecko (#100)
*** Rebuild Gecko system images (#100)
*** Flash system images in devices (#100)
*** Run performance testing for devices (#100)
*** Collect analysis result
|-
|-
| Eric
| Eric
||
||
* Week W10 (03/02~03/06)
* Week W10 (03/02~03/06)
 
** Transfer Nexus 5 smoke to Marigold
** Start Nexus 5 regression test (Marigold)
** Start flame-kk full run (Marigold)
** Check for v2.2 bug status
||
||
* Week W11 (03/09~03/13)
* Week W11 (03/09~03/13)
 
** Bluetooth PTS on Flame-KK
** Check for v2.2 bug status
|-
|-
|Gerry
|Gerry
||
||
* Week W10 (03/02~03/06)
* Week W10 (03/02~03/06)
 
** v2.2 feature testing
** QAnalyst/MGSEI bugs verification/follow-up
** Nexus 5 automation test monitoring
** bug 1115311 - clock widget regression tests
** Test Spect template drafting
||
||
* Week W11 (03/09~03/13)
* Week W11 (03/09~03/13)
 
** v2.2 feature testing
** QAnalyst/MGSEI bugs verification/follow-up
** Nexus 5 automation test monitoring
** Privacy controls debug build env setup
** Test Spect template drafting
|-
|-
| Hermes
| Hermes
||
||
* Week W10 (03/02~03/06)
* Week W10 (03/02~03/06)
 
** Monitor v2.2+ System FE Bugs
*** Create test cases for short_name support on FxOS ([https://bugzilla.mozilla.org/show_bug.cgi?id=1001861 Bug 1001861])
**** Implement ([https://github.com/mozilla-b2g/qa-testcase-data/tree/gh-pages/hermescheng/short_name-support test app])
||
||
* Week W11 (03/09~03/13)
* Week W11 (03/09~03/13)
 
** Monitor v2.2+ System FE Bugs
** Let progress of Stagnant Bugs from QAnalyst moving
** Study some b2g materials
|-
|-
| Hubert
| Hubert
Line 91: Line 151:
||
||
* Week W10 (03/02~03/06)
* Week W10 (03/02~03/06)
 
**v2.1 bug work
**Power Consumption lab setup
**Figure out Flame base image problem
||
||
* Week W11 (03/09~03/13)
* Week W11 (03/09~03/13)
 
**v2.1 bug work
**Support power tool setup
**Automation fail case investigation
|-
|-
| Owen Ouyang
| Owen Ouyang
||
||
* Week W10 (03/02~03/06)
* Week W10 (03/02~03/06)
** g 1137081 
** Study PDF report


||
||
* Week W11 (03/09~03/13)
* Week W11 (03/09~03/13)
** Bug 1139760 - Enhance Report to generate PDF version
** Study MCTS log


|-
|-
Line 107: Line 175:
||
||
* Week W10 (03/02~03/06)
* Week W10 (03/02~03/06)
 
** Fixing memory report in mtbf_operation
** Revive daily mtbf test
** Providing fix for flash tool
||
||
* Week W11 (03/09~03/13)
* Week W11 (03/09~03/13)
 
** Investigating v2.2 mtbf run
** Review and fix patches for test harness
-- backlog --
* Chaos Monkey for b2g (random process killer)
* Create daemon to emit locking status
* Modifying crash report patch based on review (pending to b2gDevice in mozbase)
* Followup live test run stream
* Datazilla integration
* Memory stress test
|-
|-
| Shing
| Shing
Line 130: Line 208:
||
||
* Week W10 (03/02~03/06)
* Week W10 (03/02~03/06)
 
** V2.2 Cgroup
*** 4 tests done, 2 in progress
** V2.2 Bluedroid
*** PTS - Request ID from BT organization
*** Regression test on hold
** Follow up on bugs list transferred by QAnalyst
||
||
* Week W11 (03/09~03/13)
* Week W11 (03/09~03/13)
 
** V2.2 Cgroup
*** 4 tests done, 2 in progress
** V2.2 Bluedroid
*** PTS - environment setup
*** Automation Report
** Reconfig Jenkins environment settings
** V2.2 email attachment
*** Verified on master
*** Verify on v2.2
|-
|-
| Walter
| Walter
Line 149: Line 240:
||
||
* Week W11 (03/09~03/13)
* Week W11 (03/09~03/13)
 
** Lab works
*** Help with Cynthia, Edward, and so on
** MTBF operation and MTBF driver modification
** MTBF Bugs
|-
|-
| William Hsu
| William Hsu
Line 155: Line 249:
* Week W10 (03/02~03/06)
* Week W10 (03/02~03/06)
** [Device]
** [Device]
*** Bug work
*** Bug work, 31 bugs from the time of writing this. (Ref: http://goo.gl/kgBCgI)
*** GU test on Flame v2.0 & Flame v2.1
*** GU test on Flame v2.0 & Flame v2.1
** [Outsourcing]
** [Outsourcing]
Line 162: Line 256:
*** Dispatch bugs of free test
*** Dispatch bugs of free test
** Others,
** Others,
*** Support PluotSorbet
*** Setup automation test environment for Dolphin v2.1s (512MB)
*** Setup automation test environment for Dolphin v2.1s (512MB)
*** Setup test-perf for Flame v2.2 and Nexus-5
*** Reply developers' inquires of RTSP and Gecko issues.


||
||
Line 176: Line 271:
** Others,
** Others,
*** Support PluotSorbet
*** Support PluotSorbet
*** PTO on 3/13
*** Set up automation test environment for Dolphin v2.1s (512MB)
*** Set up test-perf for Flame v2.2 and Nexus-5
*** Team Building 3/09 and PTO on 3/13
|}
|}

Latest revision as of 06:01, 16 March 2015

Last week | Next week

Name Done Plan
Al
  • Week W10 (03/02~03/06)
    • MCTS v2.2
    • Bug 1116878 - [2.1] Most bluetooth tests fail with "app = null" error
      • reopened....
    • Discuss about Security tests in MCTS
  • Week W11 (03/09~03/13)
    • MCTS v2.2
    • Bug 1116878 - [2.1] Most bluetooth tests fail with "app = null" error
      • attempting to resolve it again \_/#
    • Discuss about Security tests in MCTS
      • support Christian pick it up
    • Bug 1137065 - [MCTS][2.2] Identify new IDL and writing test cases
Alison
  • Week W10 (03/02~03/06)
    • Bugs verify
    • NFC full run test - Flame-KK
    • Monitor Nexus-5-L MTBF testing
  • Week W11 (03/09~03/13)
    • Bugs verify
    • Monitor Nexus-5-L MTBF testing
    • NFC regression test - Nexus5-L
    • Prepare NFC workweek QA session
Askeing
  • Week W10 (03/02~03/06)
    • MCTS issues fixing.
    • Bug 1133394 - Add image support for semiauto tests
    • Bug 1135094 - "make test" fails with "No module named semiauto"
    • Bug 1016970 - sms.test_sms_incoming.TestSmsIncoming.test_sms_incoming should have a yes/no prompt
    • Bug 1037536 - Update the semiauto screen orientation test to use the latest api changes
    • tracking Bug 1131470 - w3c screen orientation api has changed
  • Week W11 (03/09~03/13)
    • Assist Edward for Bug 1132515.
    • MCTS issues fixing.
    • Bug 1135094 - "make test" fails with "No module named semiauto"
    • Bug 1142409 - [MCTS] add v2.2 to supported versions
    • Bug 1142421 - marionette-extension should support v2.2
    • Bug 1142422 - fxosapp-gen should support v2.2 officially
    • Bug 1142430 - [MCTS] The semiauto tests will show "Could not close CertTest App automatically..." error message.
Cynthia
  • Week W10 (03/02~03/06)
    • Take care of Flame KK v2.1 automation reports (Daily)
    • Identify apps performance drop down issue
    • Prepare to setup raptor for 2.2
    • [Stingray] Create test cases
  • Week W11 (03/09~03/13)
    • Take care of Flame KK v2.1 automation reports (Daily)
    • Assist Edward in identifying Bug 1132515
      • Understand build processes and roles
      • Prepare script for cloning Geckos during 1/26
      • Prepare build scripts for each Gecko (#100)
      • Rebuild Gecko system images (#100)
      • Flash system images in devices (#100)
      • Run performance testing for devices (#100)
      • Collect analysis result
Edward
  • Week W10 (03/02~03/06)
    • Set up done for performance environment in v2.2
    • identify performance drop down issue
    • Rework Nexus 5 for power consumption of apps
  • Week W11 (03/09~03/13)
    • Bug 1132515
      • Understand build processes and roles
      • Prepare script for cloning Geckos during 1/26
      • Prepare build scripts for each Gecko (#100)
      • Rebuild Gecko system images (#100)
      • Flash system images in devices (#100)
      • Run performance testing for devices (#100)
      • Collect analysis result
Eric
  • Week W10 (03/02~03/06)
    • Transfer Nexus 5 smoke to Marigold
    • Start Nexus 5 regression test (Marigold)
    • Start flame-kk full run (Marigold)
    • Check for v2.2 bug status
  • Week W11 (03/09~03/13)
    • Bluetooth PTS on Flame-KK
    • Check for v2.2 bug status
Gerry
  • Week W10 (03/02~03/06)
    • v2.2 feature testing
    • QAnalyst/MGSEI bugs verification/follow-up
    • Nexus 5 automation test monitoring
    • bug 1115311 - clock widget regression tests
    • Test Spect template drafting
  • Week W11 (03/09~03/13)
    • v2.2 feature testing
    • QAnalyst/MGSEI bugs verification/follow-up
    • Nexus 5 automation test monitoring
    • Privacy controls debug build env setup
    • Test Spect template drafting
Hermes
  • Week W10 (03/02~03/06)
    • Monitor v2.2+ System FE Bugs
  • Week W11 (03/09~03/13)
    • Monitor v2.2+ System FE Bugs
    • Let progress of Stagnant Bugs from QAnalyst moving
    • Study some b2g materials
Hubert
  • Week W10 (03/02~03/06)
    • Follow up Woodduck tasks and issues
    • Outsourcing weekly meeting
    • Bug work for Marigold submitted bugs
    • Modify and create test cases for In-House FOTA (Completed: 40%)
    • Draw up In-House FOTA testing strategy
  • Week W11 (03/09~03/13)
    • Follow up Woodduck tasks and issues
    • Outsourcing weekly meeting
    • Bug work for Marigold submitted bugs
    • Modify and create test cases for In-House FOTA
    • In-House FOTA testing strategy discussion with PM and RD.
    • Generate lesson learn document for woodduck project.
Mike
  • Week W10 (03/02~03/06)
    • v2.1 bug work
    • Power Consumption lab setup
    • Figure out Flame base image problem
  • Week W11 (03/09~03/13)
    • v2.1 bug work
    • Support power tool setup
    • Automation fail case investigation
Owen Ouyang
  • Week W10 (03/02~03/06)
    • g 1137081
    • Study PDF report
  • Week W11 (03/09~03/13)
    • Bug 1139760 - Enhance Report to generate PDF version
    • Study MCTS log
Paul
  • Week W10 (03/02~03/06)
    • Fixing memory report in mtbf_operation
    • Revive daily mtbf test
    • Providing fix for flash tool
  • Week W11 (03/09~03/13)
    • Investigating v2.2 mtbf run
    • Review and fix patches for test harness

-- backlog --

  • Chaos Monkey for b2g (random process killer)
  • Create daemon to emit locking status
  • Modifying crash report patch based on review (pending to b2gDevice in mozbase)
  • Followup live test run stream
  • Datazilla integration
  • Memory stress test
Shing
  • Week W10 (03/02~03/06)
    • Automation report
    • Metrics testing
    • Metrics test case design
    • MozTrap & New test case management system design brainstorming
  • Week W11 (03/09~03/13)
    • New test case management system design brainstorming
    • Metrics testing
    • Metrics test case design
Teri
  • Week W10 (03/02~03/06)
    • V2.2 Cgroup
      • 4 tests done, 2 in progress
    • V2.2 Bluedroid
      • PTS - Request ID from BT organization
      • Regression test on hold
    • Follow up on bugs list transferred by QAnalyst
  • Week W11 (03/09~03/13)
    • V2.2 Cgroup
      • 4 tests done, 2 in progress
    • V2.2 Bluedroid
      • PTS - environment setup
      • Automation Report
    • Reconfig Jenkins environment settings
    • V2.2 email attachment
      • Verified on master
      • Verify on v2.2
Walter
  • Week W10 (03/02~03/06)
    • Lab works
      • Help with Cynthia, Edward, and so on
    • Co-work with Shako
      • Jenkins, Git, and so on
    • Bugs
      • Memory Report: run, look into code
    • MTBF
      • Runs triggered
      • configuration and other modification
  • Week W11 (03/09~03/13)
    • Lab works
      • Help with Cynthia, Edward, and so on
    • MTBF operation and MTBF driver modification
    • MTBF Bugs
William Hsu
  • Week W10 (03/02~03/06)
    • [Device]
      • Bug work, 31 bugs from the time of writing this. (Ref: http://goo.gl/kgBCgI)
      • GU test on Flame v2.0 & Flame v2.1
    • [Outsourcing]
      • Investigate automation fail cases
      • RTL test case review
      • Dispatch bugs of free test
    • Others,
      • Setup automation test environment for Dolphin v2.1s (512MB)
      • Setup test-perf for Flame v2.2 and Nexus-5
      • Reply developers' inquires of RTSP and Gecko issues.
  • Week W11 (03/09~03/13)
    • [Device]
      • Bug work
      • GU test on Flame v2.0 & Flame v2.1 & Dolphin v2.1s
    • [Outsourcing]
      • Investigate automation fail cases
      • RTL test case review
      • Dispatch bugs of free test
    • Others,
      • Support PluotSorbet
      • Set up automation test environment for Dolphin v2.1s (512MB)
      • Set up test-perf for Flame v2.2 and Nexus-5
      • Team Building 3/09 and PTO on 3/13