Firefox OS/DeviceQA: Difference between revisions

 
(91 intermediate revisions by 7 users not shown)
Line 1: Line 1:
==Roadmap==
==Roadmap==
Goals:  
Goals:  
* Quality assurance for each branch include Master and previous branch versions.
* Quality assurance for each branch include Firefox OS master and previous branch versions.
* Increase test coverage, automation rate. Adopt test case review and schedule before FL.
* Increase test coverage, automation rate, and Firefox OS stability. E.g., MTBF, gaia-ui-test
* File bugs in the early stage.
* Create tests and tools to verify the functionality and characteristics of Firefox OS on real devices. E.g., MCTS.
* Adopt test case review and schedule before FL.
* Work with stakeholders closely.
* Work with stakeholders closely.
*[[FirefoxOS/DeviceQA/2015TestRoadmap|2015 Testing Roadmap]]


==ToDo==
==ToDo==
* how/where to update member status
TBC
* meeting agenda link before meeting starts


==Events==
==Events==
TBD
TBC


==OS Team==
==OS Team==
* '''Team Members (Taipei)'''
* '''Team Members (Taipei)'''
** [https://phonebook.mozilla.org/#search/Alison%20Shiue Alison Shiue], [https://phonebook.mozilla.org/#search/cynthia%20tang Cynthia Tang], [https://phonebook.mozilla.org/#search/Edward%20Chen Edward Chen], [https://phonebook.mozilla.org/#search/Eric%20Chang Eric Chang], [https://phonebook.mozilla.org/#search/Gerry%20Chang Gerry Chang], [https://phonebook.mozilla.org/#search/hermes%20Cheng Hermes Cheng] , [https://phonebook.mozilla.org/#search/Shing%20Lyu Shing Lyu] & [https://phonebook.mozilla.org/#search/teri%20wen Teri Wen]
** [https://phonebook.mozilla.org/#search/Alison%20Shiue Alison Shiue], [https://phonebook.mozilla.org/#search/cynthia%20tang Cynthia Tang], [https://phonebook.mozilla.org/#search/Gerry%20Chang Gerry Chang], [https://phonebook.mozilla.org/#search/Iris%20Hsiao Iris Hsiao], [https://phonebook.mozilla.org/#search/mike%20lien Mike Lien], [https://phonebook.mozilla.org/#search/teri%20wen Teri Wen], [https://phonebook.mozilla.org/#search/william%20hsu William Hsu].


* '''Ownership & Wiki Pages'''
* '''Ownership & Wiki Pages'''
Line 23: Line 21:
** '''[[Modules/FirefoxOS|Firefox OS Module Owner]]''' - You can find RD owners here.
** '''[[Modules/FirefoxOS|Firefox OS Module Owner]]''' - You can find RD owners here.
** '''[[Gaia/UXTeam#UX_Team_Contact_Information|Firefox OS UX Contact]]''' - UX owners here.
** '''[[Gaia/UXTeam#UX_Team_Contact_Information|Firefox OS UX Contact]]''' - UX owners here.
** '''[[FirefoxOS/EPM-RM|Firefox OS EPM-RM]]''' - Project Management & Release Management team here.  
** '''[[Firefox_OS/ProgramManagement|Firefox OS EPM-RM]]''' - Project Management & Release Management team here.  
** '''[https://mana.mozilla.org/wiki/display/PM/Firefox+OS+Engineering+Status+Report Firefox OS EPM-RM]''' - Project Management & Release Management team on mana.  
** '''[https://mana.mozilla.org/wiki/display/PM/Firefox+OS+Engineering+Status+Report Firefox OS EPM-RM]''' - Project Management & Release Management team on mana.  
** '''[[B2G/QA#Firefox_OS_UX_SPEC|Firefox OS UX Spec]]''' - UX spec here.
** '''[https://wiki.mozilla.org/Firefox_OS/UX Firefox OS UX Spec]''' - UX spec here.
** '''[[B2G/QA|Firefox OS QA page for us]]''', '''[https://quality.mozilla.org/teams/firefox-os-qa/ Firefox OS QA on QMO for community]'''
** '''[[B2G/QA|Firefox OS QA page for us]]''', '''[https://quality.mozilla.org/teams/firefox-os-qa/ Firefox OS QA on QMO for community]'''
** '''[[QA|Mozilla QA]]'''
** '''[[QA|Mozilla QA]]'''


* '''Work on Moztrap'''
* '''Work on Moztrap'''
** '''[https://quality.mozilla.org/docs/test-case-writing-primer Test case creation primer]'''
** '''[https://wiki.mozilla.org/QA/Execution/MozTrap Moztrap General]'''
** '''[https://wiki.mozilla.org/QA/Execution/MozTrap Moztrap General]'''
** '''[https://wiki.mozilla.org/FirefoxOS/MoztrapGuideline Moztrap Guideline for Firefox OS]'''
** '''[https://developer.mozilla.org/en-US/docs/Mozilla/QA/Test_Case_Writing_Primer Test case creation primer]'''
** '''[https://addons.mozilla.org/EN-uS/firefox/addon/moztraphelper MozTrapHelper by Shing]''' - recommend to add this to your Firefox browser.
** '''[https://wiki.mozilla.org/FirefoxOS/MoztrapGuideline Moztrap Guideline for Firefox OS]'''  


* '''Project Overview'''
* '''Project Overview'''
** [[B2G/QA/2.2|v2.2 Overall]]
** [[B2G/QA/2.5|v2.5 - QA Overall]]
** [[B2G/QA/2.2|v2.2 - QA Overall]]
*** Put [2.2-feature-qa+] in QA whiteboard as in [https://bugzilla.mozilla.org/show_bug.cgi?id=1098289 bug 1098289]
*** Put [2.2-feature-qa+] in QA whiteboard as in [https://bugzilla.mozilla.org/show_bug.cgi?id=1098289 bug 1098289]
** [[B2G/QA/2.1|v2.1 Overall]]
** [[B2G/QA/2.1|v2.1 - QA Overall]]
** [https://wiki.mozilla.org/Release_Management/FirefoxOS/2_2_Schedule V2.2 Milestones]
** [https://wiki.mozilla.org/Release_Management/FirefoxOS/Release_Milestones Release Milestones]
** [https://wiki.mozilla.org/Release_Management/FirefoxOS/Release_Milestones Release Milestones]
** ICS of Firefox OS testing - Import this to your calendar~
** ICS of Firefox OS testing - Import this to your calendar~
Line 47: Line 44:


* '''Current Bugs & Status'''
* '''Current Bugs & Status'''
** [http://charts.mozilla.org/ Mozilla Charts] - Update status every Wednesday(GMT+8)
** [http://mozilla-twqa.github.io/QA-Dashboard/ffos/frame_features.html Features on QA Dashboard]
** [http://mozilla-twqa.github.io/QA-Dashboard/ffos/frame_features.html Features on QA Dashboard]
** [http://mozilla-twqa.github.io/QA-Dashboard/ffos/frame_bugs.html Bugs on QA Dashboard]
** [http://mozilla-twqa.github.io/QA-Dashboard/ffos/frame_bugs.html Bugs on QA Dashboard]
*** How to use: put [COM=NFC] in 'QA whiteboard', the bug shows up nicely to the count of NFC box, feature page filters for feature-b2g flag, bug page filters for blocking-b2g flag.
*** How to use: put [COM=NFC] in 'QA whiteboard', the bug shows up nicely to the count of NFC box, feature page filters for feature-b2g flag, bug page filters for blocking-b2g flag.
** [http://charts.mozilla.org/ Mozilla Charts]
** [https://mozqa.etherpad.mozilla.org/b2g-qa-roundtable? Weekly QA Roundtable]
*** Update status every Wednesday(GMT+8)
** [https://trello.com/b/VduAcqNM/os-team Trello page]
** [[FirefoxOS/DeviceQA#Meeting_Minutes|Meeting minutes]]


==Device Support Team==
*'''Device'''
Members: [https://phonebook.mozilla.org/#search/al%20tsai Al Tsai], [https://phonebook.mozilla.org/#search/Fu-Hung%20Yen Askeing Yen], [https://phonebook.mozilla.org/#search/hubert%20lu Hubert Lu], [https://phonebook.mozilla.org/#search/mike%20lien Mike Lien], [https://phonebook.mozilla.org/#search/owen%20ouyang Owen Ouyang], [https://phonebook.mozilla.org/#search/william%20hsu William Hsu].
** [https://wiki.mozilla.org/Firefox_OS/Flame Flame]
* [[FirefoxOS/DeviceQA/DeviceQAWiki|Device QA Wiki]]
** [[B2G/QA/Woodduck_tracking|Woodduck Wiki]]
* [[B2G/QA/Woodduck_tracking|Woodduck Wiki]]
** [https://wiki.mozilla.org/Firefox_OS/Tarako Tarako]
* [[FirefoxOS/DeviceQA/CollectLogs|Methods to collect Logs]]
** [https://mana.mozilla.org/wiki/display/PM/Sony Tako]
* [[FirefoxOS/DeviceQA/2.1PostCC| v2.1 Post CC]]
** [https://mana.mozilla.org/wiki/display/PM/Project+Dolphin Dolphin]
* MCTS
** [https://mana.mozilla.org/wiki/display/PM/FxOS++Red+Square+Project Red Square]
** [https://wiki.mozilla.org/Firefox_OS/Smart_TV Smart TV], [https://wiki.mozilla.org/TV_2.5 Smart TV 2.5]
 
*'''Performance'''
** [https://wiki.mozilla.org/Firefox_OS/Performance/Power_Consumption Power Consumption]
** [https://wiki.mozilla.org/Firefox_OS/Performance OS performance]


==Automation Team==
==Automation Team==
Members: [https://phonebook.mozilla.org/#search/paul%20yang Paul Yang], [https://phonebook.mozilla.org/#search/Walter%20Chen Walter Chen].
Members: [https://phonebook.mozilla.org/#search/Fu-Hung%20Yen Askeing Yen], [https://phonebook.mozilla.org/#search/paul%20yang Paul Yang], [https://phonebook.mozilla.org/#search/Shako Shako Ho], [https://phonebook.mozilla.org/tree.php#search/slyu@mozilla.com Shing Lyu], [https://phonebook.mozilla.org/#search/Walter%20Chen Walter Chen].
 
* [https://wiki.mozilla.org/B2G/QA/Test_Automation Test Automation]
* [https://developer.mozilla.org/en-US/Firefox_OS/Automated_testing/Gaia_integration_tests Gaia Integration tests(GIJ)]
* [https://wiki.mozilla.org/QA/Automation/Projects/MTBF MTBF Wiki]
* [https://wiki.mozilla.org/QA/Automation/Projects/MTBF MTBF Wiki]
* [https://github.com/mozilla-b2g/fxos-certsuite/releases MCTS Github]
* [https://github.com/askeing/b2g-util-python B2G python tools]
* [https://github.com/askeing/B2G-JS-REPL Interacting with B2G by JS]
* [https://github.com/mozilla-b2g/MozITP MozITP]
* [https://github.com/Mozilla-TWQA/B2G-flash-tool B2G script tools] (deprecated, pls access '''B2G python tools''')


==Weekly Meeting==
==Weekly Meeting==
* Cross Teams
# Taipei QA Weekly Meeting
** Time: 3:00PM (GMT+8) every Friday
#* Time: 3:00PM (Taipei time), every Tuesday
** Meeting Room: Eden
#* Meeting Room: Eden
 
# OS Team
* OS Team
#* Time: 4:00PM (Taipei time), every Wednesday
** Time: 4:00PM (GMT+8) every Wednesday
#* Meeting Room: Utopia
** Meeting Room: Utopia
# Automation Team
 
#* Time: 4:30PM (Taipei time), bi-weekly Wednesday
* Device Team
#* Meeting Room: Eden
** Time: 11:00AM (GMT+8) every Wednesday
# TW-EU Weekly Meeting
** Meeting Room: Eden
#* Time: 04:30PM (Taipei time), bi-weekly Wednesday
#* Meeting Room: Vidyo
# US-TW Weekly Meeting
#* Time: 08:00AM (Taipei time), bi-weekly Thursday
#* Meeting Room: Vidyo


==Weekly Reports==
==Weekly Reports==
{| class="wikitable"
* [https://goo.gl/YOr5L8 QA Weekly Status/Report (Q1 2016)]
! align="center" style="width: 25%;" | 2015 Q1
! align="center" style="width: 25%;" | 2015 Q2
! align="center" style="width: 25%;" | 2015 Q3
! align="center" style="width: 25%;" | 2015 Q4
|-
|
*[[FirefoxOS/DeviceQA/2014-12-29WeeklyReport|(W01) 12-29]]
*[[FirefoxOS/DeviceQA/2015-01-05WeeklyReport|(W02) 01-05]]
*[[FirefoxOS/DeviceQA/2015-01-12WeeklyReport|(W03) 01-12]]
*[[FirefoxOS/DeviceQA/2015-01-19WeeklyReport|(W04) 01-19]]
*[[FirefoxOS/DeviceQA/2015-01-26WeeklyReport|(W05) 01-26]]
*[[FirefoxOS/DeviceQA/2015-02-02WeeklyReport|(W06) 02-02]]
*[[FirefoxOS/DeviceQA/2015-02-09WeeklyReport|(W07) 02-09]]
*[[FirefoxOS/DeviceQA/2015-02-16WeeklyReport|(W08) 02-16]]
*[[FirefoxOS/DeviceQA/2015-02-23WeeklyReport|(W09) 02-23]]
*[[FirefoxOS/DeviceQA/2015-03-02WeeklyReport|(W10) 03-02]]
*[[FirefoxOS/DeviceQA/2015-03-09WeeklyReport|(W11) 03-09]]
*[[FirefoxOS/DeviceQA/2015-03-16WeeklyReport|(W12) 03-16]]
*[[FirefoxOS/DeviceQA/2015-03-23WeeklyReport|(W13) 03-23]]
*[[FirefoxOS/DeviceQA/2015-03-30WeeklyReport|(W14) 03-30]]
|
*[[FirefoxOS/DeviceQA/2015-04-06WeeklyReport|(W15) 04-06]]
*[[FirefoxOS/DeviceQA/2015-04-13WeeklyReport|(W16) 04-13]]
*[[FirefoxOS/DeviceQA/2015-04-20WeeklyReport|(W17) 04-20]]
*[[FirefoxOS/DeviceQA/2015-04-27WeeklyReport|(W18) 04-27]]
*[[FirefoxOS/DeviceQA/2015-05-04WeeklyReport|(W19) 05-04]]
*[[FirefoxOS/DeviceQA/2015-05-11WeeklyReport|(W20) 05-11]]
|
|
|}


==Meeting Minutes==
==Meeting Minutes==
{| class="wikitable"
* [https://public.etherpad-mozilla.org/p/b2g-qa-roundtable B2G QA Roundtable - Latest meeting minutes]
! align="center" style="width: 25%;" | 2015 Q1
* [https://wiki.mozilla.org/B2G/QA/Meetings Archived meeting minutes]
! align="center" style="width: 25%;" | 2015 Q2
! align="center" style="width: 25%;" | 2015 Q3
! align="center" style="width: 25%;" | 2015 Q4
|-
|
*[[FirefoxOS/DeviceQA/2015-01-09MeetingMinutes|(W02) 2015-01-09]]
*[[FirefoxOS/DeviceQA/2015-01-13MeetingMinutes|(W03) 2015-01-13 General]]
*[[FirefoxOS/DeviceQA/2015-01-14Notes|(W03) 2015-01-14 OS]]
*[[FirefoxOS/DeviceQA/2015-02-13MeetingMinutes|(W07) 2015-02-13]]
*[[FirefoxOS/DeviceQA/2015-03-13MeetingMinutes|(W11) 2015-03-13]]
*[[FirefoxOS/DeviceQA/2015-03-27MeetingMinutes|(W13) 2015-03-27]]
|
*[[FirefoxOS/DeviceQA/2015-04-17MeetingMinutes|(W16) 2015-04-17]]
*[[FirefoxOS/DeviceQA/2015-05-08MeetingMinutes|(W19) 2015-05-08]]
*[[FirefoxOS/DeviceQA/2015-05-15MeetingMinutes|(W20) 2015-05-15]]
 
|
|
|}
 
==Study Group==
*Any topic is welcome. We can do sharing, brainstorming, discussion.
{| class="wikitable"
! align="center" style="width: 25%;" | 2014 Q1
! align="center" style="width: 25%;" | 2014 Q2
! align="center" style="width: 25%;" | 2014 Q3
! align="center" style="width: 25%;" | 2014 Q4
|-
| || ||
*[https://docs.google.com/a/mozilla.com/document/d/1AVMl0GrAQmr26CwY928uSVpBhFqAnk6L4CWNNurBEE8/edit Topics]
*[https://docs.google.com/a/mozilla.com/presentation/d/1_0wMfxO91NhWucW4lNUlR7uEIIFzkav7W2vh8PRpK_g/edit#slide=id.g377812d27_028 Video Gamer by Mike]
*[https://docs.google.com/a/mozilla.com/presentation/d/1rNAscvx17tvZfDC1BS50397vq9cyu0aihAnmBv1nPpc/edit#slide=id.g378b7f7a6_040 NowSMS sharing by eric]
*[http://askeing.github.io/Slides/git-tips/ Git by Askeing]
*[https://docs.google.com/a/mozilla.com/document/d/1HfLsS-Y2N4aTay8Iwq9ji-AN3Y_bKgaLl88HQpNYz0g/edit?usp=sharing Keyboard萬歲 by Shing]
* [http://bit.ly/1qBojxD Work out myths by Gerry]
* How to work with Partner by Paul
* How to Find a Good and Cheap Hotel by Walter
* Domain knowledge of Mobility introduction by Hubert
* Experience sharing for wearable device by everyone has wearable device (r?) 
||
|-
|}


==Links==
==Links==
* [https://github.com/Mozilla-TWQA Device QA Github]
* [https://github.com/Mozilla-TWQA Device QA Github]
* [https://taiwan.etherpad.mozilla.org/107 QA Guideline for new comers]
* [https://drive.google.com/a/mozilla.com/?tab=mo#folders/0B8iJiMtqUSFRYmFjTGFWdEFHREE Quick Guides] (Google Drive, please access it by LDAP account)
* [https://drive.google.com/a/mozilla.com/?tab=mo#folders/0B8iJiMtqUSFRYmFjTGFWdEFHREE Quick Guides] (Google Drive, please access it by LDAP account)
** [https://docs.google.com/document/d/1cIXfSrlOx-qJ7OnVL2w2jkuegGo4xbjZojNRslHq3Jo Automated Testing B2G]
** [https://docs.google.com/document/d/1nO2hghaT6eTQI-Jdmgpb3aLrl7ikk524NKvl4FuatPA B2GPerf]
** [https://docs.google.com/document/d/1IBFi-_Axui8XDJhOM88psZQCjTUGDKg2cMS0Bj2LouY Building B2G]
** [https://docs.google.com/document/d/1V6bgtos43RcW3Z4WnqzRC1XWTkCqukCoSnGXnnFJV0Y Components Test of B2G Porting]
** [https://docs.google.com/document/d/1ijqN5VlG4cc5UmBa02m2vxIcI5lUwQXeGWZO62mRE2E Overall Firefox OS]
** [https://docs.google.com/document/d/12Sz19aa7GzikZtv6eWXFemXUV-aCHAPr0Qj-E3gP4Q8 Jenkins]
* [https://dl.dropboxusercontent.com/u/7281903/docs/bkm_tiddly.html#Firefox%20OS Shing's random note on Firefox OS Testing]
* [https://dl.dropboxusercontent.com/u/7281903/docs/bkm_tiddly.html#Firefox%20OS Shing's random note on Firefox OS Testing]
* [https://wiki.mozilla.org/FirefoxOS/DeviceQA/Gaia-UI-Tests-On-Jenkins#How_to_setup_gaia-ui-tests Tips for Gaia-UI-Tests on Jenkins]
* [https://wiki.mozilla.org/FirefoxOS/DeviceQA/Gaia-UI-Tests-On-Jenkins#How_to_setup_gaia-ui-tests Tips for Gaia-UI-Tests on Jenkins]
Line 171: Line 114:
==MISC==
==MISC==
==PTO Information==
==PTO Information==
* brhuang 04/07~04/12
* [https://pto.mozilla.com.tw/calendar.php PTO Calendar]
* Al Tsai 04/07~04/14
* Hermes  5/25~5/29, 10/12~10/16
* Owen Ouyang 2/12~2/17
* William Hsu 3/21~3/29 (Marriage leave)
* William Hsu 5/07~5/11 (Marriage leave)
* Teri Wen 5/20~6/4


== Device QA outsource ==
== Device QA outsource ==
=== Overview ===
*'''Overview''' (Waiting for information)
Marigold is in charge of executing FxOS testing, and they covers following tasks requested by Mozilla.
 
(Marigold is located in Chengdu, China)
*'''Management''' (Waiting for information)
 
== Member ==
=== Current members ===
* Al Tsai
* Walter Chen
* Askeing Yen
* Paul Yang
* Alison Shiue
* Mike Lien
* Gerry Chang
* Cynthia Tang
* Shako Ho
* Iris Hsiao
 
<span style="color:#D8BFD8"> NOTE: Info parsed from phonebook </span>


* Manual Test
=== Former members ===
** Daily smoke test
* Bruce Weng
** Regression test
* Brian Huang
** Full test
* Edward Chen
** RAT test
* Enpei Chu
** Bug work (qawanted,regressionwindow-wanted,verifyme)
* Eric Chang
* Power consumption test
* Lawrence Lin
* Gaia-UI-test [Planning]
* Hubert Lu
* Performance test [Planning]
* Hermes Cheng
* Patch verify [Planning]
* Shing Lyu
* Teri Wen
* William Hsu


=== Information ===
== Reference ==
* [[/Marigold_member_list | Marigold engineer list]]
* [http://mzl.la/1xHcWOp Need-Info List]
* [https://wiki.mozilla.org/FirefoxOS/DeviceQA/2014Archived 2014 Archived information]
* [https://wiki.mozilla.org/FirefoxOS/DeviceQA/2014Archived 2014 Archived information]
* [https://wiki.mozilla.org/FirefoxOS/DeviceQA/2015Archived 2015 Archived information]
* [https://www.w3.org/QA/glossary W3C QA Glossary]
* [https://github.com/sotaroikeda/firefox-diagrams/wiki/Firefox-Diagrams Firefox OS Diagrams]

Latest revision as of 03:14, 29 December 2016

Roadmap

Goals:

  • Quality assurance for each branch include Firefox OS master and previous branch versions.
  • Increase test coverage, automation rate, and Firefox OS stability. E.g., MTBF, gaia-ui-test
  • Create tests and tools to verify the functionality and characteristics of Firefox OS on real devices. E.g., MCTS.
  • Adopt test case review and schedule before FL.
  • Work with stakeholders closely.

ToDo

TBC

Events

TBC

OS Team

  • Current Bugs & Status

Automation Team

Members: Askeing Yen, Paul Yang, Shako Ho, Shing Lyu, Walter Chen.

Weekly Meeting

  1. Taipei QA Weekly Meeting
    • Time: 3:00PM (Taipei time), every Tuesday
    • Meeting Room: Eden
  2. OS Team
    • Time: 4:00PM (Taipei time), every Wednesday
    • Meeting Room: Utopia
  3. Automation Team
    • Time: 4:30PM (Taipei time), bi-weekly Wednesday
    • Meeting Room: Eden
  4. TW-EU Weekly Meeting
    • Time: 04:30PM (Taipei time), bi-weekly Wednesday
    • Meeting Room: Vidyo
  5. US-TW Weekly Meeting
    • Time: 08:00AM (Taipei time), bi-weekly Thursday
    • Meeting Room: Vidyo

Weekly Reports

Meeting Minutes

Links

MISC

PTO Information

Device QA outsource

  • Overview (Waiting for information)
  • Management (Waiting for information)

Member

Current members

  • Al Tsai
  • Walter Chen
  • Askeing Yen
  • Paul Yang
  • Alison Shiue
  • Mike Lien
  • Gerry Chang
  • Cynthia Tang
  • Shako Ho
  • Iris Hsiao

NOTE: Info parsed from phonebook

Former members

  • Bruce Weng
  • Brian Huang
  • Edward Chen
  • Enpei Chu
  • Eric Chang
  • Lawrence Lin
  • Hubert Lu
  • Hermes Cheng
  • Shing Lyu
  • Teri Wen
  • William Hsu

Reference