MozillaWiki

QA/Goals/2014q4: Difference between revisions

Page Discussion

QA/Goals/2014q4 (view source)

Revision as of 22:06, 7 January 2015

1,836 bytes added ,  7 January 2015
m
fixed minor table formatting error
m (fixed minor table formatting error)
 
(6 intermediate revisions by 2 users not shown)
Line 14: Line 14:
| Firefox Ten Year
| Firefox Ten Year
| Nov 9
| Nov 9
|
| B
|
| B
|
| A
|
| A
|
| B
|
| Fast turnaround release - tough to get done in time, lots of web production work as well. Very lucky this worked out well given 33.
|-
|-
| Firefox 33
| Firefox 33
| Oct 13
| Oct 13
|
| F
|
| C
|
| A
|
| A
|
| C
|
| Black screen issues, omtc issues resulted in obscurring other issues
|-
|-
| Firefox 34
| Firefox 34
| Nov 25
| Nov 25
|
| B
|
| B-
|
| A
|
| A
|
| B-
|
| Search could have gone better - we caught issues but no time to fix before it went live. Kamil did an amazing job getting a pre-look at it and getting many of the issues filed. Secrecy of the search release really impacted our ability to be effective. Loop uplifts and coordination issues with server side proved difficult and fraught with issues, worked out in the end. Lots of confusion in user community about slow roll-out of the loop feature - need better documentation going forward
|-
|-
| PDX Work week
| PDX Work week
| Dec 1 - 6
| Dec 1 - 6
|
| n/a
|
| n/a
|
| n/a
|
| n/a
|
| n/a
|
| n/a
|-
|-
| Marketplace shift to FxAccounts
| Marketplace shift to FxAccounts
| Oct 31
| Oct 31
|
| A
|
| A
|
| A
|
| A
|
| A
|
| Moved from persona to FxAccounts. Went quite smoothly even though there was a lot of churn. Automation in place helped a lot as well.
|-
|-
| Marketplace ship on Tarako Device in new location
| Marketplace ship on Tarako Device in new location
| Oct - Nov
| Oct - Nov
|
| A
|
| A
|
| A
|
| A
|
| A
|
| Shipped without a ton of work on our side, which surprised us. We thought this would be bigger than it turned out to be.
|-
|-
| QMO Update
| QMO Update
| Nov 20?
| Nov 20?
|
| A
|
| A
|
| A
|
| A
|
| A
|
| Went really well. Docs on MDN was a lot of work, but was led well.
|-
|-
| MozFest
| MozFest
| Oct 24-26
| Oct 24-26
|
| B
|
| A
|
| A
|
| A
|
| A
|
| QA standpoint - gave out 1000 phones, and sent people back into the communities. Would have been nice to have had sessions around that to teach people to be effective contributing with the phones.
|-
|-
| Firefox OS 2.1
| Firefox OS 2.1
| Nov 30
| Nov 30
|
| A
|
| A
|
| A
|
| A
|
| A
|
| Best quality release of Fx OS to date (from partner feedback)
|-
|-
| Loop Ship
| Loop Ship
| Nov 25
| Nov 25
|
| B
|
| B
|
| A
|
| A
|
| B
|
| Largest issues were mostly out of our control - miscommunications happening between the various groups. We were all hearing different things and spending considerable amount of time to track down source of truth and adjust strategies appropriately. Volume of uplifts was high but we dealt with it, had a separate branch which helped quite a bit.
|-
|-
| E10S on by default in nightly
| E10S on by default in nightly
| Nov 9
| Nov 9
|
| A
|
| A
|
| A
|
| A
|
| A
|
| A little difficulty with some nighlty users - being able to flip it off easily in the pref pane was a huge win. The pain we encountered was good and made the e10s system more resilient going forward.
|-
|-
|}
|}
Line 134: Line 134:


== Web QA ==
== Web QA ==
* {{ok|<small>[mbrandt and shared with MDN dev]</small> Develop and stand up a JavaScript-based testing infrastructure (proof-of-concept)}} which allows Web development and Web QA to be maximally effective by sharing key points of test infrastructure, visibility, and process/workflow:
* {{miss|<small>[mbrandt and shared with MDN dev]</small> Develop and stand up a JavaScript-based testing infrastructure (proof-of-concept)}} which allows Web development and Web QA to be maximally effective by sharing key points of test infrastructure, visibility, and process/workflow:
** There are blog posts coming early next week (12/22) which will cover all of this
** '''Carried this over to Q1 2015, and will post the week of January 4th'''
*** In the interim: https://etherpad.mozilla.org/mbrandt-q4-intern-status
*** In the interim: https://etherpad.mozilla.org/mbrandt-q4-intern-status
*** There's also a pull request for the Travis-CI integration: https://github.com/mozilla/kuma/pull/2947
*** There's also a pull request for the Travis-CI integration: https://github.com/mozilla/kuma/pull/2947
Line 141: Line 141:
** {{done|<small>[mbrandt]</small> create the plan (incl. decisions, next steps/action items, owners, dependencies, agreed-upon process/workflow changes, etc.) to best-attempt to address those needs}}
** {{done|<small>[mbrandt]</small> create the plan (incl. decisions, next steps/action items, owners, dependencies, agreed-upon process/workflow changes, etc.) to best-attempt to address those needs}}
** {{done|<small>[mbrandt]</small> execute against the plan -- according to decided owners -- noting new dependencies, shifts in direction, limitations, etc.}}
** {{done|<small>[mbrandt]</small> execute against the plan -- according to decided owners -- noting new dependencies, shifts in direction, limitations, etc.}}
** {{ok|<small>[mbrandt]</small> at the end of the quarter, do a writeup (blog post?) covering the progress and any next steps for Q1 2015}}
** {{miss|<small>[mbrandt]</small> at the end of the quarter, do a writeup (blog post?) covering the progress and any next steps for Q1 2015}}
* {{done|<small>[rbillings]</small> Review current commitments in terms of projects and transition several to community and/or developers until the set of sites is both sustainable and our time spent on them is impactful}}
* {{done|<small>[rbillings]</small> Review current commitments in terms of projects and transition several to community and/or developers until the set of sites is both sustainable and our time spent on them is impactful}}
* {{done|Finalize Marketplace support requirements for Firefox OS}}
* {{done|Finalize Marketplace support requirements for Firefox OS}}
Line 147: Line 147:
*** Running here: http://jenkins1.qa.scl3.mozilla.com/view/Marketplace/
*** Running here: http://jenkins1.qa.scl3.mozilla.com/view/Marketplace/
** {{miss|<small>[krupa]</small> Have automation coverage for Payments including in-app payments}}
** {{miss|<small>[krupa]</small> Have automation coverage for Payments including in-app payments}}
<bugzilla>
*** total scope of work (done vs. remaining) here: [https://bugzilla.mozilla.org/showdependencytree.cgi?id=1015251&hide_resolved=0 bug 1015251]
{
  "blocks": "1015251",
  "status": ["NEW", "REOPENED", "ASSIGNED"]
}
</bugzilla>
*** depends on [https://bugzilla.mozilla.org/show_bug.cgi?id=1015251 bug 1015251] and [https://bugzilla.mozilla.org/show_bug.cgi?id=1083528 bug 1083528]
*** ''NOTE: we took a sizable hit due to having to switch from Persona -> FxAccounts: https://github.com/mozilla/marketplace-tests-gaia/pull/57'''
*** ''NOTE: we took a sizable hit due to having to switch from Persona -> FxAccounts: https://github.com/mozilla/marketplace-tests-gaia/pull/57'''


Pragmatic
Confirmed users
330

edits

Retrieved from "https://wiki.mozilla.org/Special:MobileDiff/1043215...1045614"