QA/Goals/2014q2: Difference between revisions

| A

| A

| C

| B

| B-

| A

* {{done|Improve Geolocation Testing by ensuring that if geolocation code fails to work the failure will be noticed}} [juanb]

* {{drop|Improve regression testing for gaming technologies by unhiding webGL automated tests, ensuring automated emscripten tests are run daily}} [kamil]

* {{done|Create necessary test materials and infrastructure for Loop Product to ensure testing can be shared with partners}} [ashughes]

* {{done|Complete and publish metrics from bugs, regressions, root cause analysis, stability, and uplifts}} [lizzard,kairo]

* {{miss|Ensure Mozmill systems are controlled by puppet for all updates on Mac and Linux systems}}

** RelOps is not able to spend too much time on us given they have their own goals to finish. So what's left to do is the coverage for Java and Flash, which is blocked on {{bug|1032133}}

* {{done|Set up TPS (sync automation) continuous integration}}

* {{done|Automate specific tests as identified by Desktop team as features needing automation (Aim to automate 90% of requests)}}

* {{done|Provide automation training to larger community through 4 automation training events}}

* {{miss|Replace one component of Mozmill with the necessary changes to have it using marionette as its engine in the future}}

* {{done|Get Flame devices running in on-device automation within 5% of the same failure rate as the Buri phones}}

* {{miss|Complete and publish metrics on project health started in Q1}}

* {{done|Expand marketplace payment testing by improving automated regression testing}}

** [https://github.com/mozilla/marketplace-tests-gaia/commits/master commits] and [http://selenium.qa.mtv2.mozilla.com:8080/view/Marketplace/job/b2g.hamachi.mozilla-b2g28_v1_3.v1.3.marketplace/ latest results]

* {{done|Build a proof-of-concept dashboard to display smoketest information}} [johan]

* {{miss|Create a plan to engage community testing now that there are contributors armed with devices (tablets and flames)}}[marcia - falls under community goal as well]  

* {{miss|Complete and publish project metrics identified in Q1}} [geo]

* {{done|Optimize team support so that we can use the timezones and different teams to take advantage of our geolocations}} [tony]

** {{done|distribute mainstream support to US (flame), partner device support to TW (dolphin, tarako)}}

* {{done|Support efforts to create automated regression testing for graphics on Fx OS}} [no-jun]

* {{done|Work with desktop to ensure loop server system is thoroughly covered by test plans}}[pdehaan/jbonacci]

* {{done|Establish a Services QA 101 tiger team of contributors and lead them to help ensure Tokenserver, FindMyDevice, Sync 1.5, Simplepush etc are seeing adequate test coverage for the release level of each of those systems}} [kthiessen]

** {{done|Talk to developers on the above project teams to find out where they need help.}}

** {{done|Have a conversation with a community leader to help co-ordinate the tiger team.}}

* {{done|OAuth sign in for Marketplace and FMD cross browser automation}} [kthiessen/team]

* {{miss|Increase quality level of webRTC code by expanding covered scenarios being tested (non-virtual systems, TURN, STUN, NATs, integrating with Loop partners, etc)}}

* {{done|Continue expanding prioritized backlog with an eye toward other platform related projects}}

** {{miss|Investigate using Mulet as a possible Task in One and Done [marcia]}}

** {{done|Identify a set of QA contributors that should be the first ones to get the Flame and or Flatfish devices [marcia]}}

** {{done|Create getting Started Documents on QMO in Firefox OS section [marcia]}}

** {{done|Provide historical and ongoing data for QA community contributions to the Baloo project and define what reports we need back from them}} [lizzard] {{Bug|990667}}{{Bug|1017201}}

** {{done|Produce one specific piece of QA swag to deploy to contributors}} [marcia]

** {{miss|Design a QA contributor swag pack}} [marcia] -> Stretch Goal

** {{done|Keyword/flag created in Bugzilla/Github to track nominations for swag}} [kthiessen]

*** {{miss|Instead of "reinvigorating" the entire test day, focus on providing a roadmap and a set of curricula to help other community leads to start doing the "reinvigorating" of the test days throughout Q3/Q4}}

** {{miss|Develop an Events Strategy}} [marcia] -> Stretch Goal

** {{done|Start a "[[QA/Contribute/QA_101|QA 101]]" working group in consultation with the CBT Education Working Group, with emphasis on creating curriculum for teaching Mozillian contributors generally applicable QA skills}} [kthiessen]

** {{done|Develop 1 or more clear contribution paths per team}} [Everyone]

*** [[QA/Services/Contribute/Manual Testing|Manual Testing with the Cloud Services QA Team]]

*** [https://wiki.mozilla.org/QA/FXOS/Contributor_levels FX OS]