TestEngineering: Difference between revisions

From MozillaWiki
Jump to navigation Jump to search
(Formatting)
 
(12 intermediate revisions by 4 users not shown)
Line 1: Line 1:
== Mission Statement ==
The Test Engineering team supports the larger Firefox organization by enabling identification of risk to our products and eliminating quality related blind spots through tooling, testing, automation, benchmarks, and reporting.


= Overview =
More info is at: http://firefox-test-engineering.readthedocs.io/en/latest/
Firefox Test Engineering oversees the test automation, infrastructure, and manual testing for all of Firefox's services, sites, and apps that are external to the core browsers (and in some cases within the browsers as well).


= Mission =
== Focus Areas ==
Our mission is to provide testing and tools to positively impact the quality of Mozilla sites, apps, and services.
* Interop
* Performance
* GeckoView
* Fenix
* Amazon
* CI Automation
* Ecosystem
* Telemetry
* Premium Services
* Energy
* Accessibility
* Reporting
* Monitoring
* Experiments


= The Team =
== Enduring Objectives ==
* Manager: Stuart Philp
* Increase visibility into product risks
* Technical Lead and Manager, Customization group: Krupa Raj
** Streamline reporting
* Technical Lead, UI group: [https://mozillians.org/u/davehunt/ Dave Hunt]
** Reduce blind spots
* Technical Lead, Services group: Richard Pappalardo
* Improve efficiency and clarity of risk assessments
* Staff Engineer: Tarek Ziade
** Tight feedback loops
* Manager, Services group: [[User:Kthiessen|Karl Thiessen]]
** Be opinionated (i.e binary or traffic light recommendations)
* Senior Test Engineer: Peter deHaan
** Reduce guesswork, roundtrips
* Staff Test Engineer: Chris Hartjes
** Standardize between projects and types of reports
* Senior Test Engineer: [https://mozillians.org/en-US/u/stephend/ Stephen Donner]
* Maintain or improve coverage and quality standards
* Senior Test Engineer: Kevin Brosnan
** Identify and fill gaps
* Senior Test Engineer: Aaron Train
** Document and measure existing work
* Senior Test Engineer: Matt Brandt
** Establish/Improve release criteria consistency
* Senior Test Engineer: Rebecca Billings
** Reduce effort on maintenance
* Senior Test Engineer: John Dorlus
* Reduce cross-functional friction
* Senior Test Engineer: No-Jun Park
** Advocacy
* Junior Test Engineer: Benny Forehand Jr.
** Reporting
** Tools
** Benchmarks
** Relationship building


=Technical Groups=
== People ==
Firefox Test Engineering is divided into three technical groups. These groups align on the skills, tools, and focus needed to provide the coverage and quality for the projects they oversee. Each technical group has a technical lead, who oversees all of the project's testing needs and best practices.
Director: Stuart Philp
 
<br>Architect: Tarek Ziade
==User Interfaces==
<br>Interop. Manager: David Burns
* https://wiki.mozilla.org/TestEngineering/UI
<br>Performance. Manager: Dave Hunt
* Lead: Dave Hunt
<br>Ecosystem. Manager: Krupa Raj
 
<br>CI Automation. Manager: Joel Maher
==Services==
<br>Mobile. Manager: No-Jun Park
* https://wiki.mozilla.org/TestEngineering/Services
* Lead: Richard Pappalardo
* Manager: Karl Thiessen
 
==Customization==
* https://wiki.mozilla.org/TestEngineering/Customization
* Lead: Krupa Raj
 
=Full Project List=
 
The source of truth for FTE Projects is our [http://servicebook.dev.mozaws.net Servicebook].  The table below may be out of date.
 
{| class="wikitable sortable"
|-
! Project !! Primary !! Secondary !! IRC Channel !! Technical Group !! Test Suite !! Unit !! Functional/UI !! Load !! Performance !! Accessibility !! Security !! Localization !! Swagger (route def)
|-
| PageShot (Test Pilot) || Peter || Softvision || #pageshot || Customization
| style="background:lightgray;text-align:center;" | n/a
| style="background:lightgray;text-align:center;" | n/a
| style="background:pink;text-align:center;" | none
| style="background:lightgray;text-align:center;" | n/a
| style="background:lightgray;text-align:center;" | n/a
| style="background:lightgray;text-align:center;" | n/a
| style="background:lightgray;text-align:center;" | n/a
| style="background:lightgray;text-align:center;" | n/a
| style="background:lightgray;text-align:center;" | n/a
|-
| NoMore404s (Test Pilot) || Karl || Softvision || #testpilot || Customization
| style="background:lightgreen;text-align:center;" | [https://testrail.stage.mozaws.net/index.php?/suites/view/35]
| style="background:lightgray;text-align:center;" | n/a
| style="background:pink;text-align:center;" | none
| style="background:lightgray;text-align:center;" | n/a
| style="background:lightgray;text-align:center;" | n/a
| style="background:lightgray;text-align:center;" | n/a
| style="background:lightgray;text-align:center;" | n/a
| style="background:lightgray;text-align:center;" | n/a
| style="background:lightgray;text-align:center;" | n/a
|-
| MinVid (Test Pilot) || Peter || Softvision || #testpilot || Customization
| style="background:lightgray;text-align:center;" | n/a
| style="background:lightgray;text-align:center;" | n/a
| style="background:pink;text-align:center;" | none
| style="background:lightgray;text-align:center;" | n/a
| style="background:lightgray;text-align:center;" | n/a
| style="background:lightgray;text-align:center;" | n/a
| style="background:lightgray;text-align:center;" | n/a
| style="background:lightgray;text-align:center;" | n/a
| style="background:lightgray;text-align:center;" | n/a
|-
| Fathom (Test Pilot) || Peter || Softvision || #testpilot || Customization
| style="background:lightgray;text-align:center;" | n/a
| style="background:lightgray;text-align:center;" | n/a
| style="background:pink;text-align:center;" | none
| style="background:lightgray;text-align:center;" | n/a
| style="background:lightgray;text-align:center;" | n/a
| style="background:lightgray;text-align:center;" | n/a
| style="background:lightgray;text-align:center;" | n/a
| style="background:lightgray;text-align:center;" | n/a
| style="background:lightgray;text-align:center;" | n/a
|-
| Heatmap (Test Pilot) || Peter || Softvision || #testpilot || Customization
| style="background:lightgray;text-align:center;" | n/a
| style="background:lightgray;text-align:center;" | n/a
| style="background:pink;text-align:center;" | none
| style="background:lightgray;text-align:center;" | n/a
| style="background:lightgray;text-align:center;" | n/a
| style="background:lightgray;text-align:center;" | n/a
| style="background:lightgray;text-align:center;" | n/a
| style="background:lightgray;text-align:center;" | n/a
| style="background:lightgray;text-align:center;" | n/a
|-
| Universal Search (Test Pilot) || Stephen || Peter || #universal-search || Customization
| style="background:lightgray;text-align:center;" | n/a
| style="background:lightgray;text-align:center;" | n/a
| style="background:pink;text-align:center;" | none
| style="background:lightgray;text-align:center;" | n/a
| style="background:lightgray;text-align:center;" | n/a
| style="background:lightgray;text-align:center;" | n/a
| style="background:lightgray;text-align:center;" | n/a
| style="background:lightgray;text-align:center;" | n/a
| style="background:lightgray;text-align:center;" | n/a
|-
| Activity Stream (Test Pilot) || Peter || John || #activity-stream || Customization
| style="background:lightgray;text-align:center;" | n/a
| style="background:lightgray;text-align:center;" | n/a
| style="background:pink;text-align:center;" | none
| style="background:lightgray;text-align:center;" | n/a
| style="background:lightgray;text-align:center;" | n/a
| style="background:lightgray;text-align:center;" | n/a
| style="background:lightgray;text-align:center;" | n/a
| style="background:lightgray;text-align:center;" | n/a
| style="background:lightgray;text-align:center;" | n/a
|-
| WebExtensions || Krupa || Softvision || #webextensions || Customization
| style="background:lightgreen;text-align:center;" | [https://testrail.stage.mozaws.net/index.php?/suites/view/37]
| style="background:lightgray;text-align:center;" | n/a
| style="background:pink;text-align:center;" | none
| style="background:lightgray;text-align:center;" | n/a
| style="background:lightgray;text-align:center;" | n/a
| style="background:lightgray;text-align:center;" | n/a
| style="background:lightgray;text-align:center;" | n/a
| style="background:lightgray;text-align:center;" | n/a
| style="background:lightgray;text-align:center;" | n/a
|-
| Test Pilot (web site) || Peter || John || #testpilot || Customization
| style="background:lightgray;text-align:center;" | n/a
| style="background:lightgray;text-align:center;" | n/a
| style="background:pink;text-align:center;" | none
| style="background:lightgray;text-align:center;" | n/a
| style="background:lightgray;text-align:center;" | n/a
| style="background:lightgray;text-align:center;" | n/a
| style="background:lightgray;text-align:center;" | n/a
| style="background:lightgray;text-align:center;" | n/a
| style="background:lightgray;text-align:center;" | n/a
|-
| Socorro || Matt || Richard || #socorro || Customization
| style="background:lightyellow;text-align:center;" | [https://testrail.stage.mozaws.net/index.php?/projects/overview/34]
| style="background:lightgreen;text-align:center;" | [https://github.com/mozilla/socorro/tree/master/socorro/unittest]
| style="background:lightgreen;text-align:center;" | [https://github.com/mozilla/socorro/tree/master/e2e-tests]
| style="background:lightgray;text-align:center;" | n/a
| style="background:lightgray;text-align:center;" | n/a
| style="background:lightgray;text-align:center;" | n/a
| style="background:lightgray;text-align:center;" | n/a
| style="background:lightgray;text-align:center;" | n/a
| style="background:lightgray;text-align:center;" | n/a
|-
| Telemetry || John || Softvision || #telemetry || Customization
| style="background:lightgray;text-align:center;" | n/a
| style="background:lightgray;text-align:center;" | n/a
| style="background:pink;text-align:center;" | none
| style="background:lightgray;text-align:center;" | n/a
| style="background:lightgray;text-align:center;" | n/a
| style="background:lightgray;text-align:center;" | n/a
| style="background:lightgray;text-align:center;" | n/a
| style="background:lightgray;text-align:center;" | n/a
| style="background:lightgray;text-align:center;" | n/a
|-
| addons.mozilla.org || Krupa || Softvision || #amo || Customization
| style="background:lightgray;text-align:center;" | n/a
| style="background:lightgray;text-align:center;" | n/a
| style="background:lightgreen;text-align:center;" | [https://github.com/mozilla/Addon-Tests] [https://github.com/mozilla/addons-server/tree/master/tests/ui] [https://github.com/mozilla/addons-frontend/tree/master/tests/ui]
| style="background:lightgray;text-align:center;" | n/a
| style="background:lightgray;text-align:center;" | n/a
| style="background:lightgray;text-align:center;" | n/a
| style="background:lightgray;text-align:center;" | n/a
| style="background:lightgray;text-align:center;" | n/a
| style="background:lightgray;text-align:center;" | n/a
|-
| TabCenter (Test Pilot) || Peter || Softvision || #testpilot || Customization
| style="background:lightgray;text-align:center;" | n/a
| style="background:lightgray;text-align:center;" | n/a
| style="background:pink;text-align:center;" | none
| style="background:lightgray;text-align:center;" | n/a
| style="background:lightgray;text-align:center;" | n/a
| style="background:lightgray;text-align:center;" | n/a
| style="background:lightgray;text-align:center;" | n/a
| style="background:lightgray;text-align:center;" | n/a
| style="background:lightgray;text-align:center;" | n/a
|-
| Blok (Test Pilot) || Rebecca || Softvision || #testpilot || Customization
| style="background:lightgray;text-align:center;" | n/a
| style="background:lightgreen;text-align:center;" | [https://github.com/mozilla/blok/tree/master/tests]
| style="background:pink;text-align:center;" | none
| style="background:lightgray;text-align:center;" | n/a
| style="background:lightgray;text-align:center;" | n/a
| style="background:lightgray;text-align:center;" | n/a
| style="background:lightgray;text-align:center;" | n/a
| style="background:lightgray;text-align:center;" | n/a
| style="background:lightgray;text-align:center;" | n/a
|-
| Treeherder || Rebecca || Dave || #treeherder || User Interface
| style="background:lightgray;text-align:center;" | n/a
| style="background:lightgreen;text-align:center;" | [https://github.com/mozilla/treeherder/tree/master/tests ]
| style="background:lightgreen;text-align:center;" | [https://github.com/mozilla/treeherder/tree/master/tests/jenkins]
| style="background:lightgray;text-align:center;" | n/a
| style="background:lightgray;text-align:center;" | n/a
| style="background:lightgray;text-align:center;" | n/a
| style="background:lightgray;text-align:center;" | n/a
| style="background:lightgray;text-align:center;" | n/a
| style="background:lightgray;text-align:center;" | n/a
|-
| developer.mozilla.org || Matt || Dave || #mdndev || User Interface
| style="background:lightgreen;text-align:center;" | [https://testrail.stage.mozaws.net/index.php?/projects/overview/24]
| style="background:lightgreen;text-align:center;" | [https://github.com/mozilla/kuma/tree/master/tests]
| style="background:lightgreen;text-align:center;" | [https://github.com/mozilla/kuma/tree/master/tests/functional]
| style="background:lightgray;text-align:center;" | n/a
| style="background:lightgray;text-align:center;" | n/a
| style="background:lightgray;text-align:center;" | n/a
| style="background:lightgray;text-align:center;" | n/a
| style="background:lightgray;text-align:center;" | n/a
| style="background:lightgray;text-align:center;" | n/a
|-
| mozilla.org || Rebecca || Dave || #bedrock || User Interface
| style="background:lightgray;text-align:center;" | n/a
| style="background:lightgray;text-align:center;" | n/a
| style="background:lightgreen;text-align:center;" | [https://github.com/mozilla/bedrock/tree/master/tests/functional]
| style="background:lightgray;text-align:center;" | n/a
| style="background:lightgray;text-align:center;" | n/a
| style="background:lightgray;text-align:center;" | n/a
| style="background:lightgray;text-align:center;" | n/a
| style="background:lightgray;text-align:center;" | n/a
| style="background:lightgray;text-align:center;" | n/a
|-
| FoxPuppet || Benny || Dave/John || #fx-test || User Interface
| style="background:lightgray;text-align:center;" | n/a
| style="background:lightgray;text-align:center;" | n/a
| style="background:lightgray;text-align:center;" | n/a
| style="background:lightgray;text-align:center;" | n/a
| style="background:lightgray;text-align:center;" | n/a
| style="background:lightgray;text-align:center;" | n/a
| style="background:lightgray;text-align:center;" | n/a
| style="background:lightgray;text-align:center;" | n/a
| style="background:lightgray;text-align:center;" | n/a
|-
| Activity Stream (iOS) || Aaron || No-Jun || #mobile || User Interface
| style="background:lightgray;text-align:center;" | n/a
| style="background:lightgray;text-align:center;" | n/a
| style="background:pink;text-align:center;" | none
| style="background:lightgray;text-align:center;" | n/a
| style="background:lightgray;text-align:center;" | n/a
| style="background:lightgray;text-align:center;" | n/a
| style="background:lightgray;text-align:center;" | n/a
| style="background:lightgray;text-align:center;" | n/a
| style="background:lightgray;text-align:center;" | n/a
|-
| Activity Stream (Android) || Kevin || No-Jun || #mobile || User Interface
| style="background:lightgray;text-align:center;" | n/a
| style="background:lightgray;text-align:center;" | n/a
| style="background:pink;text-align:center;" | none
| style="background:lightgray;text-align:center;" | n/a
| style="background:lightgray;text-align:center;" | n/a
| style="background:lightgray;text-align:center;" | n/a
| style="background:lightgray;text-align:center;" | n/a
| style="background:lightgray;text-align:center;" | n/a
| style="background:lightgray;text-align:center;" | n/a
|-
| Prox (iOS) || Aaron || No-Jun || #mobile || User Interface
| style="background:lightgray;text-align:center;" | n/a
| style="background:lightgray;text-align:center;" | n/a
| style="background:pink;text-align:center;" | none
| style="background:lightgray;text-align:center;" | n/a
| style="background:lightgray;text-align:center;" | n/a
| style="background:lightgray;text-align:center;" | n/a
| style="background:lightgray;text-align:center;" | n/a
| style="background:lightgray;text-align:center;" | n/a
| style="background:lightgray;text-align:center;" | n/a
|-
| Focus (iOS) || Aaron || No-Jun || #mobile || User Interface
| style="background:lightgreen;text-align:center;" | [https://testrail.stage.mozaws.net/index.php?/suites/view/321]
| style="background:lightgray;text-align:center;" | n/a
| style="background:lightgreen;text-align:center;" | [https://github.com/mozilla-mobile/focus/tree/master/XCUITest]
| style="background:lightgray;text-align:center;" | n/a
| style="background:lightgray;text-align:center;" | n/a
| style="background:lightgray;text-align:center;" | n/a
| style="background:lightgray;text-align:center;" | n/a
| style="background:lightgray;text-align:center;" | n/a
| style="background:lightgray;text-align:center;" | n/a
|-
| ABSearch || Karl || Chris || #absearch || Services
| style="background:lightyellow;text-align:center;" | TBD
| style="background:lightyellow;text-align:center;" | TBD
| style="background:lightgreen;text-align:center;" | [https://mana.mozilla.org/wiki/display/SVCOPS/ABSearch Private repos]
| style="background:lightyellow;text-align:center;" | TBD
| style="background:lightgray;text-align:center;" | n/a
| style="background:darkgray;text-align:center;" | N/A
| style="background:lightyellow;text-align:center;" | TBD
| style="background:darkgray;text-align:center;" | N/A
| style="background:lightyellow;text-align:center;" | TBD
|-
| [https://github.com/mozilla/antenna Antenna] || Matt || Richard || #breakpad || Services
| style="background:lightgreen;text-align:center;"  | [https://testrail.stage.mozaws.net/index.php?/projects/overview/40]
| style="background:lightgreen;text-align:center;" | [https://github.com/mozilla/antenna/tree/master/tests/unittest]
| style="background:lightgray;text-align:center;" | n/a
| style="background:lightgreen;text-align:center;"  | [https://github.com/rpappalax/antenna-loadtests/]
| style="background:lightgray;text-align:center;" | n/a
| style="background:darkgray;text-align:center;" | N/A
| style="background:lightyellow;text-align:center;" | TBD
| style="background:darkgray;text-align:center;" | N/A
| style="background:lightyellow;text-align:center;" | TBD
|-
| [http://autopush.readthedocs.io Autopush] || Richard || Matt || #push || Services
| style="background:lightgreen;text-align:center;" |  [https://testrail.stage.mozaws.net/index.php?/projects/overview/31]
| style="background:lightgreen;text-align:center;" | [https://github.com/mozilla-services/autopush]
| style="background:lightyellow;text-align:center;"  | TBD
| style="background:lightgreen;text-align:center;" | [https://github.com/mozilla-services/ap-loadtester]
| style="background:lightgray;text-align:center;" | n/a
| style="background:darkgray;text-align:center;" | N/A
| style="background:lightyellow;text-align:center;" | TBD
| style="background:darkgray;text-align:center;" | N/A
| style="background:lightyellow;text-align:center;" | TBD
|-
| Balrog || Chris || Karl || #balrog || Services
| style="background:lightyellow;text-align:center;" | TBD
| style="background:lightyellow;text-align:center;" | [https://github.com/mozilla/balrog]
| style="background:pink;text-align:center;" | none
| style="background:lightyellow;text-align:center;" | TBD
| style="background:lightgray;text-align:center;" | n/a
| style="background:darkgray;text-align:center;" | N/A
| style="background:lightyellow;text-align:center;" | TBD
| style="background:darkgray;text-align:center;" | N/A
| style="background:lightyellow;text-align:center;" | TBD
|-
| Bouncer || Matt || Dave || #stubby || Services
| style="background:lightgreen;text-align:center;" | [https://testrail.stage.mozaws.net/index.php?/projects/overview/33]
| style="background:lightgreen;text-align:center;" | [https://github.com/mozilla-services/go-bouncer/blob/master/handlers_test.go]
| style="background:lightgreen;text-align:center;" | [https://github.com/mozilla-services/go-bouncer/tree/master/tests/e2e]
| style="background:lightyellow;text-align:center;" | TBD
| style="background:lightgray;text-align:center;" | n/a
| style="background:darkgray;text-align:center;" | N/A
| style="background:lightyellow;text-align:center;" | TBD
| style="background:darkgray;text-align:center;" | N/A
| style="background:lightyellow;text-align:center;" | TBD
|-
| Firefox Accounts || Karl || Peter || #fxa || Services
| style="background:lightgreen;text-align:center;" | [https://testrail.stage.mozaws.net/index.php?/projects/overview/35]
| style="background:lightyellow;text-align:center;" | TBD
| style="background:lightgreen;text-align:center;" | [https://github.com/mozilla/fxa-content-server#testing] [https://github.com/mozilla/fxapom]
| style="background:lightgreen;text-align:center;" | [https://github.com/mozilla/fxa-auth-server/tree/master/test/load]
| style="background:lightgray;text-align:center;" | n/a
| style="background:darkgray;text-align:center;" | N/A
| style="background:lightyellow;text-align:center;" | TBD
| style="background:darkgray;text-align:center;" | N/A
| style="background:lightyellow;text-align:center;" | TBD
|-
| [https://kinto.readthedocs.io Kinto] || Chris || Karl || #storage || Services
| style="background:lightgreen;text-align:center;" | [https://testrail.stage.mozaws.net/index.php?/suites/view/23]
| style="background:lightgreen;text-align:center;" | [https://github.com/Kinto/]
| style="background:lightgreen;text-align:center;" | [https://github.com/Kinto/]
| style="background:lightyellow;text-align:center;" | TBD
| style="background:lightgray;text-align:center;" | n/a
| style="background:darkgray;text-align:center;" | N/A
| style="background:lightyellow;text-align:center;" | TBD
| style="background:darkgray;text-align:center;" | N/A
| style="background:lightyellow;text-align:center;" | TBD
|-
| [https://github.com/loads Loads Tool] || Richard || Chris || #fx-test || Services
| style="background:darkgray;text-align:center;" | N/A
| style="background:lightyellow;text-align:center;" | TBD
| style="background:darkgray;text-align:center;" | N/A
| style="background:darkgray;text-align:center;" | N/A
| style="background:darkgray;text-align:center;" | N/A
| style="background:darkgray;text-align:center;" | N/A
| style="background:lightyellow;text-align:center;" | TBD
| style="background:darkgray;text-align:center;" | N/A
| style="background:lightyellow;text-align:center;" | TBD
|-
| Shavar (Tracking Protection) || Rebecca || Richard || #shavar || Services
| style="background:lightgreen;text-align:center;"  |[https://testrail.stage.mozaws.net/index.php?/suites/view/354]
| style="background:lightgreen;text-align:center;" |[https://github.com/mozilla-services/shavar/]
| style="background:lightyellow;text-align:center;" | TBD
| style="background:lightgreen;text-align:center;" | [https://github.com/rpappalax/shavar-loadtests]
| style="background:lightyellow;text-align:center;" | TBD
| style="background:darkgray;text-align:center;" | N/A
| style="background:lightyellow;text-align:center;" | TBD
| style="background:darkgray;text-align:center;" | N/A
| style="background:lightyellow;text-align:center;" | TBD
|-
| SHIELD || Chris || Karl || #normandy || Services
| style="background:lightgreen;text-align:center;" | [https://testrail.stage.mozaws.net/index.php?/suites/view/153]
| style="background:lightyellow;text-align:center;" | [https://github.com/mozilla/normandy]
| style="background:pink;text-align:center;" | none
| style="background:lightyellow;text-align:center;" | TBD
| style="background:lightgray;text-align:center;" | n/a
| style="background:darkgray;text-align:center;" | N/A
| style="background:lightyellow;text-align:center;" | TBD
| style="background:darkgray;text-align:center;" | N/A
| style="background:lightyellow;text-align:center;" | TBD
|-
| [https://wiki.mozilla.org/Firefox/Stub_Attribution Stub Attribution] || Stephen || Matt || #stubby || Services
| style="background:lightyellow;text-align:center;" | [https://testrail.stage.mozaws.net/index.php?/suites/view/406]
| style="background:lightgreen;text-align:center;" | [https://github.com/mozilla-services/stub_attribution] [https://github.com/mozilla/bedrock/tree/master/bedrock/firefox/tests]
| style="background:lightgreen;text-align:center;" | [https://github.com/stephendonner/stubattribution-tests]
| style="background:lightgreen;text-align:center;" | [https://github.com/stephendonner/stubattribution-loadtests]
| style="background:lightyellow;text-align:center;" | TBD
| style="background:darkgray;text-align:center;" | N/A
| style="background:lightyellow;text-align:center;" | TBD
| style="background:darkgray;text-align:center;" | N/A
| style="background:lightyellow;text-align:center;" | TBD
|-
| [https://wiki.mozilla.org/Services/Sync Sync] || Karl || Chris || #sync || Services
| style="background:lightgreen;text-align:center;" | [https://testrail.stage.mozaws.net/index.php?/projects/overview/36]
| style="background:lightyellow;text-align:center;" | TBD
| style="background:lightgreen;text-align:center;" | [https://developer.mozilla.org/en-US/docs/Mozilla/Projects/TPS]
| style="background:lightgreen;text-align:center;" | [https://github.com/mozilla-services/server-syncstorage/tree/master/loadtest] [https://github.com/mozilla-services/tokenserver/tree/master/loadtest]
| style="background:lightgray;text-align:center;" | n/a
| style="background:darkgray;text-align:center;" | N/A
| style="background:lightyellow;text-align:center;" | TBD
| style="background:darkgray;text-align:center;" | N/A
| style="background:lightyellow;text-align:center;" | TBD
|}

Latest revision as of 06:11, 13 December 2024

Mission Statement

The Test Engineering team supports the larger Firefox organization by enabling identification of risk to our products and eliminating quality related blind spots through tooling, testing, automation, benchmarks, and reporting.

More info is at: http://firefox-test-engineering.readthedocs.io/en/latest/

Focus Areas

  • Interop
  • Performance
  • GeckoView
  • Fenix
  • Amazon
  • CI Automation
  • Ecosystem
  • Telemetry
  • Premium Services
  • Energy
  • Accessibility
  • Reporting
  • Monitoring
  • Experiments

Enduring Objectives

  • Increase visibility into product risks
    • Streamline reporting
    • Reduce blind spots
  • Improve efficiency and clarity of risk assessments
    • Tight feedback loops
    • Be opinionated (i.e binary or traffic light recommendations)
    • Reduce guesswork, roundtrips
    • Standardize between projects and types of reports
  • Maintain or improve coverage and quality standards
    • Identify and fill gaps
    • Document and measure existing work
    • Establish/Improve release criteria consistency
    • Reduce effort on maintenance
  • Reduce cross-functional friction
    • Advocacy
    • Reporting
    • Tools
    • Benchmarks
    • Relationship building

People

Director: Stuart Philp
Architect: Tarek Ziade
Interop. Manager: David Burns
Performance. Manager: Dave Hunt
Ecosystem. Manager: Krupa Raj
CI Automation. Manager: Joel Maher
Mobile. Manager: No-Jun Park

Retrieved from "https://wiki.mozilla.org/index.php?title=TestEngineering&oldid=1252953"