MozillaWiki - User contributions [en]

TestEngineering

2019-01-22T16:31:26Z

StuartPhilp: new team structure

TestEngineering

2019-01-22T16:27:33Z

StuartPhilp: remove section

= Mission Statement =
The Test Engineering team supports the larger Firefox organization by enabling identification of risk to our products and eliminating quality related blind spots through tooling, testing, automation, benchmarks, and reporting.

More info is at: http://firefox-test-engineering.readthedocs.io/en/latest/

= Focus Areas =

* Interop
* Performance
* GeckoView
* Fenix
* Amazon
* CI Automation
* Ecosystem
* Telemetry
* Premium Services
* Energy
* Accessibility
* Reporting
* Monitoring
* Experiments

= Enduring Objectives =
* Increase visibility into product risks
** Streamline reporting
** Reduce blind spots
* Improve efficiency and clarity of risk assessments
** Tight feedback loops
** Be opinionated (i.e binary or traffic light recommendations)
** Reduce guesswork, roundtrips
** Standardize between projects and types of reports
* Maintain or improve coverage and quality standards
** Identify and fill gaps
** Document and measure existing work
** Establish/Improve release criteria consistency
** Reduce effort on maintenance
* Reduce cross-functional friction
** Advocacy
** Reporting
** Tools
** Benchmarks
** Relationship building

=Technical Groups=
Firefox Test Engineering is divided into three technical groups. These groups align on the skills, tools, and focus needed to provide the coverage and quality for the projects they oversee. Each technical group has a technical lead, who oversees all of the project's testing needs and best practices.

==User Interfaces==
* https://wiki.mozilla.org/TestEngineering/UI
* Lead: Dave Hunt

==Services==
* https://wiki.mozilla.org/TestEngineering/Services
* Lead: Richard Pappalardo
* Manager: Karl Thiessen

==Customization==
* https://wiki.mozilla.org/TestEngineering/Customization
* Lead: Krupa Raj

2016-08-26T20:58:17Z

StuartPhilp: /* The Team */

= Overview =
Firefox Test Engineering oversees the test automation, infrastructure, and manual testing for all of Firefox's services, sites, and apps that are external to the core browsers (and in some cases within the browsers as well).

=The Team=
* Manager: Stuart Philp
* Technical Lead: Krupa Raj
* Technical Lead: Dave Hunt
* Technical Lead: Richard Pappalardo
* Senior Test Engineer: Karl Thiessen
* Senior Test Engineer: Peter deHaan
* Senior Test Engineer: Chris Hartjes
* Senior Test Engineer: Stephen Donner
* Senior Test Engineer: Kevin Brosnan
* Senior Test Engineer: Aaron Train
* Senior Test Engineer: Matt Brandt
* Senior Test Engineer: Rebecca Billings
* Senior Test Engineer: John Dorlus
* Senior Test Engineer: No-Jun Park

=Technical Groups=
Firefox Test Engineering is divided into three technical groups. These groups align on the skills, tools, and focus needed to provide the coverage and quality for the projects they oversee. Each technical group has a technical lead, who oversees all of the project's testing needs and best practices.

==User Interfaces==
* https://wiki.mozilla.org/TestEngineering/UI
* Lead: Dave Hunt

==Services==
* https://wiki.mozilla.org/TestEngineering/Services
* Lead: Richard Pappalardo

==Customization==
* https://wiki.mozilla.org/TestEngineering/Customization
* Lead: Krupa Raj

=Full Project List=
{| class="wikitable sortable"
|-
! Project !! Primary !! Secondary !! Channel !! Technical Group
|-
| PageShot (Test Pilot) || Peter || Softvision || #pageshot || Customization
|-
| NoMore404s (Test Pilot) || Karl || Softvision || #testpilot || Customization
|-
| MinVid (Test Pilot) || Peter || Softvision || #testpilot || Customization
|-
| Fathom (Test Pilot) || Peter || Softvision || #testpilot || Customization
|-
| Heatmap (Test Pilot) || Peter || Softvision || #testpilot || Customization
|-
| Kinto || Chris || Karl || #storage || Services
|-
| Universal Search (Test Pilot) || Stephen || Peter || #universal-search || Customization
|-
| Activity Stream (Test Pilot) || Peter || John || #activity-stream || Customization
|-
| Balrog || Chris || Karl || #balrog || Services
|-
| SHIELD || Chris || Karl || #normandy || Services
|-
| WebExtensions || Krupa || Softvision || #webextensions || Customization
|-
| Push Notifications || Richard || Rebecca || #push || Services
|-
| Test Pilot (web site) || Peter || John || #testpilot || Customization
|-
| Firefox Accounts || Karl || Peter || #fxa || Services
|-
| Socorro || Matt || Stephen || #socorro || Customization
|-
| ABSearch || Karl || Chris || #absearch || Services
|-
| Sync || Karl || Chris || #sync || Services
|-
| Telemetry || John || Softvision || #telemetry || Customization
|-
| One and Done || Rebecca || Karl || #qa || User Interface
|-
| Bouncer || Matt || Dave || #stubby || Services
|-
| Addons.mozilla.org || Krupa || Softvision || #amo || Customization
|-
| Tracking Protection || Rebecca || Richard || #shavar || Services
|-
| TabCenter (Test Pilot) || Peter || Softvision || #testpilot || Customization
|-
| Treeherder || Rebecca || Dave || #treeherder || User Interface
|-
| developer.mozilla.org || Matt || Dave || #mdn || User Interface
|-
| mozilla.com || Rebecca || Dave || #bedrock || User Interface
|-
| Mozilla Location Services || Karl || Richard || #mls || User Interface
|-
| quality.mozilla.org || Stephen || Rebecca || #qmo || User Interface
|-
| Pocket || Peter || Softvision || #pocket || User Interface
|}

TestEngineering

2016-08-26T20:56:55Z

StuartPhilp: adding team members

= Overview =
Firefox Test Engineering oversees the test automation, infrastructure, and manual testing for all of Firefox's services, sites, and apps that are external to the core browsers (and in some cases within the browsers as well).

=The Team=
* Manager: Stuart Philp
* Technical Lead: Krupa Raj
* Technical Lead: Dave Hunt
* Technical Lead: Richard Pappalardo
* Senior Test Engineer: Karl Thiessen
* Senior Test Engineer: Peter deHaan
* Senior Test Engineer: Chris Hartjes
* Senior Test Engineer: Stephen Donner
* Senior Test Engineer: Kevin Brosnan
* Senior Test Engineer: Aaron Train
* Senior Test Engineer: Matt Brandt
* Senior Test Engineer: Rebecca Billings
* Senior Test Engineer: John Dorlus

=Technical Groups=
Firefox Test Engineering is divided into three technical groups. These groups align on the skills, tools, and focus needed to provide the coverage and quality for the projects they oversee. Each technical group has a technical lead, who oversees all of the project's testing needs and best practices.

==User Interfaces==
* https://wiki.mozilla.org/TestEngineering/UI
* Lead: Dave Hunt

==Services==
* https://wiki.mozilla.org/TestEngineering/Services
* Lead: Richard Pappalardo

==Customization==
* https://wiki.mozilla.org/TestEngineering/Customization
* Lead: Krupa Raj

=Full Project List=
{| class="wikitable sortable"
|-
! Project !! Primary !! Secondary !! Channel !! Technical Group
|-
| PageShot (Test Pilot) || Peter || Softvision || #pageshot || Customization
|-
| NoMore404s (Test Pilot) || Karl || Softvision || #testpilot || Customization
|-
| MinVid (Test Pilot) || Peter || Softvision || #testpilot || Customization
|-
| Fathom (Test Pilot) || Peter || Softvision || #testpilot || Customization
|-
| Heatmap (Test Pilot) || Peter || Softvision || #testpilot || Customization
|-
| Kinto || Chris || Karl || #storage || Services
|-
| Universal Search (Test Pilot) || Stephen || Peter || #universal-search || Customization
|-
| Activity Stream (Test Pilot) || Peter || John || #activity-stream || Customization
|-
| Balrog || Chris || Karl || #balrog || Services
|-
| SHIELD || Chris || Karl || #normandy || Services
|-
| WebExtensions || Krupa || Softvision || #webextensions || Customization
|-
| Push Notifications || Richard || Rebecca || #push || Services
|-
| Test Pilot (web site) || Peter || John || #testpilot || Customization
|-
| Firefox Accounts || Karl || Peter || #fxa || Services
|-
| Socorro || Matt || Stephen || #socorro || Customization
|-
| ABSearch || Karl || Chris || #absearch || Services
|-
| Sync || Karl || Chris || #sync || Services
|-
| Telemetry || John || Softvision || #telemetry || Customization
|-
| One and Done || Rebecca || Karl || #qa || User Interface
|-
| Bouncer || Matt || Dave || #stubby || Services
|-
| Addons.mozilla.org || Krupa || Softvision || #amo || Customization
|-
| Tracking Protection || Rebecca || Richard || #shavar || Services
|-
| TabCenter (Test Pilot) || Peter || Softvision || #testpilot || Customization
|-
| Treeherder || Rebecca || Dave || #treeherder || User Interface
|-
| developer.mozilla.org || Matt || Dave || #mdn || User Interface
|-
| mozilla.com || Rebecca || Dave || #bedrock || User Interface
|-
| Mozilla Location Services || Karl || Richard || #mls || User Interface
|-
| quality.mozilla.org || Stephen || Rebecca || #qmo || User Interface
|-
| Pocket || Peter || Softvision || #pocket || User Interface
|}

TestEngineering

2016-08-26T20:52:51Z

StuartPhilp: /* Full Project List */

TestEngineering

2016-08-26T20:52:27Z

StuartPhilp: /* Technical Groups */

TestEngineering

2016-08-26T20:47:55Z

StuartPhilp: /* Full Project List */

= Overview =
Firefox Test Engineering oversees the test automation, infrastructure, and manual testing for all of Firefox's services, sites, and apps that are external to the core browsers (and in some cases within the browsers as well).

=Technical Groups=

==User Interfaces==
* https://wiki.mozilla.org/TestEngineering/UI

==Services==
* https://wiki.mozilla.org/TestEngineering/Services

==Customization==
* https://wiki.mozilla.org/TestEngineering/Customization

=Full Project List=
{| class="wikitable sortable"
|-
! Project !! Primary !! Secondary !! Channel !! Testing Group
|-
| PageShot (Test Pilot) || Peter || Softvision || #pageshot || Customization
|-
| NoMore404s (Test Pilot) || Karl || Softvision || #testpilot || Customization
|-
| MinVid (Test Pilot) || Peter || Softvision || #testpilot || Customization
|-
| Fathom (Test Pilot) || Peter || Softvision || #testpilot || Customization
|-
| Heatmap (Test Pilot) || Peter || Softvision || #testpilot || Customization
|-
| Kinto || Chris || Karl || #storage || Services
|-
| Universal Search (Test Pilot) || Stephen || Peter || #universal-search || Customization
|-
| Activity Stream (Test Pilot) || Peter || John || #activity-stream || Customization
|-
| Balrog || Chris || Karl || #balrog || Services
|-
| SHIELD || Chris || Karl || #normandy || Services
|-
| WebExtensions || Krupa || Softvision || #webextensions || Customization
|-
| Push Notifications || Richard || Rebecca || #push || Services
|-
| Test Pilot (web site) || Peter || John || #testpilot || Customization
|-
| Firefox Accounts || Karl || Peter || #fxa || Services
|-
| Socorro || Matt || Stephen || #socorro || Customization
|-
| ABSearch || Karl || Chris || #absearch || Services
|-
| Sync || Karl || Chris || #sync || Services
|-
| Telemetry || John || Softvision || #telemetry || Customization
|-
| One and Done || Rebecca || Karl || #qa || User Interface
|-
| Bouncer || Matt || Dave || #stubby || Services
|-
| Addons.mozilla.org || Krupa || Softvision || #amo || Customization
|-
| Tracking Protection || Rebecca || Richard || #shavar || Services
|-
| TabCenter (Test Pilot) || Peter || Softvision || #testpilot || Customization
|-
| Treeherder || Rebecca || Dave || #treeherder || User Interface
|-
| developer.mozilla.org || Matt || Dave || #mdn || User Interface
|-
| mozilla.com || Rebecca || Dave || #bedrock || User Interface
|-
| Mozilla Location Services || Karl || Richard || #mls || User Interface
|-
| quality.mozilla.org || Stephen || Rebecca || #qmo || User Interface
|-
| Pocket || Peter || Softvision || #pocket || User Interface
|}

TestEngineering

2016-08-26T20:44:06Z

StuartPhilp:

= Overview =
Firefox Test Engineering oversees the test automation, infrastructure, and manual testing for all of Firefox's services, sites, and apps that are external to the core browsers (and in some cases within the browsers as well).

=Technical Groups=

==User Interfaces==
* https://wiki.mozilla.org/TestEngineering/UI

==Services==
* https://wiki.mozilla.org/TestEngineering/Services

==Customization==
* https://wiki.mozilla.org/TestEngineering/Customization

=Full Project List=
{| class="wikitable sortable"
|-
! Project !! Primary !! Secondary !! Channel !! Testing Group
|-
| PageShot (Test Pilot) || Peter || Softvision || #pageshot || Customization
|-
| NoMore404s (Test Pilot) || Karl || Softvision || #testpilot
|-
| MinVid (Test Pilot) || Peter || Softvision || #testpilot
|-
| Fathom (Test Pilot) || Peter || Softvision || #testpilot
|-
| Heatmap (Test Pilot) || Peter || Softvision || #testpilot
|-
| Kinto || Chris || Karl || #storage
|-
| Universal Search (Test Pilot) || Stephen || Peter || #universal-search
|-
| Activity Stream (Test Pilot) || Peter || John || #activity-stream
|-
| Balrog || Chris || Karl || #balrog
|-
| SHIELD || Chris || Karl || #normandy
|-
| WebExtensions || Krupa || Softvision || #webextensions
|-
| Push Notifications || Richard || Rebecca || #push
|-
| Test Pilot (web site) || Peter || John || #testpilot
|-
| Firefox Accounts || Karl || Peter || #fxa
|-
| Socorro || Matt || Stephen || #socorro
|-
| ABSearch || Karl || Chris || #absearch
|-
| Sync || Karl || Chris || #sync
|-
| Telemetry || John || Softvision || #telemetry
|-
| One and Done || Rebecca || Karl || #qa
|-
| Bouncer || Matt || Dave || #stubby
|-
| Addons.mozilla.org || Krupa || Softvision || #amo
|-
| Tracking Protection || Rebecca || Richard || #shavar
|-
| TabCenter (Test Pilot) || Peter || Softvision || #testpilot
|-
| Treeherder || Rebecca || Dave || #treeherder
|-
| developer.mozilla.org || Matt || Dave || #mdn
|-
| mozilla.com || Rebecca || Dave || #bedrock
|-
| Mozilla Location Services || Karl || Richard || #mls
|-
| quality.mozilla.org || Stephen || Rebecca || #qmo
|-
| Pocket || Peter || Softvision || #pocket
|}

TestEngineering/Web/AMO/preReleaseMeetings/5.11

2016-08-26T20:35:50Z

StuartPhilp: StuartPhilp moved page TestEngineering/Web/AMO/preReleaseMeetings/5.11 to TestEngineering/UI/AMO/preReleaseMeetings/5.11

#REDIRECT [[TestEngineering/UI/AMO/preReleaseMeetings/5.11]]

TestEngineering/UI/AMO/preReleaseMeetings/5.11

2016-08-26T20:35:41Z

StuartPhilp: StuartPhilp moved page TestEngineering/Web/AMO/preReleaseMeetings/5.11 to TestEngineering/UI/AMO/preReleaseMeetings/5.11

== 5.11 Release ==
==== Development ====
* Push bug: {{bug|569591}}
* Pages that are candidates to go live:
** /extensions
** /extensions/:category_name
** /extensions/:category_name/featured
** /personas/:category_name
*** Suggest kicking: pushing one /personas/ page is going to break links in un-QA'd ways
** /about
** /faq
** /user/:user_id
*** Suggest kicking: clouserw isn't finishing his bugs
* Risk Assessment
** What can go wrong,what do we do then?
* Check-list for IT

==== QA ====
* [http://tinyurl.com/2a8xjxh Unverified bugs]
* [http://tinyurl.com/34v7jnh Need to Verify]
* Risk Assessment

==== IT ====

TestEngineering/Web/AMO/automation-meetings/2011-02-28

2016-08-26T20:35:35Z

StuartPhilp: StuartPhilp moved page TestEngineering/Web/AMO/automation-meetings/2011-02-28 to TestEngineering/UI/AMO/automation-meetings/2011-02-28

#REDIRECT [[TestEngineering/UI/AMO/automation-meetings/2011-02-28]]

TestEngineering/UI/AMO/automation-meetings/2011-02-28

2016-08-26T20:35:26Z

StuartPhilp: StuartPhilp moved page TestEngineering/Web/AMO/automation-meetings/2011-02-28 to TestEngineering/UI/AMO/automation-meetings/2011-02-28

==Dial-in Info==
650-903-0800 or 650-215-1282 x92 Conf# 303 (US/INTL) 
1-800-707-2533 (pin 369) Conf# 303 (US) 
 

==Discussion Topics==
==Project Update==
* [https://bugzilla.mozilla.org/buglist.cgi?query_format=advanced&resolution=---&resolution=FIXED&target_milestone=5.12.12&product=addons.mozilla.org&classification=Server%20Software AMO 5.12.12] is going live on 03/03
* We are currently working on Mobile pages and Editor tools

==Test Coverage==
* Discovery Pane
** https://addons.allizom.org/en-US/firefox/discovery/pane/4.0/Linux
** [https://wiki.mozilla.org/QA/Execution/Web_Testing/AMO/DiscoveryPane Test coverage doc]
* Validator

==Automation Update==
==Action Item==

TestEngineering/Web/AMO/automation-meetings/2011-02-14

2016-08-26T20:35:20Z

StuartPhilp: StuartPhilp moved page TestEngineering/Web/AMO/automation-meetings/2011-02-14 to TestEngineering/UI/AMO/automation-meetings/2011-02-14

#REDIRECT [[TestEngineering/UI/AMO/automation-meetings/2011-02-14]]

TestEngineering/UI/AMO/automation-meetings/2011-02-14

2016-08-26T20:35:11Z

StuartPhilp: StuartPhilp moved page TestEngineering/Web/AMO/automation-meetings/2011-02-14 to TestEngineering/UI/AMO/automation-meetings/2011-02-14

==Dial-in Info==
650-903-0800 or 650-215-1282 x92 Conf# 303 (US/INTL) 
1-800-707-2533 (pin 369) Conf# 303 (US) 
 

==Discussion Topics==
==Project Update==
* [https://bugzilla.mozilla.org/buglist.cgi?query_format=advanced&resolution=---&resolution=FIXED&target_milestone=5.12.10&product=addons.mozilla.org&classification=Server%20Software AMO 5.12.10] is going live on 02/17
* We are currently working on Mobile pages and Editor tools

==Test Coverage==
* Discovery Pane
** https://addons.allizom.org/en-US/firefox/discovery/pane/4.0/Linux
** [https://wiki.mozilla.org/QA/Execution/Web_Testing/AMO/DiscoveryPane Test coverage doc]
* Search testcases

==Automation Update==
==Action Item==
* Discovery pane testcases
* Validator testcases

TestEngineering/Web/AMO/automation-meetings/2011-01-31

2016-08-26T20:35:05Z

StuartPhilp: StuartPhilp moved page TestEngineering/Web/AMO/automation-meetings/2011-01-31 to TestEngineering/UI/AMO/automation-meetings/2011-01-31

#REDIRECT [[TestEngineering/UI/AMO/automation-meetings/2011-01-31]]

TestEngineering/UI/AMO/automation-meetings/2011-01-31

2016-08-26T20:34:56Z

StuartPhilp: StuartPhilp moved page TestEngineering/Web/AMO/automation-meetings/2011-01-31 to TestEngineering/UI/AMO/automation-meetings/2011-01-31

==Dial-in Info==
650-903-0800 or 650-215-1282 x92 Conf# 303 (US/INTL) 
1-800-707-2533 (pin 369) Conf# 303 (US) 
 

==Discussion Topics==
==Project Update==
* [https://bugzilla.mozilla.org/buglist.cgi?query_format=advanced&resolution=---&resolution=FIXED&target_milestone=5.12.8&product=addons.mozilla.org&classification=Server%20Software AMO 5.12.8] is going live on 02/03
* We are currently working on Mobile pages and Editor tools

==Test Coverage==
* Discovery Pane
** https://addons.allizom.org/en-US/firefox/discovery/pane/4.0/Linux
** [https://wiki.mozilla.org/QA/Execution/Web_Testing/AMO/DiscoveryPane Test coverage doc]
* Validator

==Automation Update==
==Action Item==
* Discovery pane testcases
* Validator testcases

TestEngineering/Web/AMO/Tips and Pointers/amoCronJobs

2016-08-26T20:34:50Z

StuartPhilp: StuartPhilp moved page TestEngineering/Web/AMO/Tips and Pointers/amoCronJobs to TestEngineering/UI/AMO/Tips and Pointers/amoCronJobs

#REDIRECT [[TestEngineering/UI/AMO/Tips and Pointers/amoCronJobs]]

TestEngineering/UI/AMO/Tips and Pointers/amoCronJobs

2016-08-26T20:34:42Z

StuartPhilp: StuartPhilp moved page TestEngineering/Web/AMO/Tips and Pointers/amoCronJobs to TestEngineering/UI/AMO/Tips and Pointers/amoCronJobs

# production AMO
0,20,40 * * * * root cd /data/php5/www/addons.mozilla.org-remora/bin ; php -f
maintenance.php total
10,30,50 * * * * root cd /data/php5/www/addons.mozilla.org-remora/bin ; php -f
maintenance.php weekly
5,25,45 * * * * root cd /data/php5/www/addons.mozilla.org-remora/bin ; php -f
maintenance.php reviews
15,35,55 * * * * root cd /data/php5/www/addons.mozilla.org-remora/bin ; php -f
maintenance.php ratings
12 0 * * * root cd /data/php5/www/addons.mozilla.org-remora/bin ; php -f
maintenance.php gc
42 0 * * * root cd /data/php5/www/addons.mozilla.org-remora/bin ; php -f
maintenance.php unconfirmed
12,32,52 * * * * root cd /data/php5/www/addons.mozilla.org-remora/bin ; php -f
update-search-views.php
# Bug 462429 - compatibility report
5 * * * * apache cd /data/php5/www/addons.mozilla.org-remora/bin; php -f
compatibility_report.php
# Bug 482399
10,30,50 * * * * root cd /data/php5/www/addons.mozilla.org-remora/bin ; php -f
maintenance.php addons_collections_total
10,30,50 * * * * root cd /data/php5/www/addons.mozilla.org-remora/bin ; php -f
maintenance.php collections_total

# preview AMO
0,20,40 * * * * root cd /data/php5/www/addons.mozilla.org-preview/bin ; php -f
maintenance.php total
10,30,50 * * * * root cd /data/php5/www/addons.mozilla.org-preview/bin ; php -f
maintenance.php weekly
5,25,45 * * * * root cd /data/php5/www/addons.mozilla.org-preview/bin ; php -f
maintenance.php reviews
15,35,55 * * * * root cd /data/php5/www/addons.mozilla.org-preview/bin ; php -f
maintenance.php ratings
12 0 * * * root cd /data/php5/www/addons.mozilla.org-preview/bin ; php -f
maintenance.php gc
42 0 * * * root cd /data/php5/www/addons.mozilla.org-preview/bin ; php -f
maintenance.php unconfirmed
12,32,52 * * * * root cd /data/php5/www/addons.mozilla.org-preview/bin ; php -f
update-search-views.php
# Bug 462429 - compatibility report
5 * * * * apache cd /data/php5/www/addons.mozilla.org-preview/bin; php -f
compatibility_report.php
# Bug 482399
10,30,50 * * * * root cd /data/php5/www/addons.mozilla.org-preview/bin ; php -f
maintenance.php addons_collections_total
10,30,50 * * * * root cd /data/php5/www/addons.mozilla.org-preview/bin ; php -f
maintenance.php collections_total

TestEngineering/Web/AMO/Tips and Pointers

2016-08-26T20:34:35Z

StuartPhilp: StuartPhilp moved page TestEngineering/Web/AMO/Tips and Pointers to TestEngineering/UI/AMO/Tips and Pointers

#REDIRECT [[TestEngineering/UI/AMO/Tips and Pointers]]

TestEngineering/UI/AMO/Tips and Pointers

2016-08-26T20:34:26Z

StuartPhilp: StuartPhilp moved page TestEngineering/Web/AMO/Tips and Pointers to TestEngineering/UI/AMO/Tips and Pointers

== '''AMO''' ==
= Setup: staging and production =
* Staging: https://preview.addons.mozilla.org
* Production: https://addons.mozilla.org

= Production =
'''[https://intranet.mozilla.org/UpdateAMO#Content_Push Production push docs]'''
* AMO uses [http://www.zeus.com/products/zxtmlb/index.html Zeus], which heavily caches content. You can tell you're getting a cached copy of the content by looking at the headers and seeing "Via: Moz-Cache-zlb??" where ?? is a number and not seeing no-cache headers. ''being logged in bypasses this cache completely''
* If you see ''some_string_define'' on AMO, it's either 1) a raw string define, or (more likely) 2) Apache needs to restart to pick up the [http://us.php.net/gettext gettext()] changes.
* AMO runs on a cluster of servers. To tell what server is showing you the current page look for the "X-AMO-ServedBy" header.
* To view the revision of AMO you're currently seeing, view-source of any page; in the bottom, you'll see something like <pre></pre>This means you're at [http://viewvc.svn.mozilla.org/vc?revision=24322&view=revision SVN revision number 24322] -- you can cross-link this to whatever revision number was posted in the checkin comment in the bug.
* Pages won't validate due to some proprietary attributes we use (like "addonname") but it should be very close.
* Database queries are cached in memcache for 60 minutes. This means if you change something that doesn't invalidate the cache it won't actually change for up to 60 minutes.
* If you want a really fast check to see if basic infrastructure is working look at the [https://addons.mozilla.org/services/monitor.php services monitor]. This is also one of the things nagios watches.

== Cron Jobs ==
* Personas are imported at :21 after the hour (both prod/preview)
* Calculating weekly download, total download, collections, and review stats happens every 20 minutes
* Calculating the compatibility report happens every 5 minutes
* You can see exact times and all cron jobs in http://github.com/jbalogh/zamboni/tree/master/scripts/crontab/

=Testing =

== List of add-on types ==
* http://github.com/jbalogh/zamboni/blob/master/apps/amo/__init__.py#L98

== Public vs. sandbox status ==
* If the latest version of a public add-on is in sandbox, then the previous public version of the add-on is listed in the add-on detail page.

== Add-on Uploading==
* Add-ons need to have:
** At least 1 category
** A description...
before they can be complete; click on the "Complete Add-on" button to make them so
* ...and now, they can be either in the "release" or "beta" channel
== Status codes ==
* To be valid, an add-on must have:
** Valid files
*** Which gives a version "valid" status

== Special Add-ons ==
* EULA - Yahoo.com Toolbar
* Privacy Policy - Yahoo.com Toolbar

== Buttons ==
[https://preview.addons.mozilla.org/z/en-US/firefox/addons/smorgasbord AMO buttons]
*Download the User Agent Switcher Add-on
*Open your firefox browser and type about:config
*Accept the terms and proceed
*Create a new boolean preference called useragentswitcher.reset.onclose with the value false
*Now add the user agents for Firefox Mobile, SeaMonkey and Thunderbird using the User Agent Switcher add-on
*Proceed to test the buttons

===https://versioncheck.amo/===
* Used by applications to see if their add-ons are up to date. Can be modified using about:config by changing
extensions.update.url
* Should only output XML. Ever.

===https://services.addons.mozilla.org/ (also known as the AMO API) ===
* Used for the API -- [https://wiki.mozilla.org/Update:RequirementsV33 spec here, [https://developer.mozilla.org/index.php?title=en/addons.mozilla.org_%28AMO%29_API_Developers%27_Guide/The_generic_AMO_API DevMO doc here]]
** In Firefox's "Get Add-ons" tab (Tools->Add-ons->Get Add-ons). This can be configured using about:config by changing
extensions.getAddons.recommended.url
extensions.getAddons.search.url (replace "services" in each URL with "preview")
* SAMO filters by OS and version-compatibility ranges
** e.g. If you're using Firefox 3.0.8 on Windows, you should only see add-ons that are either for "ALL" or "Win", with compat range of something -> 3.0.*
* You can test other locales in the API:
** [https://preview.addons.mozilla.org/de/firefox/addon/78926 Lesezeichenleiste verstecken add-on]
*** [https://preview.addons.mozilla.org/en-US/firefox/api/1.5/addon/search/Lesezeichenleiste%20verstecken API search URL]
** For external sites, both 3rd party and sites like [http://addons.mozilla.jp/ addons.mozilla.jp]
** Should only output XML. Evar.
* '''IMPORTANT: Gets tagged and shipped with AMO, usually, so be sure its changes have been vetted'''
** Ask if it's been tagged along with the rest of the AMO changes, with each release

== Staging ==

Found at: https://preview.addons.mozilla.org/

* The site updates from SVN every 15 minutes automatically. It also reruns the clean and build scripts which make the compressed js files, etc.
* The database is a very old copy from production AMO. It is only updated when requested through IT (talk to webdev first please).
** -207 and -261 errors might sometimes abound; tread carefully. Usually, it's a staging-only file-mirror thing, but ya never know :-)
* If you're feeling wild you can directly access the [http://cm-phpmyadmin01.mozilla.org/index.php?db=addons_reskin staging database] to verify table structure or data.
'''Errors to ignore:'''
* -261/-203 errors when trying to install an add-on *only* from https://preview.addons.mozilla.org -- the files aren't synced regularly from the file-mirror DB; if you see this on production, it's a bug and should be filed against IT (but wait half a day or so)

== Featured add-ons ==

* Rotated/added/deleted through the Admin tool->Feature Manager -- have expiration dates

== Discovery Pane ==

* Can be administrated through https://addons.allizom.org/en-US/firefox/discovery/modules

== Add-on SRC=? Attributes ==
mysql> select * from download_sources;
+----+----------------------+--------+---------------------+ 
| id | name | type | created | 
+----+----------------------+--------+---------------------+ 
| 1 | category | full | 2009-08-06 19:21:17 | 
| 2 | search | full | 2009-08-06 19:21:17 | 
| 3 | collection | full | 2009-08-06 19:21:17 | 
| 4 | recommended | full | 2009-08-06 19:21:17 | 
| 5 | homepagebrowse | full | 2009-08-06 19:21:17 | 
| 6 | homepagepromo | full | 2009-08-06 19:21:17 | 
| 7 | api | full | 2009-08-06 19:21:17 | 
| 8 | sharingapi | full | 2009-08-06 19:21:17 | 
| 9 | addondetail | full | 2009-08-06 19:21:17 | 
| 10 | external- | prefix | 2009-08-06 19:21:17 | 
| 11 | developers | full | 2009-11-12 17:18:47 | 
| 12 | installservice | full | 2009-11-12 17:18:47 | 
| 13 | fxcustomization | full | 2009-11-12 17:18:47 | 
| 14 | oftenusedwith | full | 2010-02-02 20:05:27 | 
| 15 | similarcollections | full | 2010-02-02 20:05:27 | 
| 16 | userprofile | full | 2010-02-08 19:48:51 | 
| 18 | email | full | 2010-02-23 19:47:14 | 
| 19 | rockyourfirefox | full | 2010-02-23 19:47:14 | 
| 20 | mostshared | full | 2010-03-23 19:09:26 | 
| 21 | fxfirstrun | full | 2010-05-13 16:07:59 | 
| 22 | fxwhatsnew | full | 2010-05-13 16:07:59 | 
| 23 | creatured | full | 2010-06-03 16:24:38 | 
| 24 | version-history | full | 2010-08-05 16:14:09 | 
| 25 | addon-detail-version | full | 2010-08-05 16:14:09 | 
| 26 | discovery-pane | full | 2010-09-14 16:12:38 | 
| 27 | mozcom- | prefix | 2010-12-28 16:05:42 | 
+----+----------------------+--------+---------------------+ 
== Testing Search (weights/ordering) ==
https://wiki.mozilla.org/Update:Remora:Search

== Browse Page Vs. Category Landing Page ==
* Category Landing Page
** when you click on a Category link from left navigation, you are generally taken to Category landing page (if there are a enough add-ons in that category
** For e.g. if you are on [https://addons.allizom.org/en-US/firefox 'Firefox' app page] and you click on 'Shopping' category you will most likely land on [https://addons.allizom.org/en-US/firefox/extensions/shopping Category Landing Page] since this category has more than 5 add-ons
** On [https://addons.allizom.org/en-US/firefox/extensions/shopping Category Landing Page] you should see a big section of category-featured add-ons on the top, on the bottom you should see 3 columns listing 'Recently Added', 'Top Downloads' & 'Top Rated' add-ons( all for that category). On the bottom of each column there is a link to 'View All' (in that category)
* Browse Page
** when you click on a Category link from left navigation and if you end up on Browse page that's because there are not enough add-ons in that category to show a Cat. landing Page
** For e.g. if you are on [https://addons.allizom.org/en-US/mobile 'Mobile' app page] and you click on 'Shopping' category you will most likely land on [https://addons.allizom.org/en-US/mobile/extensions/shopping/ Category Browse] page since this category fewer add-ons
** Browse page will not have the 3 columns of 'Recently Added', 'Top Downloads' & 'Top Rated' add-ons.

TestEngineering/Web/AMO/Tests results

2016-08-26T20:34:20Z

StuartPhilp: StuartPhilp moved page TestEngineering/Web/AMO/Tests results to TestEngineering/UI/AMO/Tests results

#REDIRECT [[TestEngineering/UI/AMO/Tests results]]

TestEngineering/UI/AMO/Tests results

2016-08-26T20:34:11Z

StuartPhilp: StuartPhilp moved page TestEngineering/Web/AMO/Tests results to TestEngineering/UI/AMO/Tests results

= AMO tests results page =

== Overview ==
* Goals of the page
** Have the amo litmus test results well centralized
** Spot and report issues in time
** Have an archive with the test results
** Have a small statistic with the results

== Team Members ==
{| class="fullwidth-table"
|-
| style="background:#EFEFEF; width:25%" | '''Name'''
| style="background:#EFEFEF; width:25%" | '''Contact'''
| style="background:#EFEFEF; width:25%" | '''IRC Nickname'''
| style="background:#EFEFEF; width:20%" | '''Availability'''
| style="background:#EFEFEF; width:5%" | '''Project Assignments'''
|-
| Cristian Boldan
| [mailto:cristian.boldan@softvision.ro cristian.boldan@softvision.ro]
| cboldan
| Contractor
| AMO test execution, test cases designer
|}

== Results ==
{| class="fullwidth-table"
|- style="background:#efefef"
| '''Date'''
| '''Build'''
| '''Testcases Run'''
| '''Non-Reproducible Issues Found'''
| '''Bugs Filed'''
| '''Verified bugs'''
| '''Tests added'''
| '''Addtl. Comments'''
|}

TestEngineering/Web/AMO/Testday/12152010

2016-08-26T20:34:05Z

StuartPhilp: StuartPhilp moved page TestEngineering/Web/AMO/Testday/12152010 to TestEngineering/UI/AMO/Testday/12152010

#REDIRECT [[TestEngineering/UI/AMO/Testday/12152010]]

TestEngineering/UI/AMO/Testday/12152010

2016-08-26T20:33:56Z

StuartPhilp: StuartPhilp moved page TestEngineering/Web/AMO/Testday/12152010 to TestEngineering/UI/AMO/Testday/12152010

Hello there, and welcome to the AMO test day! Thanks for volunteering your time and energy to help us improve addons.mozilla.org! Below, you'll find the setup information and some use-cases to help guide you in your testing; feel free, though, to go off on your own and just ad-hoc test!

Staging server: [https://addons-next.allizom.org/en-US/firefox/ https://addons-next.allizom.org/en-US/firefox/]

'''What are we testing?''' 

update.php is what Firefox asks to see if there are add-on updates available. We have migrated it to python and need to ensure that there are no regressions. 

 '''Settings ''' 
To test the updates on the staging server we need to tweak the settings.

'''''Settings for Firefox:''''' 

  To test update on the staging server, change the following setting in your about:config 

extensions.update.url to   https://addons.allizom.org/z/update?reqVersion=%REQ_VERSION%&id=%ITEM_ID%&version=%ITEM_VERSION%&maxAppVersion=%ITEM_MAXAPPVERSION%&status=%ITEM_STATUS%&appID=%APP_ID%&appVersion=%APP_VERSION%&appOS=%APP_OS%&appABI=%APP_ABI%&locale=%APP_LOCALE%&currentAppVersion=%CURRENT_APP_VERSION%&updateType=%UPDATE_TYPE% 

'''''Settings for Thunderbird'':''' 

 To test update on the staging server, change the following setting in your about:config extension.update.url to   https://addons.allizom.org/z/update?reqVersion=%REQ_VERSION%&id=%ITEM_ID%&version=%ITEM_VERSION%&maxAppVersion=%ITEM_MAXAPPVERSION%&status=%ITEM_STATUS%&appID=%APP_ID%&appVersion=%APP_VERSION%&appOS=%APP_OS%&appABI=%APP_ABI% '''''Settings for Seamonkey:''''' To test update on the staging server, change the following setting in your about:config   extension.update.url to   https://addons.allizom.org/z/update?reqVersion=%REQ_VERSION%&id=%ITEM_ID%&version=%ITEM_VERSION%&maxAppVersion=%ITEM_MAXAPPVERSION%&status=%ITEM_STATUS%&appID=%APP_ID%&appVersion=%APP_VERSION%&appOS=%APP_OS%&appABI=%APP_ABI%&locale=%APP_LOCALE%&currentAppVersion=%CURRENT_APP_VERSION% 

'''Usecase Scenarios:'''

*testcase 1: Update add-on versions
** Check that clicking on “Find updates”, lists the latest supported versions for your installed add-ons
** Ensure that the update is successful

 

*testcase 2: Update Firefox versions (with add-on updates)
** Install an older version of Firefox
** Install older versions of add-ons which are not supported on the version you are updating to.(pick one extension, theme,dictionary and a language pack
** Upgrade Firefox to a newer version
** Check that when Firefox starts, it prompts you to upgrade all your incompatible add-ons
** Ensure that the update is successful

 

*testcase 3:Update Firefox versions (with no add-on updates)
** Install an older version of Firefox
** Install the latest versions of add-ons(pick one extension, theme,dictionary and a language pack
** Upgrade Firefox to a newer version
** Check that when Firefox starts, there are no fake prompts for updates

 

*testcase 4:Update prompt while opening a Firefox profile
** Create a profile which has a few older versions of add-ons installed.
** Quit Firefox
** Start the firefox profile
** Check that there are updates for incompatible add-on versions 

 

*testcase 5: Update prompt for beta add-ons
** Select an add-on which has multiple beta versions(say b1-b4)
** Install an older version of a beta add-on(b1
** Click on “Find Updates”
** Check that b4 versions is listed as an update
** Update is successful 

*testcase 6:Update prompt for: + extensions(.xpi) + themes(.xpi and.jar) + Dictionaries and Language packs

*testcase 6: Check that updates are only offered when the newer versions of the add-on are public
** Pick an add-on with an unreviewed latest version.
** Install the previous version of that add-on
** Click on “Find Updates” in the add-ons manager
** Check that there are no updates

*testcase 7: Check that there are no updates for unreviewed add-ons
** Pick an add-on with multiple unreviewed versions
** Install an older version
** Click on “Find Updates”
** No updates

*  testcase 8: Check that no updates are offered if the newer version is incompatible with user's browser version/platform
** Pick an add-on with an incompatible latest version
** Install an older version and restart
** Click on “Find Updates”
** No updates are offered

*testcase 9: Check for platform compatibility
** Pick an add-on which has version (b-n) compatible with the test platform and version b not supported on your platform/OS
** Install version (b-n) and restart
** Click on “Find Updates”
** No updates are offered

TestEngineering/Web/AMO/Testday/09012010

2016-08-26T20:33:50Z

StuartPhilp: StuartPhilp moved page TestEngineering/Web/AMO/Testday/09012010 to TestEngineering/UI/AMO/Testday/09012010

#REDIRECT [[TestEngineering/UI/AMO/Testday/09012010]]

TestEngineering/UI/AMO/Testday/09012010

2016-08-26T20:33:41Z

StuartPhilp: StuartPhilp moved page TestEngineering/Web/AMO/Testday/09012010 to TestEngineering/UI/AMO/Testday/09012010

Hello there, and welcome to the AMO test day! Thanks for volunteering your time and energy to help us improve addons.mozilla.org! Below, you'll find the setup information and some use-cases to help guide you in your testing; feel free, though, to go off on your own and just ad-hoc test!

Staging server: [https://next.addons.mozilla.org/en-US/firefox/ https://next.addons.mozilla.org/en-US/firefox/]

'''What are we testing?'''

The focus for this testday are the changes for 5.11.9 which includes-

*The new [https://next.addons.mozilla.org/en-US/firefox/collections/ Collections] pages.
*View/[https://next.addons.mozilla.org/en-US/firefox/users/edit Edit Profile] pages
*[https://next.addons.mozilla.org/en-US/firefox/users/pwreset Password reset] page
*User Registration and Verification

'''What are Collections?'''

Collections are groups of related add-ons created by users to share.

'''What to test?'''

Here are a few things you could check for: 

*Functionality - a Feature does what it is supposed to do. 
*Layout issues 
*Usability (does something not make sense? seem hard to use?) 
*[https://wiki.mozilla.org/WebAppSec/Secure_Coding_QA_Checklist Security] - XSS,encoding/escaping issues, etc. 
*Error handling - System fails gracefully and displays useful and appropriate user/error messages 

'''Pages/features to be tested'''

*[https://next.addons.mozilla.org/en-US/firefox/collections Collection landing page]
*[https://next.addons.mozilla.org/en-US/firefox/collections/add Collection Creation]
*Edit/Delete Collection
*Privacy setting for Collections
*Multiple Install for collections
*Transferring Owners
*Collection sorts
*View Profile Page
*Edit profile page
*Registration/Verification
*Password reset page
*Collection Search

'''Litmus test-run for new Collections:'''

You can run our testrun for Collections [https://litmus.mozilla.org/run_tests.cgi?test_run_id=194 here]

You can also help us do end-to-end testing by running the testruns listed below:

*[https://litmus.mozilla.org/run_tests.cgi?test_run_id=105 Testrun for AMO Public pages] - Includes testcases to validate user functionalities like adding add-on reviews,updating user profile etc. Don't forget to spiral around  scenarios to check for edge-cases. 
*[https://litmus.mozilla.org/run_tests.cgi?test_run_id=104 Testrun for AMO Search] - Includes testcases to test Search functionality on AMO. Don't forget to spiral around scenarios to check for edge-cases. 
*[https://litmus.mozilla.org/run_tests.cgi?test_run_id=106 Testrun for Add-on Collector] - Includes testcases to check for the extension Add-on Collector. Learn more about Add-on Collector [https://preview.addons.mozilla.org/en-US/firefox/addon/11950 here] 
*[https://litmus.mozilla.org/run_tests.cgi?test_run_id=101 Testrun for AMO Tagging] - Includes testcases to validate tagging add-ons. Don't forget to spiral around scenarios to check for edge-cases. 
*[https://litmus.mozilla.org/run_tests.cgi?test_run_id=107 Testrun for Button-states] - Includes testcases to test the different button-states on AMO. 

 

'''What *not* to worry about?''' 

*Don't worry about -261 or -203 errors when trying to install an add-on; the preview server doesn't always have the most up-to-date files synced to it from the production database

'''You found a bug!'''

Awesome! First thing you need to do is to check whether it's a known issue. You can search for existing AMO bugs [https://bugzilla.mozilla.org/query.cgi here] 

If you found a new/un-reported bug, give yourself a pat on the back and then please file the bug [https://bugzilla.mozilla.org/enter_bug.cgi?product=addons.mozilla.org here] 

If the process of filing a bug seems too daunting a task or if you are not sure whether something is a bug or not, then find someone in [irc://irc.mozilla.org/testday #testday] channel on [http://irc.mozilla.org IRC] to help you. 

Also, if you have permissions, please add [testday09012010] to the status whiteboard; thanks!

 

'''You want to do more''' 

Thanks for your interest in further testing our websites here at Mozilla! For an overview and ways to engage with us, please see [https://wiki.mozilla.org/QA/Execution/Web_Testing/Contribute https://wiki.mozilla.org/QA/Execution/Web_Testing/Contribute]. If you have any questions along the way, the best way to reach the team is via IRC, in [irc://irc.mozilla.org/#mozwebqa #mozwebqa], on irc.mozilla.org. [https://wiki.mozilla.org/QA/Execution/Web_Testing#The_Team_.2F_Contact_Info Here are some instructions] for those of you new to IRC.

'''Contact us''' 

[mailto:adesai@mozilla.com Aakash Desai] 

[mailto:kraj@mozilla.com Krupa Raj] 

[mailto:stephend@mozilla.com Stephen Donner]