QA/Svc Tests

This page is obsolete - moved to QA/External_Tests

Problem

As technology changes, the need to test against a publicly accessible server is apparent. Currently, tests cannot access the public internet for Gecko and Gaia. This is a big problem for services such as Loop, FindMyDevice, Sync, and Firefox Accounts. Without landing in the core repository means a separate repo must be maintained and is hard to discover.

Proposal

To solve this, let's create a directory and prefix specifically for tests with external access that will not be run by TBPL or the standard make targets.

These tests will:

• NOT run on TPBL
• NOT run with the general make/mach commands.
• Tests will be run on another CI system.
• test reports will be sent to TreeHearder
• Devs can choose to run these tests locally when they are on the internet and are working on code that affects that service.
• Environment variables will be set to direct tests to point to {PROD,STAGE,DEV} servers.

Details

Possible directory and test prefix:

• services/
• ext/
• extaccess/
• netaccess/

Here's the directory structure, does not live inside of marionette or integration:

• /shared/test/ext/
• /system/test/ext/

I believe file name prefix doesn't matter as gaia-ui-tests are not read in by make test.