314
edits
TestcaseManagementIdeas: Difference between revisions
formats
Zachlipton (talk | contribs) No edit summary |
Zachlipton (talk | contribs) (formats) |
||
| Line 3: | Line 3: | ||
* Keep track of the tests we have, when they are run, and their status on various platforms. | * Keep track of the tests we have, when they are run, and their status on various platforms. | ||
=== Some mockups === | === Some (very rough) mockups === | ||
* [http://www.zachlipton.com/litmusmockups/ Home] | * [http://www.zachlipton.com/litmusmockups/ Home] | ||
* [http://www.zachlipton.com/litmusmockups/confirmedfailures.html Query] | * [http://www.zachlipton.com/litmusmockups/confirmedfailures.html Query] | ||
| Line 32: | Line 32: | ||
*** Suites can also consist of other suites (e.g. all the Firefox smoketest suites => the Firefox smoketests). | *** Suites can also consist of other suites (e.g. all the Firefox smoketest suites => the Firefox smoketests). | ||
*** At any point, tests can be reordered within a suite, probably by using some kind of fancy dhtml UI. | *** At any point, tests can be reordered within a suite, probably by using some kind of fancy dhtml UI. | ||
=== Formats === | |||
* Testcases can have a format associated with them. For example, a standard BFT or smoketest might have a manual steps format, consisting of a series of actions to perform and a description of expected results. Other tests may have formats more suited to automation, such as a xul test format consisting of a chunk of XUL and a snippit of javascript. | |||
* New formats can be created as testing evolves. | |||
* Not everything has to fit into a "do these steps, look for this result" model. | |||
=== Unanswered questions === | === Unanswered questions === | ||
* Where do testcases live? In the system or in a directory structure that the system points to? | * Where do testcases live? In the system or in a directory structure that the system points to? | ||
* The "format" for testcases, particularly automated testcases. What form should tests be in so they can be managed by the system? | * The "format" for testcases, particularly automated testcases. What form should tests be in so they can be managed by the system? | ||
* Editing testcases in ways other than html forms. | |||