314
edits
TestcaseManagementIdeas: Difference between revisions
Jump to navigation
Jump to search
→What is being tracked
Zachlipton (talk | contribs) No edit summary |
Zachlipton (talk | contribs) |
||
| Line 17: | Line 17: | ||
* Testcases can also have flags associated with them. We would want to be able to add/remove flags on the fly, but initially flags would include such bits as: | * Testcases can also have flags associated with them. We would want to be able to add/remove flags on the fly, but initially flags would include such bits as: | ||
** unconfirmed - a user-submitted test that must be confirmed before it should get widespread use | ** unconfirmed - a user-submitted test that must be confirmed before it should get widespread use | ||
** broken - the test does not work (e.g. it is hard to understand or not applicable) | ** broken - the test does not work (e.g. it is hard to understand or not applicable) | ||
* Organization of testcases -- | |||
** Products | |||
** Groups -- each product consists of one or more test groups | |||
*** For instance, the Firefox product might have a menubar group, a toolbar group, etc... See [http://test.bclary.com/docs/test-organization.xhtml Bob's document on test organization]. | |||
** Subgroups -- smaller divisions such as bookmarks, etc... | |||
** In addition, any number of tests can be put together to make a test suite. | |||
*** Suites can be defined via a query (e.g. a set of all Firefox UI tests related to bookmarks => the Firefox BFT bookmarks suite) | |||
*** Or suites can be defined by arbitrary test numbers (e.g. test numbers 64, 98, and 101 => the Firefox Browser smoketests) | |||
*** Suites can also consist of other suites (e.g. all the Firefox smoketest suites => the Firefox smoketests). | |||
*** At any point, tests can be reordered within a suite, probably by using some kind of fancy dhtml UI. | |||
=== Unanswered questions === | === Unanswered questions === | ||
* Where do testcases live? In the system or in a directory structure that the system points to? | * Where do testcases live? In the system or in a directory structure that the system points to? | ||
* The "format" for testcases. What form should tests be in so they can be managed by the system? | * The "format" for testcases. What form should tests be in so they can be managed by the system? | ||