Start-up Performance Improvements/TestPlan: Difference between revisions

Start-up Performance Improvements/TestPlan (view source)

747 bytes added , 20 May 2012

Confirmed users

2,959

edits

@@ Line 75: / Line 75: @@
 = Test Case Management =
-Test cases for this feature shall be tracked in [https://moztrap.mozilla.org MozTrap]. In MozTrap, they will be flagged as a Desktop Firefox 15 feature in the product version tag. Additionally, functional smoke tests will be flagged with the "smoke" tag. Feature signoff functional test cases will be flagged with the "feature signoff" tag.
+Test cases for this feature shall be tracked in [https://moztrap.mozilla.org MozTrap]. In MozTrap, they will be flagged as a Desktop Firefox 15 feature in the product version tag. Additionally, smoke tests will be flagged with the "smoke" tag. Feature signoff test cases will be flagged with the "feature signoff" tag. Each of these test cases are broke up into two categories: Functional and Performance. Functional covers test cases for verifying that the implementation matches the intended specification of the feature of what needs to be done. These test cases shall be flagged with the tag "functional." Performance covers test cases that run a particular test scenario, captures some start-up performance data, and measures it against a set of acceptance criteria. These test cases shall be flagged with the tag "performance." Example acceptance criteria could be seeing that the performance of some piece of data over multiple runs did not regress significantly and performance of metric X improved by 5% when running a certain test before and after this feature was implemented.
 = Bugs =