Confirmed users
14,525
edits
QA/Mozmill Test Automation/Fixing Broken Tests: Difference between revisions
Jump to navigation
Jump to search
QA/Mozmill Test Automation/Fixing Broken Tests (view source)
Revision as of 14:30, 17 August 2011
, 17 August 2011→Filing a Bug
| Line 43: | Line 43: | ||
If a failure has been discovered, a search on Bugzilla has to be performed before filing a new bug. It's necessary to make sure that no-one else already created a bug for that failing test. There is a query which lists all [https://bugzilla.mozilla.org/buglist.cgi?status_whiteboard_type=allwordssubstr&query_format=advanced&status_whiteboard=mozmill-test-failure&bug_status=UNCONFIRMED&bug_status=NEW&bug_status=ASSIGNED&bug_status=REOPENED&known_name=mozmill-tests-broken&query_based_on=mozmill-tests-broken broken tests]. | If a failure has been discovered, a search on Bugzilla has to be performed before filing a new bug. It's necessary to make sure that no-one else already created a bug for that failing test. There is a query which lists all [https://bugzilla.mozilla.org/buglist.cgi?status_whiteboard_type=allwordssubstr&query_format=advanced&status_whiteboard=mozmill-test-failure&bug_status=UNCONFIRMED&bug_status=NEW&bug_status=ASSIGNED&bug_status=REOPENED&known_name=mozmill-tests-broken&query_based_on=mozmill-tests-broken broken tests]. | ||
If none of the listed bugs covers the test or test module you are experiencing the failure in, please file a [https://bugzilla.mozilla.org/enter_bug.cgi?alias=&assigned_to=nobody%40mozilla.org&blocked=&bug_file_loc= | If none of the listed bugs covers the test or test module you are experiencing the failure in, please file a [https://bugzilla.mozilla.org/enter_bug.cgi?alias=&assigned_to=nobody%40mozilla.org&blocked=&bug_file_loc=&bug_severity=normal&bug_status=NEW&comment=-----%20INSTRUCTIONS%20FOR%20FILING%20A%20MOZMILL%20FAILURE%20BUG%20-----%0D%0ANOTE%3A%20REMOVE%20THIS%20SECTION%20BEFORE%20FILING%20THE%20BUG%0D%0A%0D%0A1.%20Include%20a%20URL%20above%20for%20the%20dashboard%20report%20where%20the%20failure%20occurs%0D%0A%0D%0AEXAMPLE%3A%0D%0Ahttp%3A%2F%2Fmozmill-release.brasstacks.mozilla.com%2F%23%2Ffunctional%2Ffailure%3Ftest%3D%252FtestSecurity%252FtestGreenLarry.js%26func%3DtestLarryGreen%0D%0A%0D%0A2.%20Include%20the%20test%20and%20failure%20type%20in%20the%20SUMMARY%20field%0D%0A%0D%0AEXAMPLE%3A%0D%0A%22Failure%20in%20%2FtestSecurity%2FtestGreenLarry.js%20%7C%20Timeout%20waiting%20for%20page%20loaded.%22%0D%0A%0D%0A3.%20Add%20%22%5Bmozmill-test-failure%5D%22%20to%20the%20whiteboard%20field%20below%0D%0A%0D%0A4.%20Include%20the%20test%20function%2C%20error%20message%2C%20date%20when%20the%20error%20occurred%2C%20date%20with%20the%20error%20first%20occurred%2C%20and%20number%20of%20times%20the%20error%20has%20been%20reported%20in%20the%20DESCRIPTION%20field%0D%0A%0D%0AEXAMPLE%3A%0D%0ATEST%3A%20testSecurity%2FtestGreenLarry.js%3AtestLarryGreen%28%29%0D%0AERROR%3A%20controller.waitForPageLoad%28%29%3A%20Timeout%20waiting%20for%20page%20loaded.%20%0D%0AWHEN%3A%202011-07-01%0D%0AFIRST%3A%202011-06-25%0D%0AFREQ%3A%205%0D%0A%0D%0A5.%20Remove%20these%20instructions%0D%0A%0D%0A6.%20Click%20SUBMIT%20BUG%0D%0A-----%20END%20INSTRUCTIONS%20-----%0D%0A%0D%0ATEST%3A%20%0D%0AERROR%3A%20%0D%0AWHEN%3A%20%0D%0AFIRST%3A%20%0D%0AFREQ%3A%20%0D%0A&component=Mozmill%20Tests&contenttypeentry=&contenttypemethod=autodetect&contenttypeselection=text%2Fplain&data=&dependson=&description=&flag_type-37=X&flag_type-4=X&flag_type-607=X&form_name=enter_bug&keywords=&maketemplate=Remember%20values%20as%20bookmarkable%20template&op_sys=All&priority=--&product=Mozilla%20QA&qa_contact=mozmill-tests%40mozilla-qa.bugs&rep_platform=All&requestee_type-325=&requestee_type-4=&requestee_type-607=&short_desc=&status_whiteboard=&target_milestone=---&version=unspecified new bug]. Make sure that the summary contains a copy of the error message and the test module it happens in. | ||
==Disabling Test in Litmus== | ==Disabling Test in Litmus== | ||