Community:SummerOfCode17: Difference between revisions

Community:SummerOfCode17 (view source)

877 bytes added , 12 March 2017

→‎Automation & Tools: - add Improve Reliability of Automated tests

Confirmed users

3,376

edits

@@ Line 186: / Line 186: @@
 ! [mailto:marco@mozilla.com Marco]
 ! The project would involve finalizing https://github.com/marco-c/crashsimilarity; testing it more thoroughly; putting it in production.
+|-
+! Improve Reliability of Automated tests
+! Add a --test-lint mode to all harnesses which will ensure the test is more stable and check for common mistakes.
+! Python, Javascript
+! [mailto:jmaher@mozilla.com Joel (:jmaher)]
+! [mailto:gbrown@mozilla.com Geoff (:gbrown)]
+! Mozilla's developers write dozens of new tests every week.  We would like to provide a way to ensure these new tests are stable and reliable.  This will be done by implementing a test-lint mode in all of our test harnesses which will run the tests by themselves as well as repeat them 10 times each.  In addition to keeping the new tests stable, we want to make sure it is easier to debug test failures, this will be done by hooking up common options in our CI system to retrigger jobs with specific flags to generate the data we need. more details here: https://public.etherpad-mozilla.org/p/9u9OijDCKn
 |}