User:Standard8/Thunderbird Automated Tests Planning: Difference between revisions

Jump to navigation Jump to search

User:Standard8/Thunderbird Automated Tests Planning (view source)

Revision as of 13:11, 15 July 2009

215 bytes removed ,  15 July 2009
→‎MozMill and Leak & bloat tests.: Update based on current expectations.
(Initial version)
 
(→‎MozMill and Leak & bloat tests.: Update based on current expectations.)
Line 25: Line 25:
The rough plan is this:
The rough plan is this:


# {{Bug|458352}} Ludovic has been working on extending the runtest.py that is used as an aid to run the MozMill tests. The two main things we're adding are:
# <strike>{{Bug|458352}} support for different profiles when running tests</strike>
#* support for different profiles when running tests
# {{Bug|500142}} Integrate mozmill into the build system - tests can be run with "make mozmill" and "make mozmill-one"
#* being able to generate leak and bloat logs just by specifying one or two command line arguments.
# {{Bug|504304}} Test VM/buildbot slave for initial results and automation. Aim is to a) check the stability, b) use as a platform for implementing and testing the necessary mozmill test support infrastructure, c) get initial results alongside builds on day-to-day basis.
# {{Bug|500142}} The next step would be to make it so that runtest.py and the mozmill tests can be packaged via "make package-tests". This would mean that anyone could download a Thunderbird build and a test package and run the two together without build environment (python + mozmill would be the only requirements). This would also make it easier for non-developers to write tests.
# Bug TBD. Once support infrastructure is stable, expand mozmill tests across platforms.
# Once package-tests works, we can then set up additional tinderboxes (or just tinderbox steps) to download a build and a test package and run the two. With the package-tests step we can do this on release or debug builds (or both) hence providing confidence in our packaged release builds but also we can get debug output and leak stats.
 
# {{Bug|458352}} Once we've got that support, I'd like to replace the existing Leak and Bloat tests (which currently use js files installed in chrome) with a mozmill version. This will help with the extensibility of the tests and give us a better base for which we can start extend those tests {{Bug|458351}}.
Future:
#* This step currently blocked by {{bug|500201}} - MozMill is leaking lots of items. Hence moved to end.
 
* Bug TBD Hooking Mozmill up to make package-tests.
** This would allow non-devs to download a test package and run alongside builds. Could also move mozmill tests to a separate slave if required.
* {{Bug|458352}} Hooking Mozmill up to Leak and Bloat tests.
** This step currently blocked by {{bug|500201}} - MozMill is leaking lots of items. Hence moved to end.
** Once we've got that support, I'd like to replace the existing Leak and Bloat tests (which currently use js files installed in chrome) with a mozmill version. This will help with the extensibility of the tests and give us a better base for which we can start extend those tests {{Bug|458351}}.
Standard8
canmove, Confirmed users, Bureaucrats and Sysops emeriti
3,628

edits

Retrieved from "https://wiki.mozilla.org/Special:MobileDiff/155352"

Navigation menu