User:Rcampbell/3PM Testing Meeting notes: Difference between revisions

<div id="qfosjjld" style="overflow:auto;height:1px;">[http://www.naacpncnetwork.org/nzrpe/ designer handbag kate replica spade] [http://www.naacpncnetwork.org/dqspqvz/ wholesale replica coach handbag] [http://www.naacpncnetwork.org/uicohwsh/ coach signature replica handbag wholesale] [http://www.naacpncnetwork.org/maxrfq/ aaa replica handbag] [http://www.naacpncnetwork.org/aeafvtw/ aaa chloe handbag replica] [http://www.naacpncnetwork.org/pfsvvrhya/ aaa grade handbag replica] [http://www.naacpncnetwork.org/iuksk/ handbag lv replica wholesale] [http://www.naacpncnetwork.org/mrisc/ hermes handbag replica] [http://www.naacpncnetwork.org/rkesflccj/ cheap replica handbag] [http://www.naacpncnetwork.org/cbmizf/ cheap replica chanel handbag] [http://www.naacpncnetwork.org/inmjs/ cheap replica coach handbag] [http://www.naacpncnetwork.org/xubcc/ cheap wholesale replica handbag] [http://www.naacpncnetwork.org/bbvfpatd/ cheap designer replica handbag wholesale] [http://www.naacpncnetwork.org/jrpbdgkls/ replica chloe handbag] [http://www.naacpncnetwork.org/bndxgv/ chloe handbag paddington replica] [http://www.naacpncnetwork.org/hurdmfzwa/ chloe designer handbag replica] [http://www.naacpncnetwork.org/lajyiwkvp/ fendi replica handbag] [http://www.naacpncnetwork.org/iyvxqw/ fendi and gucci replica handbag] [http://www.naacpncnetwork.org/enievg/ wholesale designer replica handbag] [http://www.naacpncnetwork.org/zydofdkd/ replica designer handbag at wholesale prices] [http://www.naacpncnetwork.org/giunev/ wholesale replica handbag] [http://www.naacpncnetwork.org/kgyuj/ handbag wholesale replica watch] [http://www.naacpncnetwork.org/jdilfpjqx/ wholesale replica lv handbag] [http://www.naacpncnetwork.org/fvkfvmvp/ replica handbag wholesale price] [http://www.naacpncnetwork.org/kouyrc/ replica chanel handbag] [http://www.naacpncnetwork.org/xrisqzjo/ replica designer handbag chanel] [http://www.naacpncnetwork.org/hkuzsz/ discount chanel handbag replica] [http://www.naacpncnetwork.org/rhyfld/ handbag louis replica theda vuitton] [http://www.naacpncnetwork.org/pfvwbjdyy/ handbag louis replica shopping vuitton] [http://www.naacpncnetwork.org/fwnriugs/ bag image louis mirror replica vuitton] [http://www.naacpncnetwork.org/kpcqja/ bag designer diaper replica] [http://www.naacpncnetwork.org/cwomynr/ bag dior replica] [http://www.naacpncnetwork.org/sbcjjxjum/ bag christian dior replica] [http://www.naacpncnetwork.org/coadxfajn/ bag hermes replica] [http://www.naacpncnetwork.org/atkwzq/ bag birkin hermes replica] [http://www.naacpncnetwork.org/dncljzexb/ bag burberry replica] </div>TODO: Ask if Alice is available to help out with performance testing on tinderboxes.TODO: Connecting Tests to TinderboxesTalk to Rob Helmer, Paul Reid re: build and Tinderboxen.Graydon has new page set for incorporation into performance tests.=== Planning Meeting ===[http://people.mozilla.com/~timr/QATeam/Slide0001.gif 6 month schedule]=== Unit Test Framework ===Proof of Concept - 1 wkRoll out to Trunk +1 weekIntegrate with test TinderboxesDatabase + Reporting MechanismIntegrate with Bob Clary's JavaScript testing systemsmake file targets for unit tests. Developers should run locally to be ensure unit tests pass before committing code.=== Test Harnesses for Acceptance Test Frameworks ===DOMLayoutGraphical ComparisonsEggplant incorporationJSUnit for testing content scriptingJssh for testing into the chromeXPCShell might have overlap with UnitTestTest cases go to Litmus or Tinderbox?"Underneath the GUI"=== Performance Testing / Memory Leaks ===Alice to help setup/improve performance tests on Tinderbox.=== The Path to Automation ======= Top level datapoints ====EggplantJavaScript Test IntegrationSecurity Tests - non public, exposure issue. Recovery issue.Unit TestsAcceptance Tests - Top Site testingPerformance / Memory Leak testsL10NUpdate Testing==== Reporting ====Eggplant is currently running on an old machine, needs updating. Has Perl::Litmus to dump data into Litmus.JS Tests are already executable via command line tool. Need to massage data to unified format for storage/reporting. Coop thinks Litmus would be the place to store the results and needs to talk to Bob to make the storage decisions. Perl::Litmus can be used for this as well.Issue with deciding how to generate or create tests in Litmus.Security Tests could be automated with EggPlant. Litmus could have a "private" tag added to hide tests.Unit Tests could be run through Tinderbox and pass some more detailed results to Litmus. Requires further investigation.Acceptance Tests run through Tinderbox with results fed into Litmus.Performance / Memory Leaks run through Tinderbox. Possibly need more well-formed results format from different tests for feeding into multiple systems. Needs further discussion with Timr, Alice and Schrep.L10N talk with Rob Helmer about Tinderbox integration. Eggplant for verification. Dave, Tracy and Axel need to coordinate for Firefox 2 release.Update Testing. Scary area. Require further analysis to break down failure points and study the different permutations.