5
edits
QA/TDAI/Projects: Difference between revisions
Jump to navigation
Jump to search
no edit summary
No edit summary |
|||
| Line 37: | Line 37: | ||
* Selenium {{bug|424820}} | * Selenium {{bug|424820}} | ||
* Qooxdoo {{bug|426191}} | * Qooxdoo {{bug|426191}} | ||
= Test Results Comparison Reports = | |||
Currently there is no way to compare test results between runs. We need to store test results more reliably to compare test data and see the differences between one run and another that can be helpful to track tests that fail randomly, track large number of failures across different platforms, etc | |||
The solution is to set up a database to store test failures of each run and preferably web interface for viewing . | |||
The idea is to have a results server and relevant data from log files of each run will be parsed and sent to the server via JSON. Queries can then be built on the results to be viewed on a webpage, or as an XML feed. | |||
To start off, we will: | |||
*write a log parser for xpcshell and reftest and upload the data to CouchDb. | |||
*Once small sets of data are in there, we need to look at queries. | |||
*We also need to be able to run the scripts automatically during build and inform the status (work with the build team). | |||