Confirmed users
14,525
edits
QA/Platform/DOM/Metrics: Difference between revisions
Jump to navigation
Jump to search
no edit summary
No edit summary |
No edit summary |
||
| Line 12: | Line 12: | ||
In implementation we will experiment with a lot of different metrics and data sources in an attempt to see which metrics, either singularly or in conjunction with other data, enable us to effectively make informed decisions. | In implementation we will experiment with a lot of different metrics and data sources in an attempt to see which metrics, either singularly or in conjunction with other data, enable us to effectively make informed decisions. | ||
=== Catalog of Potential Data Sources and Metrics === | |||
* https://github.com/AutomatedTester/futurama-data | * https://github.com/AutomatedTester/futurama-data | ||
** intermittent test failure rate | ** intermittent test failure rate | ||
| Line 32: | Line 32: | ||
** tracked bugs by version ([https://drive.google.com/open?id=1yw4tQ9g20DlkIltVa1XZjnC9Gptq8lmpJGD1bY4zFlw&authuser=1 draft]) | ** tracked bugs by version ([https://drive.google.com/open?id=1yw4tQ9g20DlkIltVa1XZjnC9Gptq8lmpJGD1bY4zFlw&authuser=1 draft]) | ||
** unconfirmed bugs by sub-component ([https://drive.google.com/open?id=1DhBKA4P6jEVenV7Z0L043x8MV4vfbCd6qlNPA_8zP4Y&authuser=1 draft]) | ** unconfirmed bugs by sub-component ([https://drive.google.com/open?id=1DhBKA4P6jEVenV7Z0L043x8MV4vfbCd6qlNPA_8zP4Y&authuser=1 draft]) | ||
** bugs by platform | ** bugs by platform ([https://drive.google.com/open?id=1WNfBIk15p0KQ-Ha__jI74u46qfcMbht6cgG54UQDoDw&authuser=1 draft]) | ||
** mean time to find regression window | ** mean time to find regression window | ||
** mean time to resolve a bug with a regression window vs a regression without a window | ** mean time to resolve a bug with a regression window vs a regression without a window | ||
* ''to be determined'' | * ''to be determined'' | ||
** spec test coverage | ** spec test coverage | ||