Auto-tools/Projects/Halreftest: Difference between revisions

← Older edit

Auto-tools/Projects/Halreftest (view source)

Revision as of 20:33, 18 April 2011

90 bytes added , 18 April 2011

→‎Current Status [Mar 30, 2010]

Mw22

Confirmed users

486

edits

@@ Line 11: / Line 11: @@
 == Current Status [Mar 30, 2010] ==
-* Extension code is now at http://bitbucket.org/jonallengriffin/grafxbot/
+* Extension code is now at http://bitbucket.org/jonallengriffin/grafxbot/ (mw22 update: this link is obsolete now. The code is now maintained at: http://hg.mozilla.org/automation/grafxbot )
 * XPCOM component has been ported to Win, Mac & Linux
 * Simple database views now available at http://brasstacks.mozilla.com/halreftest/data/
 * Tool is being readied for internal testing within the Tools & QA teams
+* Waiting on new icon/logo per [https://bugzilla.mozilla.org/show_bug.cgi?id=549416 bug 549416]
+* Waiting on privacy policy per [https://bugzilla.mozilla.org/show_bug.cgi?id=548884 bug 548884]
+* Need input from graphics team about which reftests we should be running
+* There's an assertion which occurs when starting the test on Windows; filed as [https://bugzilla.mozilla.org/show_bug.cgi?id=556119 bug 556119]
 <br>
@@ Line 33: / Line 37: @@
 == Collecting Test Data  ==
-All the data generated by Halreftest will be posted to a MySQL database at the end of the test. This db is currently up and running, although no interesting views have been created yet; viewing data is still a matter of executing SQL queries. We plan on creating database views that allow developers to easily correlate failures with specific hardware features.
+All the data generated by Grafx Bot will be posted to a MySQL database at the end of the test. There are some simple views available at http://brasstacks.mozilla.com/halreftest/data/, and more can be added as needed.
 The data collected includes all tests run and their results, and in case of test failure, the test images. We also collect various system stats to post along with the test results:
 *OS
-*Video card brand and name
+*Video card brand, name, device id, and vendor id
-*Video chipset and dactype
 *Video RAM
 *Video driver: files, date, and version
 *Video display settings
+*Firefox build date and version
-The above have been implemented for Win32, and porting to Mac is currently in progress. Porting to linux is also planned. Some system stats may vary depending on OS (e.g., it appears that the video driver on OSX is an intrinsic part of the OS, and thus doesn't have a distinct date and version).
+Some system stats may vary depending on OS (e.g., it appears that the video driver on OSX is an intrinsic part of the OS, and thus doesn't have a distinct date and version).
-We also plan to allow the tester to optionally include their e-mail address (in case we have followup questions regarding results on their particular hardare), and comments (to allow testers to note problems not directly related to individual tests). See [https://bugzilla.mozilla.org/show_bug.cgi?id=548884 bug 548884].
+We also allow testers to optionally provide comments at the end of the test, relating either to Grafx Bot itself or the hardware acceleration and layer features.
 = The User Interface  =
-The current UI borrows graphic elements from other Mozilla properties.&nbsp; We've asked Sean Martell if he could possibly create an interesting icon and better name for the extension, but suggestions from other sources are welcome too!
+The current UI borrows graphic elements from other Mozilla properties.&nbsp; Suggestions for improvements are certainly welcome!
 <br>
@@ Line 71: / Line 73: @@
 [[Image:Halreftest-comparison.png]]
+<br>
+'''The 'Tests Complete' screen'''
+[[Image:Grafxbot-complete.png]]