Talos:WinXP:ITSupport: Difference between revisions

From MozillaWiki
Jump to navigation Jump to search
(New page: =Notes and Caveats= Please contact '''Alice''' if you need to do a physical reboot. Most problems can be solved by restarting processes without a reboot, and rebooting will destabilize per...)
 
No edit summary
 
Line 1: Line 1:
=Notes and Caveats=
=== In case of oddness, reboot ===
Please contact '''Alice''' if you need to do a physical reboot. Most problems can be solved by restarting processes without a reboot, and rebooting will destabilize performance numbers.
WinXP talos machines have been configured to auto restart necessary processes upon reboot. If the machines is misbehaving in some way (reporting red, odd numbers, not reporting in a long time) it should be rebooted.


=No Graphs=
If failures continue post reboot an appropriate bug should be filed with Release Engineering/Talos to have the issue investigated.
==== Talos boxes are reporting green, but there are no graph links.  It appears that no results from the tests were collected.====
 
1. Turn on '--debug' for talos machines
* ssh to qm-rhel02
* in /build/perfmaster edit master.cfg
* edit command=['python', 'run_tests.py', '--noisy'] to command=['python', 'run_tests.py', '--noisy', '--debug']
* restart the buildmaster
** in /build
** buildbot reconfig perfmaster
 
2. Wait for machines to cycle
 
3. Read the logs, there should be graph server errors that will indicate why sending data is failing
 
=Slave isn't reporting/is failing out=
=== A given Talos slave hasn't reported any numbers in a long time (upwards of 6 - 8 hours) OR A given Talos slave from a set has been consuming a lot of builds rapidly and failing out on browser download/installation ===
 
1. Check waterfall at: http://qm-rhel02.mozilla.org:2006/ (mpt-vpn)
* see if slave is connected.
 
2. Restart slave
* login to machine using provided credentials
** VNC (qm-pxp01-05, qm-mini*):
* close running instances of firefox or dialog windows (make sure to check the taskbar)
* ctrl-c in the command window, answer yes to terminate buildbot process
* cd c:\
* on qm-pxp*, 'buildbot start slave' (command does not return)
* on qm-mini*, 'buildbot start talos-slave' (command does not return)
 
'''note''' builds are triggered by finished builds on the Tinderbox (Firefox for trunk, Mozilla1.8 for branch). Then, depending on when the master was started, may take up to 10 minutes to recognize a change. If the master is restarted, first completed tinderbox builds are often missed so sometimes it can take upwards of 30-40 minutes to verify that systems are working as expected.
 
=Odd Reports=
=== A given Talos machine is reporting significantly higher/lower numbers than matching machines. ===
* Talos machines reporting to trunk come in sets of three (qm-mini-ubuntu01/02/03, qm-mini-vista01/02/03, etc) so that outlier results can be spotted.  If we see an outlier we try and fix the configuration on that given machine to have it match it's equals.
 
==== Steps For Restarting Talos Slave  ====
1. Stop the buildbot slave
* In the open cmd Ctrl-C, 'y' to stop slave
2. Check throttling
* Open speedswitch
* Check Settings
* Machine settings -> Forced Throttle 50%
3. Re-start apache
* Start Menu -> Programs -> Apache -> restart apache server
4. Check settings
* Display Theme: Windows XP
* screensaver off
* auto-update off
* firewall off
* all sleep features off
* screen size 1280 x 1024
5. Re-start the buildbot slave and check the numbers after the next successful machine cycle
* In the open cmd 'buildbot start talos-slave'
6. If all else fails, reboot the machine
 
7. Ensure the settings as described above are correct
 
8. Re-start the buildbot slave
* Open cmd
* cd c:/
* buildbot start talos-slave

Latest revision as of 19:01, 30 September 2008

In case of oddness, reboot

WinXP talos machines have been configured to auto restart necessary processes upon reboot. If the machines is misbehaving in some way (reporting red, odd numbers, not reporting in a long time) it should be rebooted.

If failures continue post reboot an appropriate bug should be filed with Release Engineering/Talos to have the issue investigated.

Retrieved from "https://wiki.mozilla.org/index.php?title=Talos:WinXP:ITSupport&oldid=110749"