User:Asasaki:Tp4Rollout

(obsolete; done)

.....

We have a working-on-maemo talos in cvs that will allow us to run Tp4 and post to graphs instead of graphs-old. We need to roll this out to the N810s, and do so in stages.

Bugs:

• tp4 for maemo
• linux buildbot master

SD3

We need to create an SD image version 3 that can run this.

I've got an SD2+ running on 05 and 27 that work on mobile-dev1 (9012) that's close.

SD2+:

• turn on deb repos
• apt-get install ttf-droid ttf-dejavu
• replace /tools/talos with contents of mobile-master:~cltbld/talos-test/ (rsync with --delete?)
• turn off deb repos

Proposal for SD3:

• turn on deb repos
• apt-get install ttf-droid ttf-dejavu
• install e2fsprogs <-- maybe? i think it would be a good idea.
• possibly nuke /tools/talos and /builds/talos softlink, see below
• possibly keep deb repos on
  • The orange blinky is annoying and affects numbers but doesn't show up that often, maybe. I've found on several occasions that I want to try to install a package and can't easily, due to the repos being turned off. If we had a way to turn them back on remotely I'd be ok with it.
    • Maybe re-install vnc instead?

Talos, easy solution:

nuke /tools/talos, copy mobile-master:~cltbld/talos/ to /tools/talos, then extract the pageloader inside, creating /tools/talos/chrome and /tools/talos/components.

Talos, better solution:

• Nuke /tools/talos and /builds/talos
• Update buildbot configs to download talos and the pageloader per test run as /builds/talos, and run the tests using those. This will add a small amount of time but will allow us to update the talos code at will.

Buildbot changes

in config.py, we need to change graphs-stage-old to graphs-stage, graphs-old to graphs, and tp/tp3 to tp4. So for m-c, for the tp4 portion:

BRANCHES['mozilla-central']['platforms']['n810']['talos_suites'] = { 
    'tp4': {}, 
    'non_tp1': {}, 
    'non_tp2': {}, 
}
BRANCHES['mozilla-central']['platforms']['n810']['talos_suites']['tp4']['suite_name'] = 'N810 mozilla-central talos Tp4'
BRANCHES['mozilla-central']['platforms']['n810']['talos_suites']['tp4']['build_dir'] = 'n810-trunk-tp4'
BRANCHES['mozilla-central']['platforms']['n810']['talos_suites']['tp4']['config_file'] = 'mobile.config'
BRANCHES['mozilla-central']['platforms']['n810']['talos_suites']['tp4']['active_tests'] = {
    'tp4':   90, 
}
BRANCHES['mozilla-central']['platforms']['n810']['talos_suites']['tp4']['disable_jit'] = False

factories.py has been moved to buildbotcustom/process/mobiletestfactory.py. In here, we need to change the PerfConfigurator step:

command='python PerfConfigurator.py -v -e %s/fennec/fennec -t `hostname` --branch %s --branchName %s --activeTests %s --sampleConfig %s --browserWait %d --noChrome --resultsServer %s --resultsLink /server/collect.cgi --output local.config' % (self.baseDir,self.branch,self.branch,testName,talosConfigFile,activeTests[testName],resultsServer),

Ugly? Yeah. We gotta clean that up... we can probably replace `hostname` with the build slave name property, at which time we can make that a list rather than a long string. I haven't really spent any time on that since I first wrote it though.

Note: We currently have /builds/buildbot/configs, configs-staging, and configs-dev, as well as /tools/buildbotcustom, buildbotcustom-staging, and buildbotcustom-dev. If you use the Makefile in each buildbot master directory, it should set the PYTHONPATH appropriately.

Run in Parallel

mfinkle is worried about not having any baseline data on graphs.m.o and wanted us to migrate data from graphs-old to have that baseline data.

This isn't a simple task and we haven't imported any data from Firefox.

The way I see it: run two ports (or two masters, if we have a new linux master). One is running tp4 and reporting to graphs.m.o, the other's running tp3 and reporting to graphs-old.m.o, with separate pools of slaves. They might both be reporting to Mobile tinderbox, or maybe one's elsewhere. They run all the talos tests, however.

If we keep 10+ slaves running on each for a week or 3, we'll hopefully have enough of a baseline to drop the SD2/tp3/graphs-old boxen and switch completely over to SD3/tp4/graphs.m.o.