User:Rcampbell/QA Projects: Difference between revisions

(User page moved)
 
(42 intermediate revisions by 2 users not shown)
Line 1: Line 1:
=== jssh test harness documentation ===
== Buildbot ==


==== requirements ====
* [[Buildbot]]


python (2.3 or greater)
* [[BuildbotTestfarm|Buildbot Test Farm]]


firefox 1.5 with jssh - built with mozconfig
* [[BuildbotTalos|Buildbot Talos]]


<pre>. $topsrcdir/browser/config/mozconfig
Consolidate buildbot packages.


mk_add_options MOZ_CO_PROJECT=browser
=== unittest todos ===
mk_add_options MOZ_OBJDIR=@topsrcdir@/../objdir/browser
# mk_add_options MOZ_CO_MODULE=mozilla/js/tests


ac_add_options --enable-extensions=default,jssh
* add js tests
mk_add_options MOZ_MAKE_FLAGS="-j4"</pre>
* convert RLk and Lk to buildbot
** [[User:Rcampbell/LeakTests|discussion with bz in #build]]
* reftest profile creation, [https://bugzilla.mozilla.org/show_bug.cgi?id=393410 393410]
* reboot, restart on-demand and automatically, [https://bugzilla.mozilla.org/show_bug.cgi?id=393411 393411]
* clobber in unittest directory, [https://bugzilla.mozilla.org/show_bug.cgi?id=393413 393413]
* stacktrace support, [https://bugzilla.mozilla.org/show_bug.cgi?id=393415 393415]
* update buildbot code automatically, [https://bugzilla.mozilla.org/show_bug.cgi?id=393290 393290]
* clobber + debug options on waterfall force page, [https://bugzilla.mozilla.org/show_bug.cgi?id=393417 393417]
* abort build, reboot slaves (from waterfall) [https://bugzilla.mozilla.org/show_bug.cgi?id=393418 393418]
* <strike>create tracking bug and add these to it</strike> DONE
** [https://bugzilla.mozilla.org/show_bug.cgi?id=393112 https://bugzilla.mozilla.org/show_bug.cgi?id=393112]
* create ssh key for qa machine cvs access (done, bug filed with IT by bhearsum)
* update machines with ssh key and modify checkout code to use it


firefox 2.0 with jssh
=== talos todos ===


pull MOZILLA_1_8_BRANCH from cvs
* ManifestDirectoryStreamer needs parameters for non-windows platforms [https://bugzilla.mozilla.org/show_bug.cgi?id=393048 393048] [https://bugzilla.mozilla.org/show_bug.cgi?id=393291 393291]
* Startup automation [https://bugzilla.mozilla.org/show_bug.cgi?id=393419 393419]
** Depending on task, may be undesireable to automatically startup particular masters and/or slaves
* PerfConfigurator.py checked in with Talos code [https://bugzilla.mozilla.org/show_bug.cgi?id=393266 393266]
* Buildbot master should probably be moved to a VM for easier backup and restoration/migration - qm-rhel02? [https://bugzilla.mozilla.org/show_bug.cgi?id=393421 393421]
* buildbot should clean up after faulty runs better [https://bugzilla.mozilla.org/show_bug.cgi?id=393420 393420]
** better dependent build steps
* <strike>create tracking bug and add these to it</strike> DONE
** [https://bugzilla.mozilla.org/show_bug.cgi?id=393044 https://bugzilla.mozilla.org/show_bug.cgi?id=393044]


<pre>cvs -d :pserver:anonymous@cvs-mirror.mozilla.org:/cvsroot co -r MOZILLA_1_8_BRANCH mozilla/client.mk</pre>
== Unit Testing Framework ==


<pre>cvs co -r MOZILLA_1_8_BRANCH mozilla/client.mk</pre>
As documented in bug# [https://bugzilla.mozilla.org/show_bug.cgi?id=343673 343673]


<pre>make client.mk checkout</pre>
[[SoftwareTesting:Tools:UnitTest]]


<pre>cvs co -D 2006-04-15 mozilla/extensions/jsshcvs checkout: Updating mozilla/extensions/jssh</pre>
== Automated Testing Frameworks ==


<pre>make client.mk build</pre>
[[SoftwareTesting:Tools:l10nVerifier|l10n Verification Tool]]


getting jssh:
== Extensions ==


python test harness and jssh driver
[[SoftwareTesting:Extensions:BookmarkTester|Bookmark Tester]]
 
== Onsite notes ==
 
[[robcee 1.9/3.0 Planning Discussion notes]]

Latest revision as of 00:55, 11 May 2015

Buildbot

Consolidate buildbot packages.

unittest todos

  • add js tests
  • convert RLk and Lk to buildbot
  • reftest profile creation, 393410
  • reboot, restart on-demand and automatically, 393411
  • clobber in unittest directory, 393413
  • stacktrace support, 393415
  • update buildbot code automatically, 393290
  • clobber + debug options on waterfall force page, 393417
  • abort build, reboot slaves (from waterfall) 393418
  • create tracking bug and add these to it DONE
  • create ssh key for qa machine cvs access (done, bug filed with IT by bhearsum)
  • update machines with ssh key and modify checkout code to use it

talos todos

  • ManifestDirectoryStreamer needs parameters for non-windows platforms 393048 393291
  • Startup automation 393419
    • Depending on task, may be undesireable to automatically startup particular masters and/or slaves
  • PerfConfigurator.py checked in with Talos code 393266
  • Buildbot master should probably be moved to a VM for easier backup and restoration/migration - qm-rhel02? 393421
  • buildbot should clean up after faulty runs better 393420
    • better dependent build steps
  • create tracking bug and add these to it DONE

Unit Testing Framework

As documented in bug# 343673

SoftwareTesting:Tools:UnitTest

Automated Testing Frameworks

l10n Verification Tool

Extensions

Bookmark Tester