View source for User:Mconnor/Pending/WeaveBenchmarks

* Basic goals
** Test full upload speed for all engines (easy)
** Test full download speed for all engines (easy)
** Test merge speed for all engines (hard)

* Full upload
** Create a test profile with arbitrary data, including random IDN domains, for all engines shipped by default
** wipe the server, then force a full sync to the server, timing start to finish.
** repeat this 20 times, drop high/low and average.

* Full download
** After the last run of the upload benchmark, do not wipe the server data.
** Wipe the local data and import everything from the server.
** Repeat 20x, as before, and generate a score.

* Merge speed
** <smart ideas go here>