71
edits
Hasal: Difference between revisions
update hasal current status
Bobbychien (talk | contribs) (Add project plan) |
(update hasal current status) |
||
| Line 1: | Line 1: | ||
A performance measurement project for Google Doc, Google Sheet, and Google Slide. | A performance measurement project for Google Doc, Google Sheet, and Google Slide. | ||
= | == State of this project == | ||
We are currently in the middle of phase 2. Close to finish profiler data generation for med priority results. | |||
What we do next will be revisit the test case for medium priority test cases and profiler data generation for low priority results. | |||
= Project Plan = | |||
== About this project == | |||
We are trying to measure the difference between Firefox and Chrome on high visibility web apps (Google Doc, Google Sheet, Google Slide, etc.) | |||
We use the video recording to record the user actions and extract the frames to get the running time from user perspective. Based on same user actions, we measure the difference between Firefox and Chrome. | |||
== Project Plan == | |||
** [https://goo.gl/umtHvq Resource Plan] | ** [https://goo.gl/umtHvq Resource Plan] | ||
** [https://goo.gl/n4TnoL Test Plan] | ** [https://goo.gl/n4TnoL Test Plan] | ||
** [https://docs.google.com/spreadsheets/d/1rU6cMxAtkucD-6PrpeWcGOf_6aplMCngS3ecSXgeHoo/edit#gid=1119453330 Meeting minutes] | ** [https://docs.google.com/spreadsheets/d/1rU6cMxAtkucD-6PrpeWcGOf_6aplMCngS3ecSXgeHoo/edit#gid=1119453330 Meeting minutes] | ||
=== Google Doc === | |||
==== Phase 1 (Done) ==== | |||
* Build up a workable framework that can run some manual created test cases | |||
** Trigger actions on browser | |||
** Record video on the background | |||
** Enable profiler on firefox automatically | |||
** Convert the video to image automatically | |||
** Compare images with sample images | |||
* Measure the difference between Firefox and Chrome for sample user actions (40% found between Firefox and Chrome) | |||
= [https://bugzilla.mozilla.org/show_bug.cgi?id=1260981 Working Items] = | ==== Phase 2 ==== | ||
* Create test cases based on test matrices | |||
* Create test scripts for high priority cases and execute them | |||
* Generate profiler data for each testing result | |||
** Profiler data for high priority result | |||
** Profiler data for med priority result | |||
** Profiler data for low priority result | |||
* Find out the module and method which cost the most running time | |||
* Go through the whole process from analyzing to provide information | |||
* Framework improvement | |||
** Replace Selenium with Sikuli | |||
** Get the medium value and other statistics | |||
* Support windows and mac | |||
==== Phase 3 ==== | |||
* Create scripts for medium and low priority cases and execute them | |||
* Find out the module and method which cost the most running time | |||
== Team == | |||
{| class="wikitable" | |||
! style="text-align: center;" | Name | |||
! style="text-align: center;" | Email address | |||
! style="text-align: center;" | | |||
|- | |||
| rowspan="1" | Shako Ho | |||
| [http://mailto:sho@mozilla.com sho@mozilla.com] | |||
| You can contact him to get more project detail. | |||
|- | |||
| rowspan="1" | Askeing Yen | |||
| [http://mailto:askeing@mozilla.com askeing@mozilla.com] | |||
| | |||
|- | |||
| rowspan="1" | Cynthia Tang | |||
| [http://mailto:ctang@mozilla.com ctang@mozilla.com] | |||
| | |||
|- | |||
| rowspan="1" | Farmer Tseng | |||
| [http://mailto:fatseng@mozilla.com fatseng@mozilla.com] | |||
| | |||
|- | |||
| rowspan="1" | Walter Chen | |||
| [http://mailto:wachen@mozilla.com wachen@mozilla.com] | |||
| | |||
|- | |||
|} | |||
== [https://bugzilla.mozilla.org/show_bug.cgi?id=1260981 Working Items] == | |||
<bugzilla> | <bugzilla> | ||
{ | { | ||
| Line 19: | Line 84: | ||
</bugzilla> | </bugzilla> | ||
= External Links = | == Setup environment == | ||
=== Testing Framework === | |||
Following the steps here [https://github.com/Mozilla-TWQA/Hasal/blob/master/README.md] to setup the framework. For the time being, only Ubuntu is officially supported as a testing environment; you can use OS X but you'll have to manually solve some package dependency issue. Note that Ubuntu 12.04 and 14.04 is the best-supported testing OS. | |||
=== Analysis Tool === | |||
Following the steps here [https://github.com/Mozilla-TWQA/Hasal_analysis/blob/master/README.md] to setup the tool. For the time being, only Ubuntu is officially supported as a testing environment; you can use OS X but you'll have to manually solve some package dependency issue. Note that Ubuntu 12.04 and 14.04 is the best-supported testing OS. | |||
== External Links == | |||
* | * | ||