166
edits
QA/Bug Triage Guidelines: Difference between revisions
Jump to navigation
Jump to search
no edit summary
Paul.oiegas (talk | contribs) No edit summary |
Paul.oiegas (talk | contribs) No edit summary |
||
| Line 60: | Line 60: | ||
|- | |- | ||
| New || Where there is no Component, set one. Where it cannot be reproduced, ask the Reporter for additional information or close as Incomplete / WFM | | New || Where there is no Component, set one. Where it cannot be reproduced, ask the Reporter for additional information or close as Incomplete / WFM | ||
NOTE: Sometimes, reporters mark issues as New without being confirmed by an Mozillian or Community Member. Read carefully to see if it needs confirmation to remain New or it needs to be changed back to Unconfirmed until it can be reproduced | '''NOTE''': Sometimes, reporters mark issues as New without being confirmed by an Mozillian or Community Member. Read carefully to see if it needs confirmation to remain New or it needs to be changed back to Unconfirmed until it can be reproduced | ||
|- | |- | ||
| Crash || If there is no activity by Mozilla, ping or email Emma (:emceeaich) so that she can get someone to look into the issue. place the crash tag also. | | Crash || If there is no activity by Mozilla, ping or email Emma (:emceeaich) so that she can get someone to look into the issue. place the crash tag also. | ||
| Line 69: | Line 69: | ||
|- | |- | ||
| Enhancement & Feature Requests || Enhancements and Feature Request should have an appropriate Component assigned. The developers and PM in that component will decide if it will be implemented or marked as Resolved-Won't Fix | | Enhancement & Feature Requests || Enhancements and Feature Request should have an appropriate Component assigned. The developers and PM in that component will decide if it will be implemented or marked as Resolved-Won't Fix | ||
NOTE: If you are sure that a Feature Request or an Enhancement is a valid one, you could also set his status to NEW, but usually this is the component's owner job. | '''NOTE''': If you are sure that a Feature Request or an Enhancement is a valid one, you could also set his status to NEW, but usually this is the component's owner job. | ||
|- | |- | ||
| Context || Bugs that contain sensitive information or that may be harmful to the testers should be marked Context. These items can be reviewed with Ryan or Emma | | Context || Bugs that contain sensitive information or that may be harmful to the testers should be marked Context. These items can be reviewed with Ryan or Emma | ||
| Line 170: | Line 170: | ||
If something has been missed you can find all the mentioned information also at this link -> http://mozilla.github.io/mozregression/quickstart.html. | If something has been missed you can find all the mentioned information also at this link -> http://mozilla.github.io/mozregression/quickstart.html. | ||
'''NOTE''': Mozregression tool is not perfect and will throw some errors on some old builds. If it is your case, please refer to my other lesson from above this where you have information on how to manually create the "Pushlog link" for the found builds. | |||
If you encounter some errors involving Python while trying to use mozregression on Mac OS, please look at the next lesson to resolve this issue. | If you encounter some errors involving Python while trying to use mozregression on Mac OS, please look at the next lesson to resolve this issue. | ||
| Line 195: | Line 195: | ||
If I missed something you can find all the mentioned informations also at this link -> http://mozilla.github.io/mozregression/quickstart.html. | If I missed something you can find all the mentioned informations also at this link -> http://mozilla.github.io/mozregression/quickstart.html. | ||
'''NOTE''': Mozregression tool is not perfect and will throw some errors on some old builds. If it is your case, please refer to my other lesson from above this where you have informations on how to manually create the "Pushlog link" for the found builds. | |||
|- | |- | ||
| Using Mozzregression Tool on Linux || On Linux platform you can either use the Mozregression gui from github releases page, or you can use the tool trough command line as on Mac OS. In the next steps I will present the command line way on Linux. | | Using Mozzregression Tool on Linux || On Linux platform you can either use the Mozregression gui from github releases page, or you can use the tool trough command line as on Mac OS. In the next steps I will present the command line way on Linux. | ||
| Line 207: | Line 207: | ||
If I missed something you can find all the mentioned informations also at this link -> http://mozilla.github.io/mozregression/quickstart.html. | If I missed something you can find all the mentioned informations also at this link -> http://mozilla.github.io/mozregression/quickstart.html. | ||
'''NOTE''': Mozregression tool is not perfect and will throw some errors on some old builds. If it is your case, please refer to my other lesson from above this where you have informations on how to manually create the "Pushlog link" for the found builds. | |||
|- | |- | ||
| Using Mozzregression Tool with "--find-fix" attribute || If you are dealing with an issue that still reproduces on latest Firefox release build but no longer on Beta, Aurora or Nightly you can use the "--find-fix" attribute while performing regression range in mozregression. This will help you to provide information to the reporter regarding his issue. In most of the cases his issue will end up as "duplicate" or "works for me" since the problem was treated in a different bug. | | Using Mozzregression Tool with "--find-fix" attribute || If you are dealing with an issue that still reproduces on latest Firefox release build but no longer on Beta, Aurora or Nightly you can use the "--find-fix" attribute while performing regression range in mozregression. This will help you to provide information to the reporter regarding his issue. In most of the cases his issue will end up as "duplicate" or "works for me" since the problem was treated in a different bug. | ||
| Line 225: | Line 225: | ||
2. Open a Command Prompt window and observe the path displayed. It should be something like "C:\Users\profile_name>"<br /> | 2. Open a Command Prompt window and observe the path displayed. It should be something like "C:\Users\profile_name>"<br /> | ||
3. Start Firefox with the profiler and create a test profile if you don't have one (you will need a specific name in order to find it faster).<br /> | 3. Start Firefox with the profiler and create a test profile if you don't have one (you will need a specific name in order to find it faster).<br /> | ||
4. Open "My Computer" and navigate to your OS partition in Users\<your_profile_name>\AppData\Roaming\Mozilla\Firefox\Profiles\<created_profile_name>\ folder. Remember that "AppData" folder is only displayed when "Show hidden files" option is checked.<br /> | 4. Open "My Computer" and navigate to your OS partition in Users\<your_profile_name>\AppData\Roaming\Mozilla\Firefox\Profiles\<created_profile_name>\ folder. '''Remember''' that "AppData" folder is only displayed when "Show hidden files" option is checked.<br /> | ||
5. Click the window address bar in order to view the complete path and copy it from the end to start, leaving behind only the already existing path from command prompt.<br /> | 5. Click the window address bar in order to view the complete path and copy it from the end to start, leaving behind only the already existing path from command prompt.<br /> | ||
6. With the good and bad build dates, write a command like "mozregression --good year-month-day --bad year-month-day --profile \AppData\Roaming\Mozilla\Firefox\Profiles\<created_profile_name>\" (eg: C:\Users\paul.oiegas>mozregression --bad 2015-06-06 --good 2016-02-23 --profile \AppData\Roaming\Mozilla\Firefox\Profiles\w9gzt0rd.testrelease2). <br /> | 6. With the good and bad build dates, write a command like "mozregression --good year-month-day --bad year-month-day --profile \AppData\Roaming\Mozilla\Firefox\Profiles\<created_profile_name>\" (eg: C:\Users\paul.oiegas>mozregression --bad 2015-06-06 --good 2016-02-23 --profile \AppData\Roaming\Mozilla\Firefox\Profiles\w9gzt0rd.testrelease2). <br /> | ||
| Line 264: | Line 264: | ||
For the command window mode, the only thing that is different from the PC testing is the "--app=fennec" command that you need to introduce before good & bad dates. The command will look like "mozregression --app=fennec --good 2015-05-06 --bad 2015-07-09".<br /> | For the command window mode, the only thing that is different from the PC testing is the "--app=fennec" command that you need to introduce before good & bad dates. The command will look like "mozregression --app=fennec --good 2015-05-06 --bad 2015-07-09".<br /> | ||
Notes and Tips & Tricks: | '''Notes and Tips & Tricks''':<br> | ||
- There are cases when the build is installed and opened instantly but there are times when the build takes a few minutes to load. Just have patience young Jedi. | - There are cases when the build is installed and opened instantly but there are times when the build takes a few minutes to load. Just have patience young Jedi.<br> | ||
- If you need to test on older Android versions like 2.3x, you need to use the command as "app=fennec-2.3" This will only work for as high as Firefox 48.0. The support for Android 2.3x will be dropped after v48.0. | - If you need to test on older Android versions like 2.3x, you need to use the command as "app=fennec-2.3" This will only work for as high as Firefox 48.0. The support for Android 2.3x will be dropped after v48.0.<br> | ||
- Multiple profiles are not available on mobile platform. You will need to clear the saved data from Settings>Applications>Nightly application in order to simulate a new profile. | - Multiple profiles are not available on mobile platform. You will need to clear the saved data from Settings>Applications>Nightly application in order to simulate a new profile.<br> | ||
|- | |- | ||
| Line 307: | Line 307: | ||
1. First you will need to navigate to https://developer.apple.com/downloads/ and if you don't have an apple ID, you should create one.<br /> | 1. First you will need to navigate to https://developer.apple.com/downloads/ and if you don't have an apple ID, you should create one.<br /> | ||
2. After you manage to Sign In, a list with available downloads for Apple Developers is displayed. You need to chose the most recent "Hardware IO Tools for Xcode" package (you don't need Xcode installed to use this tools). Expand the package from "+" sign on the left and click the link from right side with ".dmg" format.<br /> | 2. After you manage to Sign In, a list with available downloads for Apple Developers is displayed. You need to chose the most recent "Hardware IO Tools for Xcode" package (you don't need Xcode installed to use this tools). Expand the package from "+" sign on the left and click the link from right side with ".dmg" format.<br /> | ||
3. After the package is downloaded, mount it from downloads. A folder will be opened after containing the tools from the package. You will need to double click the "Network Link Conditioner.prefPane" file and choose to install it when prompted. The tool will be installed and added to "System Preferences" panel and you can always start it from there, each time when you need it. | 3. After the package is downloaded, mount it from downloads. A folder will be opened after containing the tools from the package. You will need to double click the "Network Link Conditioner.prefPane" file and choose to install it when prompted. The tool will be installed and added to "System Preferences" panel and you can always start it from there, each time when you need it.<br> | ||
4. The Tool comes with a couple of predefined profiles, but I suggest you to create a new one. You can do this by tapping the "manage Profiles" button. If grayed out, you need to unlock the edit possibility by clicking the "Lock" icon from bottom left and enter the user and password.<br /> | 4. The Tool comes with a couple of predefined profiles, but I suggest you to create a new one. You can do this by tapping the "manage Profiles" button. If grayed out, you need to unlock the edit possibility by clicking the "Lock" icon from bottom left and enter the user and password.<br /> | ||
5. A new window will pop up where you can click the "+" button from bottom left to add a new profile (any name you desire). <br /> | 5. A new window will pop up where you can click the "+" button from bottom left to add a new profile (any name you desire). <br /> | ||
| Line 313: | Line 313: | ||
7. After the values are introduced, press the "OK" button to close the profiles management window and switch the tool to "ON" in order to initialize the bandwidth limitation.<br /> | 7. After the values are introduced, press the "OK" button to close the profiles management window and switch the tool to "ON" in order to initialize the bandwidth limitation.<br /> | ||
Please REMEMBER that in order to return to the normal interned bandwidth speed, you will always need to switch the Tool to "OFF" after testing, otherwise the limitation will remain always ON. | Please '''REMEMBER''' that in order to return to the normal interned bandwidth speed, you will always need to switch the Tool to "OFF" after testing, otherwise the limitation will remain always ON. | ||
|- | |- | ||
| How to simulate bad internet connection on Windows || If you encounter and issue where the reporter specifies that he has a slow / bad internet connection, or you think the issue appears only when internet connection is not good enough, you can simulate this kind of environment by using a bandwidth limiter tool. | | How to simulate bad internet connection on Windows || If you encounter and issue where the reporter specifies that he has a slow / bad internet connection, or you think the issue appears only when internet connection is not good enough, you can simulate this kind of environment by using a bandwidth limiter tool. | ||
| Line 324: | Line 324: | ||
5. Confirm the settings and you are all done. In order to properly limit the process you desire, be sure you choose the one that consumes bandwidth while navigating trough websites / listening to videos in the browser.<br /> | 5. Confirm the settings and you are all done. In order to properly limit the process you desire, be sure you choose the one that consumes bandwidth while navigating trough websites / listening to videos in the browser.<br /> | ||
Please REMEMBER that in order to return to the normal interned bandwidth speed, you will always need to reset all the limitations from the "refresh" like button from the software toolbar after testing, otherwise the limitation will remain always ON. | Please '''REMEMBER''' that in order to return to the normal interned bandwidth speed, you will always need to reset all the limitations from the "refresh" like button from the software toolbar after testing, otherwise the limitation will remain always ON. | ||
|} | |} | ||