QA/Fenix/2/3.0/RC1: Difference between revisions

From MozillaWiki
< QA
Jump to navigation Jump to search
No edit summary
No edit summary
 
(13 intermediate revisions by 4 users not shown)
Line 1: Line 1:
<small>« [[QA/Fenix/2/2.0/RC2 | Fenix RC 2.2.0-rc2]] | [[QA/Fenix/2/3.0/RC1 | Fenix RC 2.3.0-rc1]] | [[QA/Fenix/2/4.0/RC1 | Fenix RC 2.4.0-rc1]] »</small>
<small>« [[QA/Fenix/2/2.0/RC2 | Fenix RC 2.2.0-rc2]] | [[QA/Fenix/2/3.0/RC1 | Fenix RC 2.3.0-rc1]] | [[QA/Fenix/2/3.0/RC2 | Fenix RC 2.3.0-rc2]] »</small>


= Firefox Preview 2.3.0-rc1 Test Plan =
= Firefox Preview 2.3.0-rc1 Test Plan =
* Release date: October 17th, 2019
* Release date: October 29th, 2019
* QA Contact: [mailto:ohorvath@mozilla.com Oana Horvath]; [mailto:fennec@softvision.ro SV QA team]
* QA Contact: [mailto:ohorvath@mozilla.com Oana Horvath]; [mailto:fennec@softvision.ro SV QA team]
* Slack: [https://mozilla.slack.com/messages/D58NA0CB0 Oana];  
* Slack: [https://mozilla.slack.com/messages/D58NA0CB0 Oana];  
* Build: [https://tools.taskcluster.net/index/project.mobile.fenix.v2.production/latest Firefox Preview RC 2.2.0-rc2]
* Build: [https://github.com/mozilla-mobile/fenix/releases/tag/v2.3.0-rc.1 Firefox Preview RC 2.3.0-rc1]
* TestRail test plan: [https://testrail.stage.mozaws.net/index.php?/plans/view/21538 Testrail]  
* TestRail test plan: [https://testrail.stage.mozaws.net/index.php?/plans/view/21851 Testrail]  


== Features ==  
== Features ==  
Line 30: Line 30:
  |-  
  |-  
  | Oana Horvath
  | Oana Horvath
  | ARM
  | x86
  |  
  | Xiaomi Mi Pad 2 (Android 5.1)
  | October 29th, 2019
  | October 29th, 2019
  | '''In Progress'''
  | '''Done'''
  |-  
  |-  
  | Andrei Joltan
  | Andrei Joltan
  | ARM
  | ARM
  |  
  | Samsung Galaxy Tab A (Android 9)
  | October 29th, 2019
  | October 29th, 2019
  | '''In Progress'''
  | '''Done'''
  |-  
  |-  
  | Andrei Bodea
  | Andrei Bodea
  | ARM
  | ARM
  |  
  | Samsung Galaxy S10+(Android 9)
  | October 29th, 2019
  | October 29th, 2019
  | '''In Progress'''
  | '''Done'''
|-
| Laurentiu Apahidean
| ARM
| Samsung Galaxy S8+ (Android 8.0.0)
| October 29th, 2019
| '''Done'''
  |-  
  |-  
  |}  
  |}  
Line 52: Line 58:
== Results ==
== Results ==
=== Phones ===
=== Phones ===
*  
* https://testrail.stage.mozaws.net/index.php?/runs/view/21854
*  
* https://testrail.stage.mozaws.net/index.php?/runs/view/21856
=== Tablets ===
=== Tablets ===
*  
* https://testrail.stage.mozaws.net/index.php?/runs/view/21853
 
* https://testrail.stage.mozaws.net/index.php?/runs/view/21852
=== Bug verification ===
=== Bug verification ===
{| class="wikitable" width=100%
{| class="wikitable" width=100%
  |-  
  |-  
  |  
  | Oana Horvath
  | October 29th, 2019
  | October 29th, 2019
  | '''In Progress'''
  | '''Done'''
  |-  
  |-  
|
| October 29th, 2019
| '''In Progress'''
|}  
|}  
</onlyinclude>
</onlyinclude>
List of fixes in this build:  
List of fixes in this build:  
*  
* [https://github.com/mozilla-mobile/fenix/issues/5323 No user feedback in delete and quit when data is deleting] - VERIFIED
*  
 
=== L10N ===
Light testing on featured locales to ensure strings fit the space allotted and there are no entity errors from missing or corrupt localizations.
* https://testrail.stage.mozaws.net/index.php?/runs/view/21855&group_by=cases:section_id&group_order=asc
 
{| class="wikitable" width=100%
|-
| Laurentiu Apahidean
| October 29th, 2019
| '''Done'''
|}
 
=== Telemetry ===
{| class="wikitable" width=100%
|-
| Andrei Joltan
| October 29th, 2019
| '''Done'''
|}


== Issues ==
== Issues ==


=== New issues ===
=== Major new issues ===
* [https://github.com/mozilla-mobile/fenix/issues/6318 6318] - [Bug] Saving only one tab to a collection creates an empty collection
* [https://github.com/mozilla-mobile/fenix/issues/6325 6325] - [Bug] Tracking protection not working


=== Other new issues ===
* [https://github.com/mozilla-mobile/fenix/issues/6323 6323] - [Bug] Incorrect flow for creating first collection from a tab
* [https://github.com/mozilla-mobile/fenix/issues/6324 6324] - [Bug] Search shortcuts and search engine settings are not displayed when pressing the shortcuts button
* [https://github.com/mozilla-mobile/fenix/issues/6330 6330] - [Bug] After you delete a collection the default title numbering goes back one position


=== Known issues ===
=== Known issues ===
* [https://github.com/mozilla-mobile/fenix/issues/5972 5972] - [Bug] Can't set as default browser on Android 5
* [https://github.com/mozilla-mobile/fenix/issues/3194 3194] - [Bug] Audio content continues to play after tab is closed, until undo snackbar disappears
* [https://github.com/mozilla-mobile/fenix/issues/5072 5072] - [Bug] x86 build doesn't crash (from about:crashcontent or about:crashparent)
* [https://github.com/mozilla-mobile/fenix/issues/2725 2725] - [Bug] Undo snackbar is not displayed when removing a tab from a collection
* [https://github.com/mozilla-mobile/fenix/issues/2783 2783] - Add snackbar to collection deletion
* [https://github.com/mozilla-mobile/fenix/issues/5129 5129] - [Bug]Shifted Play sign on Bing after rotation
* [https://github.com/mozilla-mobile/fenix/issues/5104 5104] - [Bug]Improperly displayed Site permissions - "No site exceptions" after rotation
* [https://github.com/mozilla-mobile/fenix/issues/3900 3900] - [Bug] After sharing a page from Fenix to Firefox Nightly the popup menu remains in the recent apps menu
* [https://github.com/mozilla-mobile/fenix/issues/4178 4178] - [Bug] Sharing multiple tabs to another browser, only opens 1 tab
* [https://github.com/mozilla-mobile/fenix/issues/4727 4727] - [Bug]Website loading issues (Netflix)
* [https://github.com/mozilla-mobile/fenix/issues/6213 6213] - [Bug]Facebook Stories playback issue
* [https://github.com/mozilla-mobile/fenix/issues/6211 6211] - [Bug]Instagram notification issue
* [https://github.com/mozilla-mobile/fenix/issues/5290 5290] - [Bug]Spotify Media Notification isn't displayed on lock screen
* [https://github.com/mozilla-mobile/fenix/issues/4587 4587] - [Bug]Inconsistent display of the "Find in page" bar in landscape mode
* [https://github.com/mozilla-mobile/fenix/issues/2312 2312] - [Bug] Opening images in new tab results in tiny images.
* [https://github.com/mozilla-mobile/fenix/issues/4793 4793] - [Bug] soundscloud: Audio plays without media notification showing
* [https://github.com/mozilla-mobile/fenix/issues/5733 5733] - [Bug] Open from private mode notification should always open the private mode homescreen
* [https://github.com/mozilla-mobile/fenix/issues/6179 6179] - [Bug] Private session icons position moved
* [https://github.com/mozilla-mobile/fenix/issues/5103 5103] - [Bug]Improperly displayed about crashcontent after rotation
* [https://github.com/mozilla-mobile/fenix/issues/3552 3552] - [Bug] Content crash reports unsubmitted in about:crashes
* [https://github.com/mozilla-mobile/fenix/issues/4484 4484] - [Bug]Flicker when deleting History items
* [https://github.com/mozilla-mobile/fenix/issues/4432 4432] - [Bug]Delete all history or individual history items snackbar missing
* [https://github.com/mozilla-mobile/fenix/issues/5128 5128] - [Bug]Improperly displayed "No history here" after rotation
* [https://github.com/mozilla-mobile/fenix/issues/4487 4487] - [Bug]Flicker while navigating through bookmark folders

Latest revision as of 15:05, 30 October 2019

«  Fenix RC 2.2.0-rc2 | Fenix RC 2.3.0-rc1 | Fenix RC 2.3.0-rc2 »

Firefox Preview 2.3.0-rc1 Test Plan

Features

Smoke Testing

QA Task Person/Group
Softvision Alternating

[Smoke Tests]

QA Assignment

Assigned Build type Device Completed Results
Oana Horvath x86 Xiaomi Mi Pad 2 (Android 5.1) October 29th, 2019 Done
Andrei Joltan ARM Samsung Galaxy Tab A (Android 9) October 29th, 2019 Done
Andrei Bodea ARM Samsung Galaxy S10+(Android 9) October 29th, 2019 Done
Laurentiu Apahidean ARM Samsung Galaxy S8+ (Android 8.0.0) October 29th, 2019 Done


Results

Phones

Tablets

Bug verification

Oana Horvath October 29th, 2019 Done

List of fixes in this build:

L10N

Light testing on featured locales to ensure strings fit the space allotted and there are no entity errors from missing or corrupt localizations.

Laurentiu Apahidean October 29th, 2019 Done

Telemetry

Andrei Joltan October 29th, 2019 Done

Issues

Major new issues

  • 6318 - [Bug] Saving only one tab to a collection creates an empty collection
  • 6325 - [Bug] Tracking protection not working

Other new issues

  • 6323 - [Bug] Incorrect flow for creating first collection from a tab
  • 6324 - [Bug] Search shortcuts and search engine settings are not displayed when pressing the shortcuts button
  • 6330 - [Bug] After you delete a collection the default title numbering goes back one position

Known issues

  • 5972 - [Bug] Can't set as default browser on Android 5
  • 3194 - [Bug] Audio content continues to play after tab is closed, until undo snackbar disappears
  • 5072 - [Bug] x86 build doesn't crash (from about:crashcontent or about:crashparent)
  • 2725 - [Bug] Undo snackbar is not displayed when removing a tab from a collection
  • 2783 - Add snackbar to collection deletion
  • 5129 - [Bug]Shifted Play sign on Bing after rotation
  • 5104 - [Bug]Improperly displayed Site permissions - "No site exceptions" after rotation
  • 3900 - [Bug] After sharing a page from Fenix to Firefox Nightly the popup menu remains in the recent apps menu
  • 4178 - [Bug] Sharing multiple tabs to another browser, only opens 1 tab
  • 4727 - [Bug]Website loading issues (Netflix)
  • 6213 - [Bug]Facebook Stories playback issue
  • 6211 - [Bug]Instagram notification issue
  • 5290 - [Bug]Spotify Media Notification isn't displayed on lock screen
  • 4587 - [Bug]Inconsistent display of the "Find in page" bar in landscape mode
  • 2312 - [Bug] Opening images in new tab results in tiny images.
  • 4793 - [Bug] soundscloud: Audio plays without media notification showing
  • 5733 - [Bug] Open from private mode notification should always open the private mode homescreen
  • 6179 - [Bug] Private session icons position moved
  • 5103 - [Bug]Improperly displayed about crashcontent after rotation
  • 3552 - [Bug] Content crash reports unsubmitted in about:crashes
  • 4484 - [Bug]Flicker when deleting History items
  • 4432 - [Bug]Delete all history or individual history items snackbar missing
  • 5128 - [Bug]Improperly displayed "No history here" after rotation
  • 4487 - [Bug]Flicker while navigating through bookmark folders
Retrieved from "https://wiki.mozilla.org/index.php?title=QA/Fenix/2/3.0/RC1&oldid=1219687"