MozillaWiki

QA/Sync Tabs Sidebar: Difference between revisions

Page Discussion

QA/Sync Tabs Sidebar (view source)

Revision as of 07:11, 3 August 2016

6,205 bytes added ,  3 August 2016
→‎Overview
 
(34 intermediate revisions by 3 users not shown)
Line 9: Line 9:
| 2/15/2016 || 1.0 || Adrian Florinescu || Created first draft
| 2/15/2016 || 1.0 || Adrian Florinescu || Created first draft
|-
|-
| || || ||  
| 2/17/2016 || 1.1 || Brindusa Tot || Complete with general details form received documentation
|}
|}


Line 25: Line 25:


== Scope ==
== Scope ==
This wiki details the testing that will be performed by the project team for the <project name> project. It defines the overall testing requirements and provides an integrated view of the project test activities. Its purpose is to document:
This wiki details the testing that will be performed by the project team for the Synced Tabs Sidebar project. It defines the overall testing requirements and provides an integrated view of the project test activities. Its purpose is to document:
* What will be tested
* What will be tested
* How testing will be performed
* How testing will be performed


== Ownership ==
== Ownership ==
Developer contacts: [mailto:ewong@mozilla.com Edwin Wong]
Technical Program Manager contact: [mailto:edwong@mozilla.com Edwin Wong]


QA:<br />
Engineering contact: [mailto:kthiessen@mozilla.com Karl Thiessen ]
 
 
'''QA''':<br />
[mailto:rares.bologa@softvisioninc.eu Rares Bologa] - PM for QA team
[mailto:rares.bologa@softvisioninc.eu Rares Bologa] - PM for QA team


Line 42: Line 45:


[mailto:liviu.cirdei@softvision.ro Liviu Cirdei], QA
[mailto:liviu.cirdei@softvision.ro Liviu Cirdei], QA
[mailto:camelia.badau@softvision.ro Camelia Badau], QA


= Testing summary =  
= Testing summary =  
Line 163: Line 168:


== Risk analysis ==
== Risk analysis ==
Identify the high-risk assumptions
Lack of the documentation - for this kind of feature we should receive a Release Notes document, summing up at least a basic description of what is to be expected from the feature in that release.
Identify existing bugs on the feature with high risk
 
Identify if other areas are affected by the fix
= References =
= References =
* Sync Tabs Sidebar mocks: [https://mozilla.invisionapp.com/share/KW48742BJ#/screens/120194644 link]  
* Sync Tabs Sidebar mocks: [https://mozilla.invisionapp.com/share/KW48742BJ#/screens/120194644 link]  
Line 193: Line 196:
|-
|-
| '''UI'''  
| '''UI'''  
| style="text-align:center;" | Yes ||
| style="text-align:center;" | ||
|-
|-
| Mouse-only operation   
| Mouse-only operation   
Line 215: Line 218:
|-
|-
| '''Help/Support'''  
| '''Help/Support'''  
| style="text-align:center;" | TBD ||
| style="text-align:center;" | ||
|-
|-
| Help/support interface required   
| Help/support interface required   
Line 226: Line 229:
| '''Install/Upgrade'''  
| '''Install/Upgrade'''  


| style="text-align:center;" | N/A ||
| style="text-align:center;" | ||
|-
|-
| Feature upgrades/downgrades data as expected   
| Feature upgrades/downgrades data as expected   
Line 245: Line 248:
|-
|-
| ''' Enterprise '''  
| ''' Enterprise '''  
|style="text-align:center;" | N/A
|style="text-align:center;" |  
||  Raise up the topic to developers to see if they are expecting to work different on ESR builds  
||  Raise up the topic to developers to see if they are expecting to work different on ESR builds  
|-
|-
Line 262: Line 265:
|-
|-
| ''' Data Monitoring '''  
| ''' Data Monitoring '''  
|style="text-align:center;" | N/A ||
|style="text-align:center;" | ||
|-
|-
| Temporary or permanent telemetry monitoring   
| Temporary or permanent telemetry monitoring   
Line 281: Line 284:
|-
|-
| ''' Add-ons '''  
| ''' Add-ons '''  
|style="text-align:center;" | N/A
|style="text-align:center;" |
| If add-ons are available for testing feature, or is current feature will affect some add-ons, then API testing should be done for the add-on.
| If add-ons are available for testing feature, or is current feature will affect some add-ons, then API testing should be done for the add-on.
|-
|-
Line 298: Line 301:
|-
|-
| ''' Security '''  
| ''' Security '''  
|style="text-align:center;" | No ||  
|style="text-align:center;" | ||  
|-
|-
| 3rd-party security review   
| 3rd-party security review   
Line 311: Line 314:
|-
|-
| ''' Web Compatibility '''  
| ''' Web Compatibility '''  
|style="text-align:center;" | No
|style="text-align:center;" |  
|-
|-
| Testing against target sites   
| Testing against target sites   
Line 321: Line 324:
|-
|-
| ''' Interoperability  '''  
| ''' Interoperability  '''  
|style="text-align:center;" | Yes ||  
|style="text-align:center;" | ||  


|-
|-
Line 335: Line 338:


== Test suite ==
== Test suite ==
  Full Test suite - Link with the gdoc, follow the format from [https://docs.google.com/spreadsheets/d/192BDmxxPirNZMxaH8a9bN4ak1m0sp3U1PXT-G-THpWk/edit?usp=sharing link]
  Full Test suite - [https://docs.google.com/spreadsheets/d/1IWFQgS0-Wf_7MSLsgwYOyIzLMWmymNBj4tsSZm1Z9d4/edit#gid=604463486 link]
  Smoke Test suite - Link with the gdoc, follow the format from [https://docs.google.com/spreadsheets/d/192BDmxxPirNZMxaH8a9bN4ak1m0sp3U1PXT-G-THpWk/edit?usp=sharing link]
  Smoke Test suite - Link with the gdoc - if available/needed.
  Regression Test suite - Link with the gdoc - if available/needed.
  Regression Test suite - Link with the gdoc - if available/needed.


= Bug Work =
= Bug Work =
Tracking bug – meta bug
Tracking bug – bug [https://bugzilla.mozilla.org/show_bug.cgi?id=1214379 1214379]


<div class="toccolours mw-collapsible mw-collapsed" style="width:auto">
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto">
Line 346: Line 349:
====== Bug fix verification ======
====== Bug fix verification ======
<div class="mw-collapsible-content">
<div class="mw-collapsible-content">
{| class="wikitable" style="width:50%"
{| class="wikitable" style="width:80%"
|-
|-
! Bug No !! Summary !! Status !! Firefox Verion
! Bug No !! Summary !! Status !! Firefox Verion
|-
|-
|  123 || bug summary || NEW || Nighly 45
|  1249574 || [Synced Tabs] Unchecked Tabs message is not displayed after Tab Syncing is disabled on another device and the Synced Tabs menu panel or sidebar is open on the first device. || Verified-Fixed || Nighly 47
|-
|-
| || || ||  
| 1250527 || [Sync Tabs Sidebar] Sidebar and panel "sync now" buttons should use the same terminology || Verified-Fixed || Nightly 47
|-
|  1241141 ||  Synced tabs panel height changes when it is accessed from History (Panel Menu) || Resolved-Fixed || Nightly 47
|-
|  1245728 ||  Sync Sidebar uses wrong twisties on Windows and Linux || Verified-Fixed || Nightly 47
|-
|  1250128 ||  [Sync Tabs Sidebar] Removing the search filter doesn't work the 1st time X is clicked || Verified-Fixed|| Nightly 47
|-
|  1249289 ||  "Synced Tabs" option is not visible under Sidebar || Resolved-Wontfix || Nightly 47
|-
|  1250532 ||    [Sync Tabs Sidebar] Enable Tabs for sync message not refreshed after Tab sync option disabled || Resolved-Duplicate (1249574)|| Nightly 47
|-
|  1250508 ||    [Sync Tabs Sidebar] Sync Tabs Sidebar extended options similar to Bookmarks menu || Resolved-Duplicate (1246156) || Nightly 47
|-
|  1250436 ||    [Synced Tabs] When you move Border line from Synced Tabs left or right it flicker  || Resolved-Wontfix || Nightly 47
|}
|}
</div></div>
</div></div>
Line 360: Line 377:
====== Logged bugs ======
====== Logged bugs ======
<div class="mw-collapsible-content">
<div class="mw-collapsible-content">
Bug 111111<br/>
Bug 1249289 - "Synced Tabs" option is not visible under Sidebar<br/>
Bug 211111<br/>
Bug 1250532 - [Sync Tabs Sidebar] Enable Tabs for sync message not refreshed after Tab sync option disabled<br/>
Bug 1250436 - [Synced Tabs] When you move Border line from Synced Tabs left or right it flicker<br />
Bug 1250128 - [Sync Tabs Sidebar] Removing the search filter doesn't work the 1st time X is clicked<br />
Bug 1250508 - [Sync Tabs Sidebar] Sync Tabs Sidebar extended options similar to Bookmarks menu<br />
Bug 1252058 - [mac] "New Folder" button in the bookmarks modal dialog hangs Firefox if Sync is enabled.<br />
Bug 1249620 - [Synced Tabs] Open this site "www.dj-fotovideo.ro" after you bookmarked, the site is open in the Synced Tabs sidebar<br />
Bug 1250445 - [New Bookmark] "New folder" button becomes unavailable after 2-3 new created folders<br />
Bug 1249619 - [Sync Tabs Sidebar] User is not encouraged to sign in again after password is changed<br />
Bug 1250085 - Navigation within an already opened tab doesn't cause a new tabs record to be uploaded<br />
Bug 1250531 - [Sync] Duplicate devices when logout/login or disconnect/connect to sync account<br />
Bug 1250866 - [Synced Tabs] Not all tabs are synced if they are opened before user signs in<br />
Bug 1252054 - [Sync Tabs Sidebar] Order of devices and tabs from sidebar is not the same as order of devices and tabs from Synced Tabs panel<br />
Bug 1253613 - [Sync Tabs] Devices/tabs are lost after uncheck "Tabs" from Sync preferences<br />
Bug 1254544 - [Sync Tabs Sidebar] Right click options are missing for Sidebar Search<br />
 
 
</div>
</div>
 
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto">
 
====== NEW/ASSIGNED bugs ======
<div class="mw-collapsible-content">
[https://bugzilla.mozilla.org/show_bug.cgi?id=1249619 Bug 1249619] - [Sync Tabs Sidebar] User is not encouraged to sign in again after password is changed<br/>
[https://bugzilla.mozilla.org/show_bug.cgi?id=1253613 Bug 1253613] - [Sync Tabs] Devices/tabs are lost after uncheck "Tabs" from Sync preference<br/>
[https://bugzilla.mozilla.org/show_bug.cgi?id=1238871 Bug 1238871] - Tabs from a disconnected device are still displayed in Synced Tabs list<br/>
[https://bugzilla.mozilla.org/show_bug.cgi?id=1268013 Bug 1268013] - [Sync Tabs Sidebar] Selected devices flicker in Synctab sidebar<br/>
[https://bugzilla.mozilla.org/show_bug.cgi?id=1275857 Bug 1275857] - [Synced Tabs Sidebar] Not all synced tabs are displayed in Synced Tabs Sidebar on a second device
</div>
</div>
</div>
</div>


<div class="toccolours mw-collapsible mw-collapsed" style="width:auto">
====== Bugs RESOLVED FIXED on Firefox 48 or Firefox 49, but not fixed on Firefox 47 ======
<div class="mw-collapsible-content">
[https://bugzilla.mozilla.org/show_bug.cgi?id=1247110 Bug 1247110] - Synced Tabs Sidebar - keyboard navigation issues<br/>
[https://bugzilla.mozilla.org/show_bug.cgi?id=1246156 Bug 1246156] - Few context menu options for Synced Tabs sidebar - wontfix for Firefox 47<br/>
[https://bugzilla.mozilla.org/show_bug.cgi?id=1250531 Bug 1250531] - [Sync] Duplicate devices when logout/login or disconnect/connect to sync account - wontfix for Firefox 47<br/>
[https://bugzilla.mozilla.org/show_bug.cgi?id=1247345 Bug 1247345] - Synced tab sidebar scrolls differently than bookmarks and history sidebar<br/>
[https://bugzilla.mozilla.org/show_bug.cgi?id=1251159 Bug 1251159] - [Sync Tabs Sidebar] search filter doesn't show the "clear filter" "X" button<br/>
[https://bugzilla.mozilla.org/show_bug.cgi?id=1252054 Bug 1252054] - [Sync Tabs Sidebar] Order of devices and tabs from sidebar is not the same as order of devices and tabs from Synced Tabs pane<br/>
[https://bugzilla.mozilla.org/show_bug.cgi?id=1254544 Bug 1254544] - [Sync Tabs Sidebar] Right click options are missing for Sidebar Search<br/>
[https://bugzilla.mozilla.org/show_bug.cgi?id=1239845 Bug 1239845] - Remove Fetching Synced Tabs row from Synced Tabs<br/>
[https://bugzilla.mozilla.org/show_bug.cgi?id=1239042 Bug 1239042] - Add minimum display time to Syncing… and spinner<br/>
[https://bugzilla.mozilla.org/show_bug.cgi?id=1270294 Bug 1270294] - OSX Synced Tabs spacing touch-ups<br/>
[https://bugzilla.mozilla.org/show_bug.cgi?id=1268036 Bug 1268036] - [Synced Tabs] The arrow that expand the device synced tabs is truncated on Ubuntu OS's<br/>
</div>
</div>


= Sign off =
= Sign off =
Line 376: Line 438:
'''Nightly testing'''<br />
'''Nightly testing'''<br />


List of OSes that will be covered by testing<br />
*Link for the tests run
*Link for the tests run
** Daily Smoke, use template from [https://docs.google.com/spreadsheets/d/1ch0OubyOWn1W-_JLF-38nvSvVB76Wmo1hkLccEtU5hk/edit?usp=sharing link]
** Daily Smoke, use template from [https://docs.google.com/spreadsheets/d/1ch0OubyOWn1W-_JLF-38nvSvVB76Wmo1hkLccEtU5hk/edit?usp=sharing link]
Line 386: Line 447:
*Link for the tests run
*Link for the tests run
** Full Test suite
** Full Test suite
'''Merge to Release Sign-off (05-26-2016)'''<br/>
List of OSes that will be covered by testing: <br />
* Windows 7 64bit
* Mac OSX 10.9.5
* Ubuntu 13.10 32bit, Ubuntu 14.04 64bit
* Full Test suite: [https://docs.google.com/spreadsheets/d/1IWFQgS0-Wf_7MSLsgwYOyIzLMWmymNBj4tsSZm1Z9d4/edit?pref=2&pli=1#gid=1506880050 link]


== Checklist ==
== Checklist ==
Line 393: Line 463:
|-
|-
|  Testing Prerequisites (specs, use cases)  
|  Testing Prerequisites (specs, use cases)  
| style="text-align:center;" | In Progress    
| style="text-align:center;" | {{mdone|}}    
| style="text-align:center;" |  
| style="text-align:center;" |  
|-
|-
|  Testing Infrastructure setup  
|  Testing Infrastructure setup  
|style="text-align:center;" | No ||  
|style="text-align:center;" | {{mdone|}} ||  
|-
|-
|  Test Plan Creation  
|  Test Plan Creation  
| style="text-align:center;" |  In progress ||  
| style="text-align:center;" |  {{mdone|}} ||  
|-
|-
|  Test Cases Creation  
|  Test Cases Creation  
|style="text-align:center;" |  In progress ||  
|style="text-align:center;" |  {{mdone|}} ||  
|-
|-
|  Full Functional Tests Execution  
|  Full Functional Tests Execution  
|style="text-align:center;" |  Not Started
|style="text-align:center;" |  {{mdone|}}
|style="text-align:center;" |   
|style="text-align:center;" |   
|-
|-
|  Automation Coverage  
|  Automation Coverage  
|style="text-align:center;" | N/A ||  
|style="text-align:center;" | TBD ||  
|-
|-
|  Performance Testing  
|  Performance Testing  
|style="text-align:center;" | ||  
|style="text-align:center;" | N/A ||  
|-
|-
|  All Defects Logged  
|  All Defects Logged  
|style="text-align:center;" | TBD ||
|style="text-align:center;" | {{mdone|}} ||  
|-
|-
|  Critical/Blockers Fixed and Verified || ||  
|  Critical/Blockers Fixed and Verified  
|style="text-align:center;" | {{mdone|}}  ||  
|-
|-
|  Daily Status Report (email/etherpad statuses/ gdoc with results) || ||  
|  Daily Status Report (email/etherpad statuses/ gdoc with results)  
|style="text-align:center;" | {{mdone|}} ||  
|-
|-
|  Metrics/Telemetry  
|  Metrics/Telemetry  
|style="text-align:center;" | No ||
|style="text-align:center;" | N/A ||
|-
|-
|  QA Signoff  - Nightly Release
|  QA Signoff  - Nightly Release
|style="text-align:center;" | TBD
|style="text-align:center;" | {{mdone|}}
|style="text-align:center;" | Email to be sent  
|style="text-align:center;" | [https://wiki.mozilla.org/images/7/71/Firefox_47_Nightly_-_Synced_Tabs_Sidebar_Conditional_Sign_Off_1.pdf Conditional SignOff email] sent on 03.08.2016
|-
|-
|  QA Aurora - Full Testing  
|  QA Aurora - Full Testing  
Line 433: Line 505:
|-
|-
|  QA Signoff  - Aurora Release
|  QA Signoff  - Aurora Release
|style="text-align:center;" | N/A
|style="text-align:center;" |  
|style="text-align:center;"| Email to be sent  
|style="text-align:center;"| Email to be sent  
|-
|-
|  QA Beta - Full Testing
|  QA Beta - Full Testing
|style="text-align:center;" | N/A ||  
|style="text-align:center;" | ||  
|-
|-
|  QA Signoff  - Beta Release  
|  QA Signoff  - Beta Release  
|style="text-align:center;" | N/A
|style="text-align:center;" |
|style="text-align:center;" | Email to be sent  
|style="text-align:center;" | Email to be sent  
|}
|}
Cynthia Tang
Confirmed users
171

edits

Retrieved from "https://wiki.mozilla.org/Special:MobileDiff/1117430...1142441"