MozillaWiki

QA/Reading list: Difference between revisions

Page Discussion

QA/Reading list (view source)

Revision as of 07:12, 30 April 2015

10,479 bytes added ,  30 April 2015
m
→‎Bug fix verification: added results
(→‎Results: update related to feature status on aurora 38)
m (→‎Bug fix verification: added results)
 
(23 intermediate revisions by the same user not shown)
Line 1: Line 1:
= Desktop Reading List =
= Desktop Reading List =
== Ownership ==
== Ownership ==
Developer contacts: Justin Dolske, Blair McBride, Drew Willcoxon
Developer contacts: Blair McBride, Justin Dolske, Drew Willcoxon


QA Lead: [mailto:andrei.vaida@softvision.ro Andrei Vaida], :avaida on IRC
QA Lead: [mailto:andrei.vaida@softvision.ro Andrei Vaida], :avaida on IRC
Line 9: Line 9:
<small>'''<font color="green">[LANDED]</font>'''</small> Nightly 38: first landed, disabled by default
<small>'''<font color="green">[LANDED]</font>'''</small> Nightly 38: first landed, disabled by default


<small>'''<font color="green">[LANDED]</font>'''</small> Aurora 38: landed, disabled by default
<small>'''<font color="green">[LANDED]</font>'''</small> Aurora 38: landed, currently enabled by default


{{ok|}} Beta 38: tbd
<small>'''<font color="green">[LANDED]</font>'''</small> Beta 38: landed, disabled by default


{{ok|}} Release 38: tbd
{{ok|}} Release 38: tbd
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto">
<big>'''Timeline'''</big>
<div class="mw-collapsible-content">
* '''<small>UPDATE 2015-03-22</small>''': the pref is <code>true</code> by default on 39.0a1.
* '''<small>UPDATE 2015-03-26</small>''': the pref is <code>true</code> by default on 38.0a2.
* '''<small>UPDATE 2015-03-30</small>''': the pref is <code>true</code> by default on 38.0b1.
</div></div>


===Risk analysis===
===Risk analysis===
Line 20: Line 28:
! Event !! Probability !! Impact !! Current situation !! Mitigation steps
! Event !! Probability !! Impact !! Current situation !! Mitigation steps
|-
|-
| Adding a website to Reading List fails to work. || tbd || high || tbd || Periodical regression testing covers this area.
| Adding a website to Reading List fails to work. || probable || high || There were isolated cases where the add action failed. || Periodical regression testing covers this area.
|-
|-
| Opening a website from the Reading List fails to work. || tbd || high || tbd || Periodical regression testing covers this area.
| Opening a website from the Reading List fails to work. || improbable || high || There were no failures reported for this case. || Periodical regression testing covers this area.
|-
|-
| Removing a website from Reading List fails to work. || tbd || medium || tbd || Periodical regression testing covers this area.
| Removing a website from Reading List fails to work. || probable || medium || There were isolated cases where the remove action failed. || Periodical regression testing covers this area.
|-
|-
| The Reading List sidebar toggle button fails to work. || improbable || high || tbd || Periodical regression testing covers this area.
| The Reading List sidebar toggle button fails to work. || improbable || high || There were no failures reported for this case. || Periodical regression testing covers this area.
|-
|-
| Local reading lists are not saved properly and some/all added items are missing. || tbd || high || tbd || Periodical regression testing covers this area.
| Local reading lists are not saved properly and some/all added items are missing. || improbable || high || There were no failures reported for this case. || Periodical regression testing covers this area.
|-
|-
| Reading List items are not synced up with the Firefox Account. || tbd || medium || tbd || Periodical regression testing covers this area.
| Reading List items are not synced up with the Firefox Account. || probable || medium || There were isolated cases where the sync-up action failed. || Periodical regression testing covers this area.
|-
|-
| Reading List items are not synced down from the Firefox Account. ||  tbd || high || tbd || Periodical regression testing covers this area.
| Reading List items are not synced down from the Firefox Account. ||  probable || high || There were isolated cases where the sync-down action failed. || Periodical regression testing covers this area.
|}
|}


Line 51: Line 59:
Reading List is available starting with Firefox 38 and it can be enabled by setting the following pref to true:
Reading List is available starting with Firefox 38 and it can be enabled by setting the following pref to true:
:<code>browser.readinglist.enabled</code>
:<code>browser.readinglist.enabled</code>
{| class="wikitable"
|-
| '''<small>UPDATE 2015-03-22</small>''': the pref is <code>true</code> by default on 39.0a1.
|-
| '''<small>UPDATE 2015-03-26</small>''': the pref is <code>true</code> by default on 38.0a2.
|-
|}


== References ==
== References ==
Line 65: Line 65:
== Test cases ==
== Test cases ==
===Overview===
===Overview===
* {{done|}} Draft test suite
* Draft test suites
** [https://docs.google.com/spreadsheets/d/1PVhqSPcLNvIEY5SooAO81FAxN4j8MFo3Qb4WkZcONfQ/edit Google Spreadsheet].
** {{done|}} [https://docs.google.com/spreadsheets/d/1PVhqSPcLNvIEY5SooAO81FAxN4j8MFo3Qb4WkZcONfQ/edit Smoke and Regression Test Suites].
* {{done|}} MozTrap test suites
** {{done|}} [https://docs.google.com/spreadsheets/d/1nL4bF2XeKPsTgxhQgoYvOgu1CLWtBPjLZiligd8GJ-M/edit#gid=1837691267 Cross-platform compatibility Test Suite]
** [https://moztrap.mozilla.org/manage/cases/?filter-suite=881 Smoke Test Suite]
* MozTrap test suites
** [https://moztrap.mozilla.org/manage/cases/?filter-suite=882 Regression Test Suite]
** {{done|}} [https://moztrap.mozilla.org/manage/cases/?filter-suite=881 Smoke Test Suite]
** {{done|}} [https://moztrap.mozilla.org/manage/cases/?filter-suite=882 Regression Test Suite]
** {{done|}} [https://moztrap.mozilla.org/manage/cases/?filter-suite=887 Cross-platform compatibility Test Suite]


===Targeted scenarios===
===Targeted scenarios===
Line 130: Line 132:
<big>'''Testing Reading List with e10s'''</big>
<big>'''Testing Reading List with e10s'''</big>
<div class="mw-collapsible-content">
<div class="mw-collapsible-content">
* Reading List should work just as well with e10S enabled (default on in 39.0a1)
All regular test cases already available in test suites will be executed with e10s enabled.
** '''Is this really still true?''' --> Reading List is currently NOT compatible with e10s. It seems to work fine in e10s.
</div></div>
</div></div>


Line 169: Line 170:
<font color="green">'''[QE-VERIFY+]'''</font> [https://bugzilla.mozilla.org/show_bug.cgi?id=1148201 Bug 1148201] - Fix desktop reading list client's use of Last-Modified, If-Unmodified-Since, If-Modified-Since headers<br/>
<font color="green">'''[QE-VERIFY+]'''</font> [https://bugzilla.mozilla.org/show_bug.cgi?id=1148201 Bug 1148201] - Fix desktop reading list client's use of Last-Modified, If-Unmodified-Since, If-Modified-Since headers<br/>
<font color="green">'''[QE-VERIFY+]'''</font> [https://bugzilla.mozilla.org/show_bug.cgi?id=1148240 Bug 1148240] - Reading list item is difficult to delete if the vertical scroll bar is visible<br/>
<font color="green">'''[QE-VERIFY+]'''</font> [https://bugzilla.mozilla.org/show_bug.cgi?id=1148240 Bug 1148240] - Reading list item is difficult to delete if the vertical scroll bar is visible<br/>
<font color="green">'''[QE-VERIFY+]'''</font> [https://bugzilla.mozilla.org/show_bug.cgi?id=1149869 Bug 1149869] - Repeatedly adding and removing an item from reader mode causes duplicate items to appear in the sidebar<br/>
<font color="green">'''[QE-VERIFY+]'''</font> [https://bugzilla.mozilla.org/show_bug.cgi?id=1148762 Bug 1148762] - Reading List not full but scrollable for 1px, causes scroll bar to flash when opening reading list sidebar<br/>
<font color="green">'''[QE-VERIFY+]'''</font> [https://bugzilla.mozilla.org/show_bug.cgi?id=1149823 Bug 1149823] - Keep reading list sidebar sorted when new items are added via sync<br/>
<font color="green">'''[QE-VERIFY+]'''</font> [https://bugzilla.mozilla.org/show_bug.cgi?id=1149023 Bug 1149023] - unable to remove reading list item<br/>
<font color="green">'''[QE-VERIFY+]'''</font> [https://bugzilla.mozilla.org/show_bug.cgi?id=1147409 Bug 1147409] - right click on sites in readlist cannot remove it<br/>
<font color="gray">'''[QE-VERIFY-]'''</font> [https://bugzilla.mozilla.org/show_bug.cgi?id=1153121 Bug 1153121] - Write local items to the sync log if any logs have "Trace" level<br/>
<font color="gray">'''[QE-VERIFY-]'''</font> [https://bugzilla.mozilla.org/show_bug.cgi?id=1153371 Bug 1153371] - Create shared place for readability content CSS styles<br/>
<font color="green">'''[QE-VERIFY+]'''</font> [https://bugzilla.mozilla.org/show_bug.cgi?id=1151823 Bug 1151823] - Reading list item is missing hover effect in "Sidebars" dropdown panel<br/>
<font color="green">'''[QE-VERIFY+]'''</font> [https://bugzilla.mozilla.org/show_bug.cgi?id=1152412 Bug 1152412] - Reading list items that are images get stuck in "loading" state<br/>
<font color="gray">'''[QE-VERIFY-]'''</font> [https://bugzilla.mozilla.org/show_bug.cgi?id=1148701 Bug 1148701] - React to Backoff and Retry-After headers from Reading List storage servers<br/>
</div>
</div>
</div>
</div>
Line 247: Line 258:
<font color="green">'''[VERI]'''</font> [https://bugzilla.mozilla.org/show_bug.cgi?id=1146358 Bug 1146358] - The attempt of adding a page to Reading List from Reader View fails and causes an error
<font color="green">'''[VERI]'''</font> [https://bugzilla.mozilla.org/show_bug.cgi?id=1146358 Bug 1146358] - The attempt of adding a page to Reading List from Reader View fails and causes an error
:↳ <small>'''2015-03-30'''</small>: verified fixed on 39.0a1 and 38.0a2, across platforms
:↳ <small>'''2015-03-30'''</small>: verified fixed on 39.0a1 and 38.0a2, across platforms
<font color="green">'''[VERI]'''</font> [https://bugzilla.mozilla.org/show_bug.cgi?id=1147440 Bug 1147440] - Improve the transition of the Add to Reading List URL Button
:↳ <small>'''2015-04-02'''</small>: verified fixed on 40.0a1, across platforms
:↳ <small>'''2015-04-07'''</small>: verified fixed on 38.0b2-build1 (20150406174117), across platforms
<font color="green">'''[VERI]'''</font> [https://bugzilla.mozilla.org/show_bug.cgi?id=1147444 Bug 1147444] - Improve the transition when deleting an item from the Reading List
:↳ <small>'''2015-04-02'''</small>: verified fixed on 40.0a1, across platforms
:↳ <small>'''2015-04-07'''</small>: verified fixed on 38.0b2-build1 (20150406174117), across platforms
<font color="green">'''[VERI]'''</font> [https://bugzilla.mozilla.org/show_bug.cgi?id=1147479 Bug 1147479] - Improve the transition when adding an item from the Reading List
:↳ <small>'''2015-04-02'''</small>: verified fixed on 40.0a1, across platforms
:↳ <small>'''2015-04-07'''</small>: verified fixed on 38.0b2-build1 (20150406174117), across platforms
<font color="green">'''[VERI]'''</font> [https://bugzilla.mozilla.org/show_bug.cgi?id=1147889 Bug 1147889] - need transition when switching between light-dark-sepia
:↳ <small>'''2015-04-02'''</small>: verified fixed on 40.0a1 and 39.0a2, across platforms
:↳ <small>'''2015-04-07'''</small>: verified fixed on 38.0b2-build1 (20150406174117), across platforms
<font color="green">'''[VERI]'''</font> [https://bugzilla.mozilla.org/show_bug.cgi?id=1134446 Bug 1134446] - Automatically open the ReadingList sidebar the first time ReaderMode is used
:↳ <small>'''2015-04-02'''</small>: verified fixed on 40.0a1 and 39.0a2, across platforms
<font color="green">'''[VERI]'''</font> [https://bugzilla.mozilla.org/show_bug.cgi?id=1149869 Bug 1149869] - Repeatedly adding and removing an item from reader mode causes duplicate items to appear in the sidebar
:↳ <small>'''2015-04-02'''</small>: verified fixed on 40.0a1, across platforms
:↳ <small>'''2015-04-10'''</small>: verified fixed on 38.0b3-build1 (20150409144858), across platforms
<font color="green">'''[VERI]'''</font> [https://bugzilla.mozilla.org/show_bug.cgi?id=1137089 Bug 1137089] - The sidebar header is white on the developer edition theme
:↳ <small>'''2015-04-02'''</small>: verified fixed on 40.0a1 and 39.0a2, across platforms
<font color="green">'''[VERI]'''</font> [https://bugzilla.mozilla.org/show_bug.cgi?id=1149023 Bug 1149023] - unable to remove reading list item
:↳ <small>'''2015-04-02'''</small>: verified fixed on 40.0a1 and 39.0a2, across platforms
:↳ <small>'''2015-04-07'''</small>: verified fixed on 38.0b2-build1 (20150406174117), across platforms
<font color="green">'''[VERI]'''</font> [https://bugzilla.mozilla.org/show_bug.cgi?id=1148462 Bug 1148462] - When "Reading List" is disabled (browser.readinglist.enabled = false) CTRL+ALT+R should not open its sidebar.
:↳ <small>'''2015-04-06'''</small>: verified fixed on 40.0a1, across platforms
:↳ <small>'''2015-04-07'''</small>: verified fixed on 38.0b2-build1 (20150406174117), across platforms
<font color="green">'''[VERI]'''</font> [https://bugzilla.mozilla.org/show_bug.cgi?id=1144774 Bug 1144774] - Add to reading list button is blurry
:↳ <small>'''2015-04-10'''</small>: verified fixed on 38.0b3-build1 (20150409144858), across platforms
<font color="green">'''[VERI]'''</font> [https://bugzilla.mozilla.org/show_bug.cgi?id=1148201 Bug 1148201] - Fix desktop reading list client's use of Last-Modified, If-Unmodified-Since, If-Modified-Since headers
:↳ <small>'''2015-04-14'''</small>: verified fixed on the 38 and 39 branches, across platforms
<font color="green">'''[VERI]'''</font> [https://bugzilla.mozilla.org/show_bug.cgi?id=1148273 Bug 1148273] - Readinglist scheduler doesn't handle FxA error states correctly.
:↳ <small>'''2015-04-14'''</small>: verified fixed on the 38 and 39 branches, across platforms
<font color="green">'''[VERI]'''</font> [https://bugzilla.mozilla.org/show_bug.cgi?id=1149136 Bug 1149136] - Incorrect hover styling displayed for the article remove button available in the Reading List sidebar
:↳ <small>'''2015-04-16'''</small>: verified fixed on 38.0b4-build1, across platforms
<font color="green">'''[VERI]'''</font> [https://bugzilla.mozilla.org/show_bug.cgi?id=1149302 Bug 1149302] - Error when adding an item to reading list
:↳ <small>'''2015-04-16'''</small>: verified fixed on 38.0b4-build1, across platforms
<font color="green">'''[VERI]'''</font> [https://bugzilla.mozilla.org/show_bug.cgi?id=1152412 Bug 1152412] - Reading list items that are images get stuck in "loading" state
:↳ <small>'''2015-04-16'''</small>: verified fixed on 40.0a1, across platforms
<font color="green">'''[VERI]'''</font> [https://bugzilla.mozilla.org/show_bug.cgi?id=1148762 Bug 1148762] - Reading List not full but scrollable for 1px, causes scroll bar to flash when opening reading list sidebar
:↳ <small>'''2015-04-29'''</small>: verified fixed on 40.0a1, across platforms
</div>
</div>
</div>
</div>
Line 282: Line 332:
[https://bugzilla.mozilla.org/show_bug.cgi?id=1145609 Bug 1145609] - The Reading List item removal button should have the same tooltip as the one from the Location Bar
[https://bugzilla.mozilla.org/show_bug.cgi?id=1145609 Bug 1145609] - The Reading List item removal button should have the same tooltip as the one from the Location Bar
:↳ <small>'''2015-03-20'''</small>: found while verifying the fix pushed for [https://bugzilla.mozilla.org/show_bug.cgi?id=1123525 Bug 1123525]  
:↳ <small>'''2015-03-20'''</small>: found while verifying the fix pushed for [https://bugzilla.mozilla.org/show_bug.cgi?id=1123525 Bug 1123525]  
[https://bugzilla.mozilla.org/show_bug.cgi?id=1149136 Bug 1149136] - Incorrect hover styling displayed for the article remove button available in the Reading List sidebar
:↳ <small>'''2015-03-30'''</small>: found while signing off the feature for the merge to beta
[https://bugzilla.mozilla.org/show_bug.cgi?id=1149144 Bug 1149144] - Crash-report page thumbnail displays a never-ending loading circle in Reading List sidebar
:↳ <small>'''2015-03-30'''</small>: found while signing off the feature for the merge to beta
[https://bugzilla.mozilla.org/show_bug.cgi?id=1149902 Bug 1149902] - The Reading List's sidebar is sometimes enabled automatically in newly opened private windows
:↳ <small>'''2015-04-01'''</small>: found while verifying build1 of 38.0b1-build1
[https://bugzilla.mozilla.org/show_bug.cgi?id=1150369 Bug 1150369] - Intermittently, syncing Reading List items fails with an error thrown by Sync.jsm:431
:↳ <small>'''2015-04-02'''</small>: found while verifying build1 of 38.0b1-build1
:↳ <small>'''2015-04-02'''</small>: marked as <font color="gray">'''<small>DUPE</small>'''</font> of [https://bugzilla.mozilla.org/show_bug.cgi?id=1149105 Bug 1149105] by Mark Hammond
[https://bugzilla.mozilla.org/show_bug.cgi?id=1150388 Bug 1150388] - Some items from Reading List are doubled after the automated syncing with Firefox Account
:↳ <small>'''2015-04-02'''</small>: found while verifying build1 of 38.0b1-build1
[https://bugzilla.mozilla.org/show_bug.cgi?id=1151845 Bug 1151845] - Thumbnail and name for a previous played youtube video are added in Reading list
:↳ <small>'''2015-04-07'''</small>: found during the verification of 38.0b2-build1, by Petruta Rasa
[https://bugzilla.mozilla.org/show_bug.cgi?id=1151871 Bug 1151871] - Links with the same domain can not be added to Reading List
:↳ <small>'''2015-04-07'''</small>: found during the verification of 38.0b2-build1, by Petruta Rasa
[https://bugzilla.mozilla.org/show_bug.cgi?id=1151823 Bug 1151823] - Reading list item is missing hover effect in "Sidebars" dropdown panel
:↳ <small>'''2015-04-07'''</small>: found during the verification of 38.0b2-build1, by Catalin Varga
[https://bugzilla.mozilla.org/show_bug.cgi?id=1152192 Bug 1152192] - Repeatedly adding and removing an item from Reader View causes duplicates in Reading List's sidebar
:↳ <small>'''2015-04-08'''</small>: filed as a follow-up issue for [https://bugzilla.mozilla.org/show_bug.cgi?id=1149869 Bug 1149869]
[https://bugzilla.mozilla.org/show_bug.cgi?id=1152307 Bug 1152307] - Reading list is not synced
:↳ <small>'''2015-04-08'''</small>: found by Mihaela Velimiroviciu while testing Reading List with e10s enabled on 40.0a1
</div>
</div>
</div>
</div>
Andrei.vaida
Confirmed users
1,595

edits

Retrieved from "https://wiki.mozilla.org/Special:MobileDiff/1065145...1071279"