QA/Pocket integration: Difference between revisions

no edit summary
m (→‎Ownership: small update)
No edit summary
 
(45 intermediate revisions by 3 users not shown)
Line 1: Line 1:
= Desktop — Firefox Pocket Integration =
= Desktop — Firefox Pocket Integration =
'''Note''': ''Please note that information is still being added to this page.''
== Ownership ==
== Ownership ==
Developer contacts: ---
Developer contacts: ---
Line 8: Line 7:
== Status ==
== Status ==
===Overview===
===Overview===
<small>'''<font color="gray">[ON TRACK]</font>'''</small> Nightly 40: ---<br/>
<small>'''<font color="green">[LANDED]</font>'''</small> Nightly 40: first landed, disabled by default<br/>
<small>'''<font color="gray">[ON TRACK]</font>'''</small> Aurora 39: ---<br/>
<small>'''<font color="gray">[ON TRACK]</font>'''</small> Aurora 39: ---<br/>
<small>'''<font color="gray">[ON TRACK]</font>'''</small> Beta 38: ---<br/>
<small>'''<font color="gray">[ON TRACK]</font>'''</small> Beta 38: ---<br/>
<small>'''<font color="gray">[ON TRACK]</font>'''</small> Release 38: ---
<small>'''<font color="gray">[ON TRACK]</font>'''</small> Release 38: ---
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto">
<big>'''Timeline'''</big>
<div class="mw-collapsible-content">
{|
|-
| '''What?''' || '''Expected''' || '''Actual'''
|-
| Prototype landing on m-c &nbsp;&nbsp;&nbsp; || Wed, April 29th&nbsp;&nbsp;&nbsp; || &nbsp;&nbsp;&nbsp;---
|-
| Uplift to m-b || --- || &nbsp;&nbsp;&nbsp;---
|-
| GTB: Beta 1 || Thu, May 7th || &nbsp;&nbsp;&nbsp;---
|-
| GTB: RC1 || Thu, may 21st || &nbsp;&nbsp;&nbsp;---
|}
</div></div>


===Risk analysis===
===Risk analysis===
Line 35: Line 17:
! Event !! Probability !! Impact !! Current situation !! Mitigation steps
! Event !! Probability !! Impact !! Current situation !! Mitigation steps
|-
|-
| Already installed Pocket add-on is not handled properly on the Pocket-integrated Firefox setup. || probable || high || --- || Periodical regression testing covers this area.
| Users that have the Pocket add-on already installed are not handled properly after updating to a Pocket-integrated Firefox build. || probable || high || --- || Periodical regression testing covers this area.
|-
|-
| Already installed Pocket social media service is not handled properly on the Pocket-integrated Firefox setup. || probable || high || --- || Periodical regression testing covers this area.
| Users that have the Pocket social media service already installed are not handled properly after updating to a Pocket-integrated Firefox build. || probable || high || --- || Periodical regression testing covers this area.
|-
|-
| User fails to log into Pocket using the FxA sign-in flow. || probable || high || --- || Periodical regression testing covers this area.
| User fails to log into Pocket using the FxA sign-in flow. || probable || high || --- || Periodical regression testing covers this area.
Line 44: Line 26:
|-
|-
| Saved page fails to be opened from Pocket. || probable || high || --- || Periodical regression testing covers this area.
| Saved page fails to be opened from Pocket. || probable || high || --- || Periodical regression testing covers this area.
|-
| Reader View fails to display pages saved to Pocket. || probable || high || --- || Periodical regression testing covers this area.
|-
|-
|}
|}
Line 61: Line 41:
===Enabling the feature===
===Enabling the feature===
Pocket is available starting with Firefox 40 and it can be enabled by setting the following pref to ''true'':
Pocket is available starting with Firefox 40 and it can be enabled by setting the following pref to ''true'':
:<font style="background-color:#ECECEE; border-radius:3px; font-family:monospace; font-size:115%;">browser.pocket.enabled</font>
:<font style="background-color:#ECECEE; border-radius:3px;border-style:solid; border-color:#ECECEE; border-width:3px; font-family:monospace; font-size:115%;">browser.pocket.enabled</font>


== References ==
== References ==
---
* The Pocket toolbar panel mock is available [https://bug1158883.bugzilla.mozilla.org/attachment.cgi?id=8598080 here].
* A design mock depicting a few Pocket flows is available [https://mozilla.invisionapp.com/share/4E2TPD4YD#/screens here]
* A design mock showing confirmation panel's variations and states is available [https://bug1158883.bugzilla.mozilla.org/attachment.cgi?id=8598080 here].
* A design mock showing the bookmarks menu entry is available [https://mozilla.invisionapp.com/share/4E2TPD4YD#/screens/75361624?maintainScrollPosition=false here].


== Test cases ==
== Test cases ==
===Overview===
===Overview===
Targeted scenarios:
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto">
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto">
<small>Click the <code>expand</code> button to see a few of the targeted user stories</small>
Targeted scenarios
<div class="mw-collapsible-content">
<div class="mw-collapsible-content">
* As a user, I can log into Pocket with an existing Firefox Account, so that I can start using the feature without having to create a new set of credentials.
* The Pocket button is displayed by default between the Bookmarks and the Downloads buttons from the toolbar, '''IF''' Pocket is enabled by default.
* As a user, I can log into Pocket with an existing Pocket account, so that I can start using the feature without having to create a new set of credentials.
* '''IF''' it's the first time, clicking the Pocket button from any page --regular, in-content, etc-- should bring up the Pocket sign-up panel.
* As a user, I can log into Pocket with a new Firefox Account, so that I can start using Pocket.
* The user is able to sign-up for a new Pocket account using FxA.
* As a user, I can log into Pocket with a new Pocket account, so that I can start using Pocket.
* The user is able to log into Pocket using FxA.
* As a user, I can save a page to Pocket by clicking the dedicated Pocket button from the Location Bar.
* The user is able to sign-up for a new Pocket account using a regular email address.
* As a user, I can save a page to Pocket by clicking the dedicated Pocket button from the controls available in Reader View.
* The user is able to log into Pocket using a regular email address.
* As a user, I can save a page to Pocket by clicking the dedicated Pocket option from the context menu.
* The user is able to log into Pocket using an existing, premium account.
* As a user, I can view the items saved to Pocket from the dedicated Pocket entry available in the bookmarks menu.
* The user is able to save a page to Pocket by clicking the associated button from the toolbar.
* As a user, I can start using Pocket on an older profile that already has it installed as an add-on.
* The user is able to save a page to Pocket by clicking the associated button from Reader View's controls.
* As a user, I can start using Pocket on an older profile that already has it installed via Social API.
* The user is able to save a page to Pocket by clicking the associated option from the context menu.
* As a user, I can remove a page from Pocket using the dedicated Pocket button from the Location Bar.
* The user is able to open the Pocket list by clicking the associated option from the bookmarks menu.
* As a user, I can remove a page from Pocket using the dedicated Pocket entry from the bookmarks menu.
* The user is able to open the Pocket list by clicking the associated link from the Pocket confirmation panel displayed after saving a page.
* As a user, I can remove a page from Pocket using the dedicated Pocket option from the context menu.
* The user is able to open a saved page from the Pocket list.
* As a user, I can be notified in a friendly way if my connection or the Pocket servers are down.
* The user is able to open a saved Reader View page from the Pocket list.
* The user is able to make use of all Pocket functionalities from a Firefox profile that already has Pocket installed as an add-on.
* The user is able to make use of all Pocket functionalities from a Firefox profile that already has Pocket installed as a social media service (Social API).
* The user is notified in a friendly manner if his internet connection or the Pocket servers are down.
* The user is able to log out of Pocket using the associated option from Pocket's web application.
</div></div>
</div></div>


Draft test suites:
Draft test suites:
* {{mprog|}} [https://docs.google.com/spreadsheets/d/1lJl60Gb9LaGErDPoFkaYA0-JSOdA32Zgh8sopnpNG2s/edit#gid=405383526 Smoke and Regression Test Suites]
* {{mdone|}} [https://docs.google.com/spreadsheets/d/1lJl60Gb9LaGErDPoFkaYA0-JSOdA32Zgh8sopnpNG2s/edit#gid=405383526 Smoke and Regression Test Suites]
MozTrap test suites:
MozTrap test suites:
* {{ok|}} Smoke Test Suite
* {{mdone|}} [https://moztrap.mozilla.org/manage/cases/?filter-suite=897 Smoke Test Suite]
* {{ok|}} Regression Test Suite
** '''Please note''' that the Smoke Test Suite is subject to change due to pending requirements for specific scenarios (e.g. offline experience, Reader View integration, etc.)
* {{mok|}} Regression Test Suite


== Bug work ==
== Bug work ==
Line 107: Line 94:
====== Bug triage +/- for verification ======
====== Bug triage +/- for verification ======
<div class="mw-collapsible-content">
<div class="mw-collapsible-content">
<font color="green">'''[QE-VERIFY+]'''</font> [https://bugzilla.mozilla.org/show_bug.cgi?id=1155523 Bug 1155523] - Implement Pocket toolbar button<br/>
<font color="green">'''[QE-VERIFY+]'''</font> [https://bugzilla.mozilla.org/show_bug.cgi?id=1155523 Bug 1155523] - Implement rough first-pass at Pocket toolbar button UI<br/>
<font color="green">'''[QE-VERIFY+]'''</font> [https://bugzilla.mozilla.org/show_bug.cgi?id=1155517 Bug 1155517] - Change Reader View to have a "Save Page to Pocket" button instead of "Add To Reader List"<br/>
<font color="green">'''[QE-VERIFY+]'''</font> [https://bugzilla.mozilla.org/show_bug.cgi?id=1155517 Bug 1155517] - Change Reader View to have a "Save Page to Pocket" button instead of "Add To Reader List"<br/>
<font color="green">'''[QE-VERIFY+]'''</font> [https://bugzilla.mozilla.org/show_bug.cgi?id=1155518 Bug 1155518] - Implement "Save to Pocket" context menu item<br/>
<font color="green">'''[QE-VERIFY+]'''</font> [https://bugzilla.mozilla.org/show_bug.cgi?id=1155518 Bug 1155518] - Implement "Save to Pocket" context menu item<br/>
<font color="green">'''[QE-VERIFY+]'''</font> [https://bugzilla.mozilla.org/show_bug.cgi?id=1155519 Bug 1155519] - Add "View Pocket Items" menuitem to the bookmarks menu<br/>
<font color="green">'''[QE-VERIFY+]'''</font> [https://bugzilla.mozilla.org/show_bug.cgi?id=1155519 Bug 1155519] - Add "View Pocket Items" menuitem to the bookmarks menu<br/>
<font color="gray">'''[QE-VERIFY-]'''</font> [https://bugzilla.mozilla.org/show_bug.cgi?id=1155520 Bug 1155520] - Add telemetry for Pocket integration<br/>
<font color="gray">'''[QE-VERIFY-]'''</font> [https://bugzilla.mozilla.org/show_bug.cgi?id=1155520 Bug 1155520] - Add telemetry for Pocket integration<br/>
<font color="gray">'''[QE-VERIFY-]'''</font> [https://bugzilla.mozilla.org/show_bug.cgi?id=1158289 Bug 1158289] - Optimize Reader View's line length to have between 45 and 75 characters<br/>
<font color="green">'''[QE-VERIFY+]'''</font> [https://bugzilla.mozilla.org/show_bug.cgi?id=1158281 Bug 1158281] - Match Pocket's Reader View Sepia Theme<br/>
<font color="green">'''[QE-VERIFY+]'''</font> [https://bugzilla.mozilla.org/show_bug.cgi?id=1161514 Bug 1161514] - The sign-up panel shown by the Pocket button displays top and bottom borders on Mac and Windows<br/>
<font color="green">'''[QE-VERIFY+]'''</font> [https://bugzilla.mozilla.org/show_bug.cgi?id=1160678 Bug 1160678] - Pocket door hangers arent automatically closed<br/>
<font color="green">'''[QE-VERIFY+]'''</font> [https://bugzilla.mozilla.org/show_bug.cgi?id=1161881 Bug 1161881] - Enable Pocket by default (in supported locales)<br/>
<font color="green">'''[QE-VERIFY+]'''</font> [https://bugzilla.mozilla.org/show_bug.cgi?id=1162147 Bug 1162147] - "View Pocket List" link in bookmarks menu doesn't match UI spec
:↳ <small>'''2015-05-07'''</small>: set <code>qe-verify-</code> instead since the bug was marked as <code>wontfix</code>
<font color="green">'''[QE-VERIFY+]'''</font> [https://bugzilla.mozilla.org/show_bug.cgi?id=1162193 Bug 1162193] - Pocket initial panel load displays incorrectly<br/>
<font color="green">'''[QE-VERIFY+]'''</font> [https://bugzilla.mozilla.org/show_bug.cgi?id=1161810 Bug 1161810] - Allow opening the Pocket panel<br/>
<font color="green">'''[QE-VERIFY+]'''</font> [https://bugzilla.mozilla.org/show_bug.cgi?id=1162713 Bug 1162713] - Implement "Save Link to Pocket" context menu item<br/>
<font color="green">'''[QE-VERIFY+]'''</font> [https://bugzilla.mozilla.org/show_bug.cgi?id=1162014 Bug 1162014] - Long tags cut off after trying to save them, overlayed/hidden by white area<br/>
<font color="green">'''[QE-VERIFY+]'''</font> [https://bugzilla.mozilla.org/show_bug.cgi?id=1162033 Bug 1162033] - Pocket panel closes itself while hovering over pocket toolbar button<br/>
<font color="green">'''[QE-VERIFY+]'''</font> [https://bugzilla.mozilla.org/show_bug.cgi?id=1162056 Bug 1162056] - While signed into Firefox Accounts for Sync: 'Sign In with Firefox' button links to sign up page, should be sign in page<br/>
<font color="green">'''[QE-VERIFY+]'''</font> [https://bugzilla.mozilla.org/show_bug.cgi?id=1162697 Bug 1162697] - spinner when saving to pocket feels like a responsiveness problem<br/>
<font color="green">'''[QE-VERIFY+]'''</font> [https://bugzilla.mozilla.org/show_bug.cgi?id=1162816 Bug 1162816] - After signing up for Pocket using Firefox, the onboarding experience shows Chrome screenshots<br/>
<font color="gray">'''[QE-VERIFY-]'''</font> [https://bugzilla.mozilla.org/show_bug.cgi?id=1162253 Bug 1162253] - Update the Pocket Menu Icon with the correct aspect ratios<br/>
<font color="gray">'''[QE-VERIFY-]'''</font> [https://bugzilla.mozilla.org/show_bug.cgi?id=1162660 Bug 1162660] - Pocket Save Panel should use the system font<br/>
<font color="green">'''[QE-VERIFY+]'''</font> [https://bugzilla.mozilla.org/show_bug.cgi?id=1155521 Bug 1155521] - Figure out what to do with users to have the Pocket add-on / SocialAPI button installed<br/>
<font color="green">'''[QE-VERIFY+]'''</font> [https://bugzilla.mozilla.org/show_bug.cgi?id=1163360 Bug 1163360] - Update Pocket code to latest version (May 9th code drop)<br/>
<font color="green">'''[QE-VERIFY+]'''</font> [https://bugzilla.mozilla.org/show_bug.cgi?id=1157017 Bug 1157017] - Pocket offline experience<br/>
<font color="green">'''[QE-VERIFY+]'''</font> [https://bugzilla.mozilla.org/show_bug.cgi?id=1161504 Bug 1161504] - The "Save" button from the Pocket panel appears to have a visited styling applied<br/>
<font color="green">'''[QE-VERIFY+]'''</font> [https://bugzilla.mozilla.org/show_bug.cgi?id=1163319 Bug 1163319] - Pocket button in hamburger menu breaks layout<br/>
<font color="green">'''[QE-VERIFY+]'''</font> [https://bugzilla.mozilla.org/show_bug.cgi?id=1163349 Bug 1163349] - "View Pocket List" menuitem not working<br/>
</div>
</div>
</div>
</div>
Line 119: Line 129:
====== Bug fix verification ======
====== Bug fix verification ======
<div class="mw-collapsible-content">
<div class="mw-collapsible-content">
<font color="green">'''[VERI]'''</font> [bug_url Bug #] - Summary
<font color="green">'''[VERI]'''</font> [https://bugzilla.mozilla.org/show_bug.cgi?id=1155523 Bug 1155523] - Implement rough first-pass at Pocket toolbar button UI
:↳ <small>'''YYYY-MM-DD'''</small>:  
:↳ <small>'''2015-04-30'''</small>: partial functionality confirmed fixed on 40.0a1, across platforms
<font color="red">'''[REOP]'''</font> [bug_url Bug #] - Summary
<font color="green">'''[VERI]'''</font> [https://bugzilla.mozilla.org/show_bug.cgi?id=1156878 Bug 1156878] - Send a request to the server when clicking the Pocket toolbar button
:↳ <small>'''YYYY-MM-DD'''</small>:  
:↳ <small>'''2015-04-30'''</small>: confirmed fixed on 40.0a1, across platforms
<font color="green">'''[VERI]'''</font> [https://bugzilla.mozilla.org/show_bug.cgi?id=1160578 Bug 1160578] - Odd empty door hanger panel when you're on an internal Firefox page
:↳ <small>'''2015-05-07'''</small>: confirmed fixed on 40.0a1, across platforms
<font color="green">'''[VERI]'''</font> [https://bugzilla.mozilla.org/show_bug.cgi?id=1155518 Bug 1155518] - Implement "Save to Pocket" context menu item
:↳ <small>'''2015-05-07'''</small>: confirmed fixed on 40.0a1, across platforms
<font color="green">'''[VERI]'''</font> [https://bugzilla.mozilla.org/show_bug.cgi?id=1161510 Bug 1161510] - main.js:481:12 throws an error in the Browser Console when "Sign Up with Firefox" is clicked
:↳ <small>'''2015-05-07'''</small>: confirmed fixed on 40.0a1, across platforms
<font color="green">'''[VERI]'''</font> [https://bugzilla.mozilla.org/show_bug.cgi?id=1155519 Bug 1155519] - Add "View Pocket Items" menuitem to the bookmarks menu
:↳ <small>'''2015-05-08'''</small>: confirmed fixed on 40.0a1, across platforms
<font color="green">'''[VERI]'''</font> [https://bugzilla.mozilla.org/show_bug.cgi?id=1160577 Bug 1160577] - Error message is no longer shown when a page isn't readable
:↳ <small>'''2015-05-08'''</small>: confirmed fixed on 40.0a1, across platforms
<font color="green">'''[VERI]'''</font> [https://bugzilla.mozilla.org/show_bug.cgi?id=1160678 Bug 1160678] - Pocket door hangers arent automatically closed
:↳ <small>'''2015-05-08'''</small>: confirmed fixed on 40.0a1, across platforms
<font color="green">'''[VERI]'''</font> [https://bugzilla.mozilla.org/show_bug.cgi?id=1161504 Bug 1161504] - The "Save" button from the Pocket panel appears to have a visited styling applied
:↳ <small>'''2015-05-11'''</small>: confirmed fixed across branches and platforms
<font color="green">'''[VERI]'''</font> [https://bugzilla.mozilla.org/show_bug.cgi?id=1163319 Bug 1163319] - Pocket button in hamburger menu breaks layout
:↳ <small>'''2015-05-11'''</small>: confirmed fixed across branches and platforms
<font color="green">'''[VERI]'''</font> [https://bugzilla.mozilla.org/show_bug.cgi?id=1163349 Bug 1163349] - "View Pocket List" menuitem not working
:↳ <small>'''2015-05-11'''</small>: confirmed fixed on 39.0a2 and 38.0.5b1 (build1), across platforms
<font color="green">'''[VERI]'''</font> [https://bugzilla.mozilla.org/show_bug.cgi?id=1157682 Bug 1157682] - Should ignore query string / hashes for checking for "home page"
:↳ <small>'''2015-05-11'''</small>: confirmed fixed across branches and platforms
<font color="green">'''[VERI]'''</font> [https://bugzilla.mozilla.org/show_bug.cgi?id=1157197 Bug 1157197] - Please enable reader view for 38.0.5
:↳ <small>'''2015-05-11'''</small>: confirmed fixed on 38.0.5b1 (build1) and platforms
</div>
</div>
</div>
</div>


<div class="toccolours mw-collapsible mw-collapsed" style="width:auto">
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto">
====== Logged bugs ======
====== Logged bugs ======
<div class="mw-collapsible-content">
<div class="mw-collapsible-content">
[bug_url Bug #] - Summary
[https://bugzilla.mozilla.org/show_bug.cgi?id=1161502 Bug 1161502] - The question mark icon next to the "Sign Up with Firefox" button seems misaligned
:↳ <small>'''YYYY-MM-DD'''</small>:  
:↳ <small>'''2015-05-05'''</small>: found while performing functional testing on 40.0a1
[https://bugzilla.mozilla.org/show_bug.cgi?id=1161504 Bug 1161504] - The "Save" button from the Pocket panel appears to have a visited styling applied
:↳ <small>'''2015-05-05'''</small>: found while performing functional testing on 40.0a1
[https://bugzilla.mozilla.org/show_bug.cgi?id=1161508 Bug 1161508] - The panel shown by the Pocket button after saving a page displays top and bottom borders
:↳ <small>'''2015-05-05'''</small>: found while performing functional testing on 40.0a1
[https://bugzilla.mozilla.org/show_bug.cgi?id=1161510 Bug 1161510] - main.js:481:12 throws an error in the Browser Console when "Sign Up with Firefox" is clicked
:↳ <small>'''2015-05-05'''</small>: found while performing functional testing on 40.0a1
[https://bugzilla.mozilla.org/show_bug.cgi?id=1161514 Bug 1161514] - The sign-up panel shown by the Pocket button displays top and bottom borders on Mac and Windows
:↳ <small>'''2015-05-05'''</small>: found while performing functional testing on 40.0a1
[https://bugzilla.mozilla.org/show_bug.cgi?id=1161518 Bug 1161518] - The user is able to drag and drop the links from the Pocket panel
:↳ <small>'''2015-05-05'''</small>: found while performing functional testing on 40.0a1
[https://bugzilla.mozilla.org/show_bug.cgi?id=1161522 Bug 1161522] - The user is able to save Pocket's "My List" to itself, twice
:↳ <small>'''2015-05-05'''</small>: found while performing functional testing on 40.0a1
[https://bugzilla.mozilla.org/show_bug.cgi?id=1162445 Bug 1162445] - The Pocket toolbar button's functionality is not properly adapting to private browsing, where the user is no longer signed in
:↳ <small>'''2015-05-07'''</small>: found while performing functional testing on 40.0a1
[https://bugzilla.mozilla.org/show_bug.cgi?id=1163576 Bug 1163576] - Unable to remove pages from the Pocket list
:↳ <small>'''2015-05-11'''</small>: found while validating Firefox 38.0.5b1 (build1)
[https://bugzilla.mozilla.org/show_bug.cgi?id=1163613 Bug 1163613] - The panel shown when attempting to Save to Pocket in offline mode is dismissed too soon
:↳ <small>'''2015-05-11'''</small>: found while validating Firefox 38.0.5b1 (build1)
[https://bugzilla.mozilla.org/show_bug.cgi?id=1163581 Bug 1163581] - Unexpected error message displayed when navigating from Pocket list
:↳ <small>'''2015-05-11'''</small>: found while validating Firefox 38.0.5b1 (build1)
:↳ <small>'''2015-05-11'''</small>: closed as <code>invalid</code> by Gavin Sharp, as the issue will be tracked Pocket-side
[https://bugzilla.mozilla.org/show_bug.cgi?id=1163577 Bug 1163577] - Enter Reader View button available in Pocket List page
:↳ <small>'''2015-05-11'''</small>: found while validating Firefox 38.0.5b1 (build1)
[https://bugzilla.mozilla.org/show_bug.cgi?id=1163917 Bug 1163917] - The built-in Pocket is NOT completely disabled if Pocket is already installed and used as an add-on
:↳ <small>'''2015-05-12'''</small>: found while validating Firefox 38.0.5b1 (build2)
</div>
</div>
 
==Milestones==
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto">
===Firefox 38.0.5 Beta 1===
<div class="mw-collapsible-content">
 
{| class="wikitable"
|-
| || '''Build 1''' || '''Build 2'''
|-
| '''Builds''' || [ftp://ftp.mozilla.org/pub/mozilla.org/firefox/candidates/38.0.5b1-candidates/build1/ FTP], [https://ftp.mozilla.org/pub/mozilla.org/firefox/candidates/38.0.5b1-candidates/build1/ HTTP] || [ftp://ftp.mozilla.org/pub/mozilla.org/firefox/candidates/38.0.5b1-candidates/build2/ FTP], [https://ftp.mozilla.org/pub/mozilla.org/firefox/candidates/38.0.5b1-candidates/build2/ HTTP]
|-
| '''ID''' || 20150510205200 || 20150511143336
|-
| '''Changeset''' || [https://hg.mozilla.org/releases/mozilla-release/rev/32b69592b334 32b69592b334] ([https://hg.mozilla.org/releases/mozilla-release/pushloghtml pushlog]) || [https://hg.mozilla.org/releases/mozilla-release/rev/fff143cacb66 fff143cacb66] ([https://hg.mozilla.org/releases/mozilla-release/pushloghtml pushlog])
|}
 
<big>'''Manual testing summary'''</big>
* '''Test coverage'''
** Smoke testing — targeting the primary functionalities of the feature
** [https://etherpad.mozilla.org/Fx38-0-5b1 Exploratory testing] — targeting various other scenarios surrounding the main functionalities available, including negative and edge cases
** Bug fix verification — [http://mzl.la/1zWYZhq Bugzilla query]
* '''Platform coverage'''
** Windows 7 (x64)
** Windows 8.1 (x86)
** Mac OS X 10.9.5
** Ubuntu 14.04 (x64)
* '''Reported bugs for this build'''
** [normal] [https://bugzil.la/1163576 Bug 1163576] - Unable to remove pages from the Pocket list
*** <font style="background-color:#ECECEE; border-radius:3px;border-style:solid; border-color:#ECECEE; border-width:3px;font-size:90%;">UPDATE 2015-05-12</font> marked as '''Resolved Fixed''' and pending uplift
** [normal] [https://bugzil.la/1163577 Bug 1163577] - Enter Reader View button available in Pocket List page
** [normal] [https://bugzil.la/1163613 Bug 1163613] - The panel shown when attempting to Save to Pocket in offline mode is dismissed too soon
** [normal] [https://bugzil.la/1163581 Bug 1163581] - Unexpected error message displayed when navigating from Pocket list
*** <font style="background-color:#ECECEE; border-radius:3px;border-style:solid; border-color:#ECECEE; border-width:3px;font-size:90%;">UPDATE 2015-05-12</font> closed as '''Invalid''' by Gavin Sharp, as the issue will be tracked on Pocket's end
** [normal] [https://bugzil.la/1163651 Bug 1163651] - [Windows]View Pocket List icon from Bookmarks menu is missing.
** [normal] [https://bugzil.la/1163655 Bug 1163655] - View Pocket List menuitem is not at top if Bookmarks button is moved to menu panel.
** [normal] [https://bugzil.la/1163917 Bug 1163917] - The built-in Pocket is NOT completely disabled if Pocket is already installed and used as an add-on
* '''Test results'''
** Smoke test results:
<blockquote>
<blockquote>
{| class="wikitable"
|-
| '''Platform''' || '''Results''' ([https://moztrap.mozilla.org/results/cases/?filter-run=7156 report])
|-
| Windows 7 (x64) || <center><b><font style="font-size:80%;color:red;">[FAILED]</font></b></center>
|-
| Windows 8.1 (x86) || <center><b><font style="font-size:80%;color:red;">[FAILED]</font></b></center>
|-
| Mac OS X 10.9.5 || <center><b><font style="font-size:80%;color:red;">[FAILED]</font></b></center>
|-
| Ubuntu 14.04 (x64) || <center><b><font style="font-size:80%;color:red;">[FAILED]</font></b></center>
|}
</blockquote>
</blockquote>
 
:* Overall feature status after testing: {{mrisk|}}
:* Recommendation from QA: <font style="font-size:80%;color:orange;">'''[CONDITIONAL SIGN OFF]'''</font> — pending the review of newly introduced bugs
</div>
</div>
</div>
</div>


== Sign off ==
===Firefox 38.0.5 Beta 2===
{| class="wikitable"
| '''Builds''' || [ftp://ftp.mozilla.org/pub/mozilla.org/firefox/candidates/38.0.5b2-candidates/build1/ FTP], [https://ftp.mozilla.org/pub/mozilla.org/firefox/candidates/38.0.5b2-candidates/build1/ HTTP]
|-
| '''ID''' || 20150514163436
|-
| '''Changeset''' || [https://hg.mozilla.org/releases/mozilla-release/rev/195e873a8ab1 195e873a8ab1] ([https://hg.mozilla.org/releases/mozilla-release/pushloghtml pushlog])
|}
 
<big>'''Manual testing summary'''</big>
* '''Test coverage'''
** Smoke testing — targeting the primary functionalities of the feature
** [https://etherpad.mozilla.org/Fx38-0-5b2 Exploratory testing] — targeting various other scenarios surrounding the main functionalities available, including negative and edge cases
** Bug fix verification — Bugzilla query
* '''Platform coverage'''
** Windows XP (x86)
** Windows 8 (x64)
** Mac OS X 10.8.5
** Ubuntu (x86)
* '''Reported bugs for this build'''
** [normal] [https://bugzil.la/1165291 Bug 1165291] - Pocket Social Api is not correctly disabled
* '''Test results'''
** Smoke test results:
<blockquote>
<blockquote>
{| class="wikitable"
|-
| '''Platform''' || '''Results''' ([https://moztrap.mozilla.org/results/cases/?filter-run=7215 report])
|-
| Windows XP (x86) || <center><b><font style="font-size:80%;color:red;">[FAILED]</font></b></center>
|-
| Windows 8 (x64) || <center><b><font style="font-size:80%;color:red;">[FAILED]</font></b></center>
|-
| Mac OS X 10.8.5 || <center><b><font style="font-size:80%;color:red;">[FAILED]</font></b></center>
|-
| Ubuntu (x86) || <center><b><font style="font-size:80%;color:red;">[FAILED]</font></b></center>
|}
</blockquote>
</blockquote>
 
:* Overall feature status after testing: <b><font style="color:green;font-size:80%;">[GOOD]</font></b>
:* Recommendation from QA: <b><font style="color:green;font-size:80%;">[SIGN OFF]</font></b>
 
==Sign off ==
===Criteria===
===Criteria===
* All the test cases were executed.
* All the test cases were executed.
Line 140: Line 301:


===Results===
===Results===
---
{{mok|}}''' Beta 38.0.5''' ''(yyyy-mm-dd)''
* <font style="font-size:80%;color:orange;">'''[CONDITIONALLY SIGNED OFF]'''</font> 38.0.5b1-build2 ''(2015-05-12)''
* <b><font style="color:green;font-size:80%;">[SIGNED OFF]</font></b> 38.0.5b2-build1 ''(2015-05-15)''
 
 
= Pocket System Add-on =
== Ownership ==
Developer contacts: Shane Caraveo
 
QA Lead: [mailto:paul.silaghi@softvision.ro Paul Silaghi], :pauly on IRC
 
== Summary ==
Pocket moved to a system add-on in [https://bugzil.la/1215694 Bug 1215694], which landed on Firefox 46.
 
== Test Cases ==
Draft test suites:
* {{mdone|}} [https://docs.google.com/spreadsheets/d/1wl9QDPj6-zQfUJd328KOXI75pJX1EOsP5nD9wkRNUO8/edit#gid=2009706707 Smoke and Regression Test Suites]
 
== Important bugs ==
<font color="red"><small>'''[META]'''</small></font> [https://bugzil.la/1215694 Bug 1215694] - Move Pocket to a built-in add-on
 
'''[NEW]''' [https://bugzil.la/1263599 Bug 1263599] - "View Pocket List" option from the bookmarks menu gone after restart
 
==Sign off ==
* <b><font style="color:green;font-size:80%;">[SIGNED OFF]</font></b> 46.0b11 ''(2016-04-18)''
Confirmed users
891

edits