QA/Photon Structure: Difference between revisions
< QA
Jump to navigation
Jump to search
| Line 242: | Line 242: | ||
|- | |- | ||
| Does sync work across upgrades | | Does sync work across upgrades | ||
|style="text-align:center;" | | |style="text-align:center;" | Yes || || | ||
|- | |- | ||
| Requires install testing | | Requires install testing | ||
| Line 258: | Line 258: | ||
|- | |- | ||
| Enterprise administration | | Enterprise administration | ||
|style="text-align:center;" | | |style="text-align:center;" | Not applicable || | ||
|- | |- | ||
| Network proxies/autoconfig | | Network proxies/autoconfig | ||
|style="text-align:center;" | | |style="text-align:center;" | Not applicable || | ||
|- | |- | ||
| ESR behavior changes | | ESR behavior changes | ||
|style="text-align:center;" | | |style="text-align:center;" | Not applicable || | ||
|- | |- | ||
| Locked preferences | | Locked preferences | ||
|style="text-align:center;" | | |style="text-align:center;" | Not applicable || | ||
|- | |- | ||
Revision as of 22:37, 15 August 2017
Approvals Required / Received
The following individuals are required to/have approved this Test Plan:
| Name | Title | Department | Approval Date | Method |
|---|---|---|---|---|
| Marco Mucci | EPM | Product Management | TBA | |
| Gijs Kruitbosch | Software Engineer | Engineering | TBA | |
| Mike de Boer | Software Engineer | Engineering | TBA | |
| Drew Willcoxon | Software Engineer | Engineering | TBA | |
| Aaron Benson | UX Designer | Engineering | TBA | |
| Bryan Bell | UX Designer | Engineering | TBA | |
Revision History
| Date | Version | Author | Description |
|---|---|---|---|
| 06/28/2017 | 1.0 | Grover Wimberly IV | Created first draft |
| 08/10/2017 | 1.1 | Grover Wimberly IV | Added details to test plan |
Overview
Purpose
The purpose of this test plan is to
- Determine the scope of testing Photon Structure related bugs and features
- Delegate test responsibilities between various QA personnel
- Have a test strategy for the levels and types of test for this release
- List entry and exit criteria
- Any risks, issues, assumptions and test dependencies
- List test schedule and major milestones
- List test deliverable(s)
Scope
The scope of this document is to test and verify new features/bugs in Photon Structure are working as intended.
- Testing is performed on the newest version of Nightly and tested on all three mainstream operating systems of Firefox Nightly.
- (Windows, Mac OSX, and Linux - Ubuntu Distribution).
Ownership
What resources are needed, and when (developers, QA, PMs working on the feature)
Testing summary
Scope of Testing
In Scope
Photon Structure - Including menus, buttons, toolbar, overflow panel, customization windows on all three major operating systems.
Out of Scope
Animations, Preferences, Onboarding
Requirements for testing
Environments
Windows OS, Mac OSX, and Linux (Ubuntu)
Channel dependent settings (configs) and environment setups
Nightly
photon.structure.enabled = true (Default)
Beta
photon.structure.enabled = true
Post Beta / Release
photon.structure.enabled = true
Test Strategy
Risk Assessment and Coverage
| ID | Description / Threat Description | Covered by Test Objective | Magnitude | Probability | Priority | Impact Score |
|---|---|---|---|---|---|---|
| RAC-1 | Risk description 1 | TO-1 | 2-Moderate | 1-Unlikely | 3-High | 6 |
| RAC-2 | Risk description 2 | TO-1 | 3-High | 3-Almost Certain | 3-High | 27 |
| RAC-3 | Risk description 3 | TO-2 | 2-Moderate | 2-Possible | 3-High | 12 |
Values:
- Magnitude: 1- Low , 2-Moderate, 3-High
- Probability: 1-Unlikely, 2-Possible, 3-Almost Certain
- Priority: 1 - Low, 2-Medium, 3-High
Impact Score Breakdown:
- An impact value of 1, 2, 3, 4 would describe an area which although should be covered there aren't expected any discoveries of critical issues.
- An impact value of 6, 8, 9, 12 would describe an area in which we expect to find issues but those issues are not expected to be critical.
- An impact value of 18 or 27 would describe an area on which it is likely to find issues and those issues to be critical or blockers.
Test Objectives
This section details the progression test objectives that will be covered. Please note that this is at a high level. For large projects, a suite of test cases would be created which would reference directly back to this master. This could be documented in bullet form or in a table similar to the one below.
| Ref | Function | Test Objective | Evaluation Criteria | Test Type | RAC | Owners |
|---|---|---|---|---|---|---|
| 1 | Bug Verification | Verify current bugs for Photon Structure | Ensuring the bug is fixed on major desktop operating systems | Manual/Performance | RAC-1, RAC-2, RAC-3 | Eng Team |
| 2 | Feature Validation | Ensure Photon Structure features work in conjunction with other Photon features | Ensuring the bug is fixed on major desktop operating systems | Manual/Performance | RAC-1, RAC-2, RAC-3 | Eng Team |
| 3 |
Builds
Test Execution Schedule
The following table identifies the anticipated testing period available for test execution.
| Project phase | Start Date | End Date | |
|---|---|---|---|
| Start project | |||
| Study documentation/specs received from developers | |||
| QA - Test plan creation | June 2017 | TBA | |
| QA - Test cases/Env preparation | Not applicable | Not applicable | |
| QA - Nightly Testing | May 2017 | Not applicable | |
| QA - Beta Testing | TBD | ||
| Release Date | November 2017 with Firefox 57 |
Testing Tools
Detail the tools to be used for testing, for example see the following table:
| Process | Tool |
|---|---|
| Test plan creation | Mozilla wiki |
| Test case creation | TestRail/ Google docs |
| Test case execution | TestRail |
| Bugs management | Bugzilla |
Status
Overview
Track the dates and build number where feature was released to Nightly Track the dates and build number where feature was merged to Release/Beta
References
Testcases
Test Areas
| Test Areas | Covered | Details | |
|---|---|---|---|
| Private Window | Varies | ||
| Multi-Process Enabled | Yes | ||
| Multi-process Disabled | Depending on if tests fail | ||
| Theme (high contrast) | Yes | ||
| UI | |||
| Mouse-only operation | Yes | ||
| Keyboard-only operation | Yes | ||
| Display (HiDPI) | Varies | ||
| Interaction (scroll, zoom) | Varies | ||
| Usable with a screen reader | Varies | ||
| Usability and/or discoverability testing | Yes | ||
| RTL build testing | Yes | ||
| Help/Support | |||
| Help/support interface required | Make sure link to support/help page exist and is easy reachable. | ||
| Support documents planned(written) | Make sure support documents are written and are correct. | ||
| Install/Upgrade | |||
| Feature upgrades/downgrades data as expected | Not applicable | ||
| Does sync work across upgrades | Yes | ||
| Requires install testing | Not applicable | ||
| Affects first-run or onboarding | Not applicable | ||
| Does this affect partner builds? Partner build testing | yes/no options, add comment with details about who will lead testing | ||
| Enterprise | Raise up the topic to developers to see if they are expecting to work different on ESR builds | ||
| Enterprise administration | Not applicable | ||
| Network proxies/autoconfig | Not applicable | ||
| ESR behavior changes | Not applicable | ||
| Locked preferences | Not applicable | ||
| Data Monitoring | |||
| Temporary or permanent telemetry monitoring | List of error conditions to monitor | ||
| Telemetry correctness testing | |||
| Server integration testing | |||
| Offline and server failure testing | |||
| Load testing | |||
| Add-ons | If add-ons are available for testing feature, or is current feature will affect some add-ons, then API testing should be done for the add-on. | ||
| Addon API required? | |||
| Comprehensive API testing | |||
| Permissions | |||
| Testing with existing/popular addons | |||
| Security | Security is in charge of Matt Wobensmith. We should contact his team to see if security testing is necessary for current feature. | ||
| 3rd-party security review | |||
| Privilege escalation testing | |||
| Fuzzing | |||
| Web Compatibility | depends on the feature | ||
| Testing against target sites | |||
| Survey of many sites for compatibility | |||
| Interoperability | depends on the feature | ||
| Common protocol/data format with other software: specification available. Interop testing with other common clients or servers. | |||
| Coordinated testing/interop across the Firefoxes: Desktop, Android, iOS | |||
| Interaction of this feature with other browser features |
Test suite
Full Test suite - Link to test rail - testcases should be added under Firefox Desktop project link Smoke Test suite - Link with the tests - if available/needed. Regression Test suite - Link with the tests - if available/needed.
Bug Work
Meta bug: 1387512 - [Meta Photon Structure QA Tracking Bug]
Logged bugs ( blocking 1387512 )
133 Total; 0 Open (0%); 6 Resolved (4.51%); 127 Verified (95.49%);
Bug fix verification
| ID | Priority | Component | Assigned to | Summary | Status | Resolution | Target milestone |
|---|---|---|---|---|---|---|---|
| 1009116 | P1 | Toolbars and Customization | :Paolo Amadini | Redo resizing architecture of panelmultiview | VERIFIED | FIXED | Firefox 55 |
| 1352120 | P1 | Theme | :Gijs (out until Jan 5th; he/him) | Put a bookmark-star button in the location bar | VERIFIED | FIXED | Firefox 56 |
| 1353360 | P1 | Toolbars and Customization | Mike de Boer [:mikedeboer] | Update panelmultiview subviews to match photon design | VERIFIED | FIXED | Firefox 55 |
| 1354078 | P1 | Toolbars and Customization | :Gijs (out until Jan 5th; he/him) | Update toolbar context menu strings and functionality (based on a pref) to move items to/from overflow panel instead of hamburger panel | VERIFIED | FIXED | Firefox 55 |
| 1354082 | P1 | Toolbars and Customization | :Gijs (out until Jan 5th; he/him) | Show the overflow panel in customize mode | VERIFIED | FIXED | Firefox 55 |
| 1354084 | P1 | Toolbars and Customization | :Gijs (out until Jan 5th; he/him) | Add 'Firefox Account' button to static hamburger menu | VERIFIED | FIXED | Firefox 55 |
| 1354086 | P1 | Toolbars and Customization | :Gijs (out until Jan 5th; he/him) | Update overflow panel styling | VERIFIED | FIXED | Firefox 56 |
| 1354094 | P1 | Toolbars and Customization | :Gijs (out until Jan 5th; he/him) | Update code to show/hide overflow panel to take into account whether the user has put permanent items into it | VERIFIED | FIXED | Firefox 55 |
| 1354095 | P1 | Toolbars and Customization | :Gijs (out until Jan 5th; he/him) | Add 'New Window' and 'New Private Window' buttons to static hamburger menu | VERIFIED | FIXED | Firefox 55 |
| 1354097 | P1 | Toolbars and Customization | Blake Winton (:bwinton) (:☕️) | Add footer to overflow panel that opens customize mode | VERIFIED | FIXED | Firefox 56 |
| 1354105 | P1 | Toolbars and Customization | Mike de Boer [:mikedeboer] | Add a restyled zoom control to static hamburger menu | VERIFIED | FIXED | Firefox 55 |
| 1354108 | P1 | Toolbars and Customization | Mike de Boer [:mikedeboer] | Add a restyled edit control to static hamburger menu | VERIFIED | FIXED | Firefox 55 |
| 1354113 | P1 | Toolbars and Customization | :Gijs (out until Jan 5th; he/him) | Add 'Show Library', 'Extensions', 'Preferences' and 'Customize Toolbar' buttons to static hamburger menu | VERIFIED | FIXED | Firefox 55 |
| 1354116 | P1 | Toolbars and Customization | :Gijs (out until Jan 5th; he/him) | Add 'Open File...', 'Save Page As...', 'Page Setup...' and 'Print' buttons to static hamburger menu | VERIFIED | FIXED | Firefox 55 |
| 1354117 | P1 | Toolbars and Customization | :Gijs (out until Jan 5th; he/him) | On startup of a photon browser, migrate customized items from the hamburger panel to the overflow panel | VERIFIED | FIXED | Firefox 57 |
| 1354119 | P1 | Toolbars and Customization | Mike de Boer [:mikedeboer] | Add 'Find in Page...' and 'Help' buttons to static hamburger menu | VERIFIED | FIXED | Firefox 55 |
| 1354123 | P1 | Toolbars and Customization | :Gijs (out until Jan 5th; he/him) | Remove customize mode UI grid styling on window edges / behind the hamburger panel (and corresponding animations) | VERIFIED | FIXED | Firefox 56 |
| 1354126 | P1 | Toolbars and Customization | :Gijs (out until Jan 5th; he/him) | Restyle customize mode footer | VERIFIED | FIXED | Firefox 55 |
| 1354127 | P1 | Toolbars and Customization | Mike de Boer [:mikedeboer] | Add 'More' button to static hamburger menu | VERIFIED | FIXED | Firefox 55 |
| 1354128 | P1 | Toolbars and Customization | Mike de Boer [:mikedeboer] | Add 'Web Developer' button to static hamburger menu | VERIFIED | FIXED | Firefox 55 |
| 1354144 | P1 | Toolbars and Customization | Mike de Boer [:mikedeboer] | Allow basic keyboard navigation in panelmultiview subviews | VERIFIED | FIXED | Firefox 55 |
| 1354145 | P1 | Toolbars and Customization | :Gijs (out until Jan 5th; he/him) | Restyle customize mode main palette ('toolbox') | VERIFIED | FIXED | Firefox 56 |
| 1354155 | P1 | Toolbars and Customization | :Gijs (out until Jan 5th; he/him) | Create Library button and corresponding panel | VERIFIED | FIXED | Firefox 55 |
| 1354159 | P1 | Toolbars and Customization | Mike de Boer [:mikedeboer] | Add a 'Bookmarks' button to the Library panel | VERIFIED | FIXED | Firefox 56 |
| 1354532 | P1 | Toolbars and Customization | Mike de Boer [:mikedeboer] | Add a 'Downloads' button to the Library panel | VERIFIED | FIXED | Firefox 57 |
| 1354533 | P1 | Toolbars and Customization | Mike de Boer [:mikedeboer] | Update the 'History' view in the Library for photon | VERIFIED | FIXED | Firefox 56 |
| 1354534 | P1 | Toolbars and Customization | :Gijs (out until Jan 5th; he/him) | Add a 'Pocket List' button to the Library panel | VERIFIED | FIXED | Firefox 56 |
| 1354536 | P1 | Toolbars and Customization | Mike de Boer [:mikedeboer] | Add a 'Recent Activity' list to the Library panel | VERIFIED | FIXED | Firefox 57 |
| 1355020 | P1 | Toolbars and Customization | :Gijs (out until Jan 5th; he/him) | Include update and other 'notification' UI on hamburger panel in new Photon hamburger panel | VERIFIED | FIXED | Firefox 55 |
| 1355322 | P1 | Address Bar | Drew Willcoxon :adw | Add anchor button to urlbar for action menu | VERIFIED | FIXED | Firefox 55 |
| 1355323 | P1 | Address Bar | Drew Willcoxon :adw | Create action menu panel with initial "copy URL" and "email link" items | VERIFIED | FIXED | Firefox 55 |
| 1355324 | P1 | General | Brian Grinstead [:bgrins] | Create sidebar header switcher | VERIFIED | FIXED | Firefox 55 |
| 1355331 | P1 | General | Brian Grinstead [:bgrins] | Create an option to move sidebar between the left and right sides of the window | VERIFIED | FIXED | Firefox 55 |
| 1360282 | P1 | General | Brian Grinstead [:bgrins] | Remove the panel that opens when clicking on the sidebar toolbar button | VERIFIED | FIXED | Firefox 56 |
| 1363182 | P1 | Address Bar | Drew Willcoxon :adw | Add a "send to device" subview to the page action menu | VERIFIED | FIXED | Firefox 55 |
| 1363183 | P1 | Address Bar | Drew Willcoxon :adw | Add a "bookmark" item to the page action menu | VERIFIED | FIXED | Firefox 55 |
| 1363188 | P1 | Address Bar | Drew Willcoxon :adw | Add add/remove context menus to the different items in the page action menu to add/remove them from the location bar, adding 'save to pocket' by default | VERIFIED | FIXED | Firefox 57 |
| 1363753 | P1 | Toolbars and Customization | Mike de Boer [:mikedeboer] | Ensure that the width of panel views do not exceed that of the main view | VERIFIED | FIXED | Firefox 55 |
| 1364166 | P1 | Theme | Johann Hofmann [:johannh] | Combined toolbar buttons don't have toolbarbutton-1 class after opening the menu panel | VERIFIED | FIXED | Firefox 55 |
| 1364238 | P1 | Toolbars and Customization | Brian Grinstead [:bgrins] | Add the sidebar button into the default toolbar set | VERIFIED | FIXED | Firefox 56 |
| 1364672 | P1 | Toolbars and Customization | Mike de Boer [:mikedeboer] | Glitches in animation in photon hamburger panel | VERIFIED | FIXED | Firefox 55 |
| 1364738 | P1 | Toolbars and Customization | Mike de Boer [:mikedeboer] | [Photon] Update notification causes scroll bar in hamburger panel menu if the update label's text wraps | VERIFIED | FIXED | Firefox 55 |
| 1365294 | P1 | Toolbars and Customization | :Gijs (out until Jan 5th; he/him) | Updated Overflow Menu inverts where placed-objects and overflowed-in objects apear | VERIFIED | FIXED | Firefox 55 |
| 1365637 | P1 | Frontend | Shane Caraveo (:mixedpuppy) | Sidebar doesn't show up in the new Photon sidebar selector | VERIFIED | FIXED | mozilla55 |
| 1365647 | P1 | Toolbars and Customization | Mike de Boer [:mikedeboer] | Ensure that the height of panel views does not shrink smaller that of the main view | VERIFIED | FIXED | Firefox 55 |
| 1365663 | P1 | Toolbars and Customization | :Gijs (out until Jan 5th; he/him) | Update fixed items at top of synced tabs item in library panel to have icons, correct indenting | VERIFIED | FIXED | Firefox 56 |
| 1365705 | P1 | Theme | Brian Grinstead [:bgrins] | Sidebar header has a dark background and dark text with the dark compact theme installed (win10) | VERIFIED | FIXED | Firefox 55 |
| 1366026 | P1 | Toolbars and Customization | :Gijs (out until Jan 5th; he/him) | Add a Screenshots item to the library panel | VERIFIED | FIXED | Firefox 57 |
| 1366041 | P1 | Menus | Drew Willcoxon :adw | Add "Take Screenshot" button to Page Action Menu | VERIFIED | FIXED | --- |
| 1366079 | P1 | Toolbars and Customization | :Gijs (out until Jan 5th; he/him) | [Photon] Overflow menu button is visible on popups but empty | VERIFIED | FIXED | Firefox 55 |
| 1366207 | P1 | Toolbars and Customization | :Gijs (out until Jan 5th; he/him) | Keep subview buttons selected after subview became visible | VERIFIED | FIXED | Firefox 57 |
| 1366573 | P1 | Theme | :Gijs (out until Jan 5th; he/him) | Page action button looks almost vanished on mousehover | VERIFIED | FIXED | Firefox 55 |
| 1366813 | P1 | Toolbars and Customization | :Gijs (out until Jan 5th; he/him) | Add customizable flexible space item in customize mode | VERIFIED | FIXED | Firefox 56 |
| 1366844 | P1 | Theme | :Gijs (out until Jan 5th; he/him) | Update sync iconography for Photon | VERIFIED | FIXED | Firefox 57 |
| 1367012 | P1 | Toolbars and Customization | :Gijs (out until Jan 5th; he/him) | Update updateEditUIVisibility for Photon edit controls | VERIFIED | FIXED | Firefox 55 |
| 1367409 | P1 | Toolbars and Customization | :Gijs (out until Jan 5th; he/him) | New sync panel in hamburger menu stretches user image | VERIFIED | FIXED | Firefox 55 |
| 1367761 | P1 | Theme | :Paolo Amadini | Arrow for photon hamburger arrow panel doesn't blend in anymore | VERIFIED | FIXED | Firefox 55 |
| 1367909 | P1 | General | :Gijs (out until Jan 5th; he/him) | Sidebar switcher background hover should be the width of the item (not the full width of the container) | VERIFIED | FIXED | Firefox 55 |
| 1367927 | P1 | Address Bar | Drew Willcoxon :adw | Add a "save to pocket" item to the page action menu | VERIFIED | FIXED | Firefox 57 |
| 1367970 | P1 | Toolbars and Customization | Mike de Boer [:mikedeboer] | Weird popup effect in the Send to Device Photon menu | VERIFIED | FIXED | Firefox 55 |
| 1368194 | P1 | Menus | :Gijs (out until Jan 5th; he/him) | Page Action Menu, Send to Device items should have tooltips to allow reading titles that get cropped because they are too long | VERIFIED | FIXED | Firefox 55 |
| 1368317 | P1 | General | :Gijs (out until Jan 5th; he/him) | Sidebar splitter overlaps web content when moving the sidebar to the right | VERIFIED | FIXED | Firefox 56 |
| 1368734 | P1 | Toolbars and Customization | Mike de Boer [:mikedeboer] | Add a non-mac-only exit/quit item to the photon hamburger panel | VERIFIED | FIXED | Firefox 55 |
| 1369095 | P1 | Toolbars and Customization | Mike de Boer [:mikedeboer] | Photon panelmultiview subviews should be scrollable | VERIFIED | FIXED | Firefox 56 |
| 1369564 | P1 | Menus | :Gijs (out until Jan 5th; he/him) | [Photon] Menus are too wide. | VERIFIED | FIXED | Firefox 55 |
| 1369729 | P1 | Toolbars and Customization | :Gijs (out until Jan 5th; he/him) | Synced tabs view gets cut off when device descriptions are multiline (needs descriptionheightworkaround) | VERIFIED | FIXED | Firefox 56 |
| 1370083 | P1 | Toolbars and Customization | Mike de Boer [:mikedeboer] | [Photon] (some?) panels have ~4px blank space at the bottom underneath the footer/content | VERIFIED | FIXED | Firefox 56 |
| 1370580 | P1 | Toolbars and Customization | Mike de Boer [:mikedeboer] | Fix layout issues in Library Panel subviews | VERIFIED | FIXED | Firefox 56 |
| 1370686 | P1 | General | Blake Winton (:bwinton) (:☕️) | Extensions sidebar icon doesn't show up in sidebar switcher panel | VERIFIED | FIXED | Firefox 57 |
| 1370967 | P1 | Toolbars and Customization | :Gijs (out until Jan 5th; he/him) | Clicking WebExtension buttons doesn't close the overflow panel | VERIFIED | FIXED | Firefox 56 |
| 1370986 | P1 | Toolbars and Customization | :Gijs (out until Jan 5th; he/him) | Overflow panel subview misses anchor styling, cuts off subviews (needs minimum width?) | VERIFIED | FIXED | Firefox 55 |
| 1371236 | P1 | Toolbars and Customization | :Gijs (out until Jan 5th; he/him) | [Photon] Overflow panel shouldn't try to open in customize mode when dragging items over it | VERIFIED | FIXED | Firefox 56 |
| 1371311 | P1 | Toolbars and Customization | :Gijs (out until Jan 5th; he/him) | Toggling full-screen on Photon menu does not cause the Hamburger Menu to disappear on Windows operating systems | VERIFIED | FIXED | Firefox 56 |
| 1372601 | P1 | General | :Gijs (out until Jan 5th; he/him) | Persist title when toggling the sidebar with a web page loaded in it | VERIFIED | FIXED | Firefox 57 |
| 1373016 | P1 | Toolbars and Customization | :Gijs (out until Jan 5th; he/him) | Remove or update customization mode infopanel | VERIFIED | FIXED | Firefox 56 |
| 1373968 | P1 | Toolbars and Customization | :Gijs (out until Jan 5th; he/him) | Adding many items to overflow panel in customization mode breaks customize mode layout, makes it impossible to exit customize mode with the 'done' button | VERIFIED | FIXED | Firefox 56 |
| 1373969 | P1 | Toolbars and Customization | :Gijs (out until Jan 5th; he/him) | The overflow panel shows unnecessary scrollbars and isn't sized appropriately in some situations | VERIFIED | FIXED | Firefox 56 |
| 1373972 | P1 | Toolbars and Customization | :Gijs (out until Jan 5th; he/him) | Chevron for overflow panel doesn't disappear after using reset / restore defaults, showing empty overflow panel when clicked | VERIFIED | FIXED | Firefox 56 |
| 1374048 | P1 | General | Blake Winton (:bwinton) (:☕️) | Sidebar extension icon does not appear in Photon sidebar header | VERIFIED | FIXED | Firefox 57 |
| 1374315 | P1 | Theme | :Gijs (out until Jan 5th; he/him) | [Photon] overflow panel should have rounded corners (not square ones) on OS X | VERIFIED | FIXED | Firefox 57 |
| 1374509 | P1 | Toolbars and Customization | Mike de Boer [:mikedeboer] | Panel jiggles / twitches sideways when opening subpanel (in overflow / page action panels) | VERIFIED | FIXED | --- |
| 1374603 | P1 | Toolbars and Customization | :Gijs (out until Jan 5th; he/him) | history toolbar button dropdown panel is too wide | VERIFIED | FIXED | Firefox 56 |
| 1374650 | P1 | Theme | Mike de Boer [:mikedeboer] | Indenting of non-iconic subviewbutton items in the panels is wrong | VERIFIED | FIXED | Firefox 56 |
| 1374694 | P1 | Menus | Mike de Boer [:mikedeboer] | "Restart to update Nightly" and its icon are randomly aligned | VERIFIED | FIXED | Firefox 56 |
| 1374749 | P1 | Menus | Mike de Boer [:mikedeboer] | Update door hanger submenu panel animation | VERIFIED | FIXED | Firefox 57 |
| 1374815 | P1 | Menus | :Gijs (out until Jan 5th; he/him) | Sidebar switcher menu items need updated hover styling | VERIFIED | FIXED | Firefox 57 |
| 1375080 | P1 | General | Migrate sidebar into toolbar for current users in Firefox 57 | VERIFIED | FIXED | Firefox 57 | |
| 1375864 | P1 | Theme | :Gijs (out until Jan 5th; he/him) | [Linux] Alignment of some labels in hamburger menu is off | VERIFIED | FIXED | Firefox 56 |
| 1376098 | P1 | Menus | :Gijs (out until Jan 5th; he/him) | [hamburger panel] Remove Page Setup menu item | VERIFIED | FIXED | Firefox 56 |
| 1376100 | P1 | Theme | :Gijs (out until Jan 5th; he/him) | [hamburger panel][Linux] Icon is misaligned in icon-only buttons (without labels) like cut, copy, paste, zoom in/out, sync now and the fullscreen button | VERIFIED | FIXED | Firefox 56 |
| 1377139 | P1 | Toolbars and Customization | :Gijs (out until Jan 5th; he/him) | [Photon] back button in menu sub panels gets stuck in hover state | VERIFIED | FIXED | Firefox 56 |
| 1377165 | P1 | Theme | :Gijs (out until Jan 5th; he/him) | Bookmark star icon in location bar should be blue (not black) when filled in | VERIFIED | FIXED | Firefox 56 |
| 1377202 | P1 | Toolbars and Customization | :Gijs (out until Jan 5th; he/him) | Bookmark icon in location bar not visible with Compact Dark Theme (and potentially dark OS themes and/or other dark lightweight themes) | VERIFIED | FIXED | Firefox 56 |
| 1377227 | P1 | Theme | :Gijs (out until Jan 5th; he/him) | Bookmark and Page Action icons in the location bar are too dark | VERIFIED | FIXED | Firefox 56 |
| 1377413 | P1 | General | :Gijs (out until Jan 5th; he/him) | Chrome UI broken in non-Photon mode. | VERIFIED | FIXED | Firefox 56 |
| 1377967 | P1 | Toolbars and Customization | :Gijs (out until Jan 5th; he/him) | Middle click on Bookmark and History closed tab entry does not open it in new tab | VERIFIED | FIXED | Firefox 57 |
| 1378016 | P1 | Toolbars and Customization | Erica Wright [:ewright] | keyboard navigation broken on 'recent bookmarks' of Library Button | VERIFIED | FIXED | Firefox 57 |
| 1378277 | P1 | Toolbars and Customization | :Gijs (out until Jan 5th; he/him) | Overflow panel arrow is misaligned in customize mode | VERIFIED | FIXED | Firefox 56 |
| 1378427 | P1 | Toolbars and Customization | :Gijs (out until Jan 5th; he/him) | Context menus flicker when opened on edit/zoom controls in the panel menu | VERIFIED | FIXED | Firefox 56 |
| 1378560 | P1 | Address Bar | Drew Willcoxon :adw | The order of items in the url bar should be (from right-to-left) bookmarks, page action menu | VERIFIED | FIXED | Firefox 57 |
| 1378807 | P1 | Search | :Gijs (out until Jan 5th; he/him) | accel/ctrl/cmd-k should bring up the search box if it's in the overflow panel post-photon | VERIFIED | FIXED | Firefox 56 |
| 1380084 | P1 | Toolbars and Customization | :Gijs (out until Jan 5th; he/him) | When moving the library button to the overflow panel, it closes the panel when clicked (doesn't open subview) | VERIFIED | FIXED | Firefox 56 |
| 1380274 | P1 | Toolbars and Customization | :Gijs (out until Jan 5th; he/him) | Overflow panel customizable area doesn't declare an anchor (like the hamburger panel) breaking share widget and potentially other things | VERIFIED | FIXED | Firefox 56 |
| 1381155 | P1 | Address Bar | :Gijs (out until Jan 5th; he/him) | "Page actions" menu should hide after changing tab | VERIFIED | FIXED | Firefox 56 |
| 1381556 | P1 | Address Bar | :Gijs (out until Jan 5th; he/him) | Make page action panel, library, and overflow panels wider (larger min-width) to make them accommodate longer content | VERIFIED | FIXED | Firefox 57 |
| 1382145 | P1 | Toolbars and Customization | :Gijs (out until Jan 5th; he/him) | Update header in customize mode to make it clearer what things are | VERIFIED | FIXED | Firefox 57 |
| 1382570 | P1 | Toolbars and Customization | Erica Wright [:ewright] | right click on bookmark star shows both the bookmark edit popup and the context menu | VERIFIED | FIXED | Firefox 57 |
| 1383009 | P1 | Toolbars and Customization | :Gijs (out until Jan 5th; he/him) | Add flexible spaces around the URL and search bar by default and replace the bookmarks button with the library one | VERIFIED | FIXED | Firefox 57 |
| 1383458 | P1 | Toolbars and Customization | :Gijs (out until Jan 5th; he/him) | Flexible space item shows "Pin to Overflow Menu" item in context menu | VERIFIED | FIXED | Firefox 56 |
| 1383473 | P1 | Toolbars and Customization | Erica Wright [:ewright] | Some minor styling issues in the hamburger menu | VERIFIED | FIXED | Firefox 57 |
| 1383535 | P1 | Theme | :Gijs (out until Jan 5th; he/him) | "Sign into sync" option in new photon hamburger panel has end-side margin even when 'sync now' is not visible (should be flush with panel end) | VERIFIED | FIXED | Firefox 56 |
| 1385083 | P1 | Bookmarks & History | :Gijs (out until Jan 5th; he/him) | History button (and history panel in library, after bug 1354117) doesn't show the Recent History | VERIFIED | FIXED | Firefox 57 |
| 1387846 | P1 | Toolbars and Customization | Maya Messinger | Print item in hamburger panel should print instead of opening print preview (like file menu) | VERIFIED | FIXED | Firefox 57 |
| 1388131 | P1 | Toolbars and Customization | Dão Gottwald [:dao] | The "library" button does not have a tooltip | VERIFIED | FIXED | Firefox 57 |
| 1388832 | P1 | Toolbars and Customization | Sam Foster [:sfoster] (PTO until 2026-01-05) (he/him) | Right-clicking on the Search box within the overflow panel causes 'TypeError: parent.getAttribute is not a function' | VERIFIED | FIXED | Firefox 57 |
| 1388990 | P1 | Toolbars and Customization | :Gijs (out until Jan 5th; he/him) | Back toolbarbutton is perma-disabled after customize toolbar | VERIFIED | FIXED | Firefox 57 |
| 1390327 | P1 | Toolbars and Customization | :Gijs (out until Jan 5th; he/him) | Flexible Spacers should have a non-0 min-width | VERIFIED | FIXED | Firefox 57 |
| 1390985 | -- | Screenshots | Ian Bicking (:ianbicking) | Update Screenshots to version 16.1.0 | RESOLVED | FIXED | --- |
| 1391280 | P1 | Toolbars and Customization | :Gijs (out until Jan 5th; he/him) | Show sidebars button should show previously opened sidebar, even after closing the sidebar and a restart | VERIFIED | FIXED | Firefox 57 |
| 1391549 | P1 | Theme | :Gijs (out until Jan 5th; he/him) | Initial state of sidebar icon should reflect the sidebar side (left/right) pref even if sidebar was closed before restarting Firefox | VERIFIED | FIXED | Firefox 57 |
| 1391705 | P1 | General | :Gijs (out until Jan 5th; he/him) | Don't offer context menu on devices in Send Page to Device subview | VERIFIED | FIXED | Firefox 57 |
| 1392631 | P1 | Toolbars and Customization | :Gijs (out until Jan 5th; he/him) | Flexible spacers can end up in the overflow panel on narrow windows | VERIFIED | FIXED | Firefox 57 |
| 1393574 | P1 | Toolbars and Customization | :Gijs (out until Jan 5th; he/him) | Flexible Space cannot be removed on some profiles | VERIFIED | FIXED | Firefox 57 |
| 1397447 | P1 | Downloads Panel | :Gijs (out until Jan 5th; he/him) | Automatically hide/show the downloads button by default, providing an option to have it permanently visible | VERIFIED | FIXED | Firefox 57 |
| 1400604 | P1 | Menus | Mike de Boer [:mikedeboer] | Overflow Menu expanded (width doubled) after pinning add-on icon | VERIFIED | FIXED | --- |
| 1401238 | P1 | Menus | :Gijs (out until Jan 5th; he/him) | Deprecate Recent Bookmarks, and Pocket List from the Bookmarks Menu. | VERIFIED | FIXED | Firefox 57 |
| 1402311 | P1 | Theme | :Gijs (out until Jan 5th; he/him) | Overflow panel button icon is barely visible in customize mode when the dark theme is enabled | VERIFIED | FIXED | Firefox 58 |
| 1402721 | P1 | Menus | Drew Willcoxon :adw | Add/edit bookmark panel should open anchored on the page action (ellipsis) button instead of on the identity block (left side of the address bar) when the bookmarks star action is not pinned/visible | VERIFIED | FIXED | Firefox 58 |
128 Total; 0 Open (0%); 1 Resolved (0.78%); 127 Verified (99.22%);
Sign off
Criteria
Checklist
- All bugs are to be verified
- All test cases should be executed
- All blockers, criticals must be fixed and verified or have an agreed-upon timeline for being fixed (as determined by engineering/RelMan/QA)
Results
Nightly testing
List of OSes that will be covered by testing
- Link for the tests run
- Full Test suite, link to TestRail - Tests Runs and Results link
- Daily Smoke, if needed/available
- Regression Test suite, if needed/available
Merge to Beta Sign-off
List of OSes that will be covered by testing
- Link for the tests run
- Full Test suite
Checklist
| Exit Criteria | Status | Notes/Details |
|---|---|---|
| Testing Prerequisites (specs, use cases) | ||
| Testing Infrastructure setup | ||
| Test Plan Creation | July-August 2017 | |
| Test Cases Creation | In-Progress | |
| Automation Coverage | ||
| Performance Testing | ||
| All Defects Logged | ||
| Critical/Blockers Fixed and Verified | ||
| Metrics/Telemetry | ||
| Basic/Core functionality Nightly testing | ||
| QA mid-Nightly Signoff | Mid-August 2017 | Email to be sent |
| QA Nightly - Full Testing | ||
| QA pre-Beta Signoff | TBA | Email to be sent |
| QA Beta - Full Testing | ||
| QA pre-Release Signoff | Email to be sent |