QA/Photon Structure: Difference between revisions
< QA
Jump to navigation
Jump to search
| Line 49: | Line 49: | ||
== Ownership == | == Ownership == | ||
Engineering lead | Engineering lead: | ||
[mailto:gijskruitbosch%2Bbugs%40gmail.com Gijs Kruitbosch] | [mailto:gijskruitbosch%2Bbugs%40gmail.com Gijs Kruitbosch] | ||
Engineering Team | Engineering Team: | ||
[mailto:mdeboer@mozilla.com Mike De Boer] | [mailto:mdeboer@mozilla.com Mike De Boer] | ||
[mailto:adw@mozilla.com Drew Willcoxon] | [mailto:adw@mozilla.com Drew Willcoxon] | ||
| Line 60: | Line 60: | ||
[mailto:bbell@mozilla.com Bryan Bell] | [mailto:bbell@mozilla.com Bryan Bell] | ||
QA | QA: | ||
[mailto:gwimberly@softvision.com Grover Wimberly IV] | [mailto:gwimberly@softvision.com Grover Wimberly IV] | ||
Revision as of 16:27, 18 August 2017
Approvals Required / Received
The following individuals are required to/have approved this Test Plan:
| Name | Title | Department | Approval Date | Method |
|---|---|---|---|---|
| Lawrence Mandel, Ryan VanderMeulen | QA Reviewer | Product Integrity | TBA | |
| Marco Mucci | EPM | Product Management | TBA | |
| Gijs Kruitbosch | Software Engineer | Engineering | TBA |
Revision History
| Date | Version | Author | Description |
|---|---|---|---|
| 06/28/2017 | 1.0 | Grover Wimberly IV | Created first draft |
| 08/10/2017 | 1.1 | Grover Wimberly IV | Added details to test plan |
| 08/18/2017 | 1.2 | Grover Wimberly IV | Additional revisions |
Overview
Purpose
The purpose of this test plan is to
- Determine the scope of testing Photon Structure related bugs and features
- Delegate test responsibilities between various QA personnel
- Have a test strategy for the levels and types of test for this release
- List entry and exit criteria
- Any risks, issues, assumptions and test dependencies
- List test schedule and major milestones
- List test deliverable(s)
Scope
The scope of this document is to test and verify new features/bugs in Photon Structure are working as intended.
- Testing is performed on the newest version of Nightly and tested on all three mainstream operating systems of Firefox Nightly.
- (Windows, Mac OSX, and Linux - Ubuntu Distribution).
Ownership
Engineering lead: Gijs Kruitbosch
Engineering Team: Mike De Boer Drew Willcoxon
UX Team: Aaron Benson Bryan Bell
QA: Grover Wimberly IV
Testing summary
Scope of Testing
In Scope
Photon Structure - Including menus, buttons, toolbar, overflow panel, customization windows on all three major operating systems.
Out of Scope
Animations, Preferences, Onboarding, Mobile Environments
Requirements for testing
Environments
Windows OS, Mac OSX, and Linux (Ubuntu)
Channel dependent settings (configs) and environment setups
Nightly
photon.structure.enabled = true (Default)
Beta
photon.structure.enabled = true
Post Beta / Release
photon.structure.enabled = true
Test Strategy
Risk Assessment and Coverage
| ID | Description / Threat Description | Covered by Test Objective | Magnitude | Probability | Priority | Impact Score |
|---|---|---|---|---|---|---|
| RAC-1 | Glitches in the new in-panel animations [when going into subviews or clicking the back button (or using the keyboard) to go back] | TO-1 | 2-Moderate | 2-Possible | 3-High | 12 |
| RAC-2 | Issues with drag/drop in customize mode when dragging item to the overflow panel or toolbar/palette | TO-2 | 3-High | 3-Almost Certain | 3-High | 27 |
| RAC-3 | Issues with the new library/hamburger/page action menu and items in it not functioning correctly | TO-3/4/5 | 2-Moderate | 2-Possible | 3-High | 12 |
| RAC-4 | Styling issues with the new menus (page action, library, hamburger) in RTL | TO-3/4/5/6 | 2-Moderate | 1-Unlikely | 3-High | 6 |
| RAC-5 | Styling/functionality issues with page actions when they're put in the location bar using the context menu on the page action menu | TO-2 | 3-High | 3-Almost Certain | 3-High | 27 |
| RAC-6 | Existing buttons don't work right when pinned to the overflow panel | TO-2 | 2-Moderate | 2-Possible | 3-High | 12 |
| RAC-7 | Issues relating to the sidebar - switching from one side to the other. Holding it over a restart | TO-7 | 3-High | 3-Almost Certain | 3-High | 27 |
| RAC-8 | Potential issues with touchscreen | TO-8 | 2-Moderate | 2-Possible | 3-High | 12 |
Values:
- Magnitude: 1- Low , 2-Moderate, 3-High
- Probability: 1-Unlikely, 2-Possible, 3-Almost Certain
- Priority: 1 - Low, 2-Medium, 3-High
Impact Score Breakdown:
- An impact value of 1, 2, 3, 4 would describe an area which although should be covered there aren't expected any discoveries of critical issues.
- An impact value of 6, 8, 9, 12 would describe an area in which we expect to find issues but those issues are not expected to be critical.
- An impact value of 18 or 27 would describe an area on which it is likely to find issues and those issues to be critical or blockers.
Test Objectives
This section details the progression test objectives that will be covered. Please note that this is at a high level. For large projects, a suite of test cases would be created which would reference directly back to this master. This could be documented in bullet form or in a table similar to the one below.
| Ref | Function | Test Objective | Evaluation Criteria | Test Type | RAC | Owners |
|---|---|---|---|---|---|---|
| 1 | Bug Verification | Ensure new menus/panels open correctly | Ensuring the bug is fixed on major desktop operating systems | Manual/Performance | RAC-1 | Eng Team |
| 2 | Bug Verification | Ensure drag and drop functionality with items from new customize window can seamlessly be swapped to location bar, relevant toolbars or overflow panel | Ensuring the bug is fixed on major desktop operating systems | Manual/Performance | RAC-2, RAC-5, RAC-6 | Eng Team |
| 3 | Bug Verification | Ensure the new library menu functions as intended per specification | Ensuring the bug is fixed on major desktop operating systems | Manual/Performance | RAC-3, RAC-4 | Eng Team |
| 4 | Bug Verification | Ensure the new hamburger menu functions as intended per specification | Ensuring the bug is fixed on major desktop operating systems | Manual/Performance | RAC-4 | Eng Team |
| 5 | Bug Verification | Ensure the new page action menu functions as intended per specification | Ensuring the bug is fixed on major desktop operating systems | Manual/Performance | RAC-4 | Eng Team |
| 6 | Bug Verification | Ensure the Photon Structure menus operate correctly with RTL | Ensuring the bug is fixed on major desktop operating systems | Manual/Performance | RAC-4 | Eng Team |
| 7 | Bug Verification | Ensure the new functionality with the sidebar works as intended | Ensuring the bug is fixed on major desktop operating systems | Manual/Performance | RAC-7 | Eng Team |
| 8 | Bug Verification | Ensure the new structure works with touchscreen devices | Ensuring the bug is fixed on major desktop operating systems | Manual/Performance | RAC-8 | Eng Team |
Builds
Test Execution Schedule
The following table identifies the anticipated testing period available for test execution.
| Project phase | Start Date | End Date |
|---|---|---|
| Start project | June 2017 | July 2017 |
| Study documentation/specs received from developers | June 2017 | July 2017 |
| QA - Test plan creation | June 2017 | August 2017 |
| QA - Test cases/Env preparation | August 21, 2017 | August 25, 2017 |
| QA - Nightly Testing | May 2017 | September 2017 |
| QA - Beta Testing | TBD | TBD |
| Release Date | November 2017 with Firefox 57 | TBD |
Testing Tools
Detail the tools to be used for testing, for example see the following table:
| Process | Tool |
|---|---|
| Test plan creation | Mozilla wiki |
| Test case creation | TBD |
| Test case execution | TBD |
| Bugs management | Bugzilla |
Status
Overview
Track the dates and build number where feature was released to Nightly Track the dates and build number where feature was merged to Release/Beta
References
Testcases
Test Areas
| Test Areas | Covered | Details | |
|---|---|---|---|
| Private Window | Varies | ||
| Multi-Process Enabled | Yes | ||
| Multi-process Disabled | Depending on if tests fail | ||
| Theme (high contrast) | Yes | ||
| UI | |||
| Mouse-only operation | Yes | ||
| Keyboard-only operation | Yes | ||
| Display (HiDPI) | Varies | ||
| Interaction (scroll, zoom) | Varies | ||
| Usable with a screen reader | Varies | ||
| Usability and/or discoverability testing | Yes | ||
| RTL build testing | Yes | ||
| Help/Support | |||
| Help/support interface required | Make sure link to support/help page exist and is easily reachable. | ||
| Support documents planned(written) | Make sure support documents are written and are correct. | ||
| Install/Upgrade | |||
| Feature upgrades/downgrades data as expected | Not applicable | ||
| Does sync work across upgrades | Yes | ||
| Requires install testing | Not applicable | ||
| Affects first-run or onboarding | Not applicable | ||
| Does this affect partner builds? Partner build testing | No | ||
| Enterprise | Raise up the topic to developers to see if they are expecting to work different on ESR builds | ||
| Enterprise administration | Not applicable | ||
| Network proxies/autoconfig | Not applicable | ||
| ESR behavior changes | Not applicable | ||
| Locked preferences | Not applicable | ||
| Data Monitoring | |||
| Temporary or permanent telemetry monitoring | List of error conditions to monitor | ||
| Telemetry correctness testing | Not applicable | ||
| Server integration testing | Not applicable | ||
| Offline and server failure testing | Not applicable | ||
| Load testing | Not applicable | ||
| Add-ons | If add-ons are available for testing feature, or is current feature will affect some add-ons, then API testing should be done for the add-on. | ||
| Addon API required? | No | ||
| Comprehensive API testing | Yes | ||
| Permissions | No | ||
| Testing with existing/popular addons | Gecko Profiler and relevant Web Extensions | ||
| Security | Security is in charge of Matt Wobensmith. We should contact his team to see if security testing is necessary for current feature. | ||
| 3rd-party security review | No | ||
| Privilege escalation testing | No | ||
| Fuzzing | No | ||
| Web Compatibility | depends on the feature | ||
| Testing against target sites | Yes | ||
| Survey of many sites for compatibility | Yes | ||
| Interoperability | depends on the feature | ||
| Common protocol/data format with other software: specification available. Interop testing with other common clients or servers. | No | ||
| Coordinated testing/interop across the Firefoxes: Desktop, Android, iOS | Desktop Only | ||
| Interaction of this feature with other browser features | Yes |
Test suite
Full Test suite - To be worked on
Bug Work
Meta bug: 1387512 - [Meta Photon Structure QA Tracking Bug]
Logged bugs ( blocking 1387512 )
133 Total; 0 Open (0%); 6 Resolved (4.51%); 127 Verified (95.49%);
Bug fix verification
| ID | Priority | Component | Assigned to | Summary | Status | Resolution | Target milestone |
|---|---|---|---|---|---|---|---|
| 1009116 | P1 | Toolbars and Customization | :Paolo Amadini | Redo resizing architecture of panelmultiview | VERIFIED | FIXED | Firefox 55 |
| 1352120 | P1 | Theme | :Gijs (out until Jan 5th; he/him) | Put a bookmark-star button in the location bar | VERIFIED | FIXED | Firefox 56 |
| 1353360 | P1 | Toolbars and Customization | Mike de Boer [:mikedeboer] | Update panelmultiview subviews to match photon design | VERIFIED | FIXED | Firefox 55 |
| 1354078 | P1 | Toolbars and Customization | :Gijs (out until Jan 5th; he/him) | Update toolbar context menu strings and functionality (based on a pref) to move items to/from overflow panel instead of hamburger panel | VERIFIED | FIXED | Firefox 55 |
| 1354082 | P1 | Toolbars and Customization | :Gijs (out until Jan 5th; he/him) | Show the overflow panel in customize mode | VERIFIED | FIXED | Firefox 55 |
| 1354084 | P1 | Toolbars and Customization | :Gijs (out until Jan 5th; he/him) | Add 'Firefox Account' button to static hamburger menu | VERIFIED | FIXED | Firefox 55 |
| 1354086 | P1 | Toolbars and Customization | :Gijs (out until Jan 5th; he/him) | Update overflow panel styling | VERIFIED | FIXED | Firefox 56 |
| 1354094 | P1 | Toolbars and Customization | :Gijs (out until Jan 5th; he/him) | Update code to show/hide overflow panel to take into account whether the user has put permanent items into it | VERIFIED | FIXED | Firefox 55 |
| 1354095 | P1 | Toolbars and Customization | :Gijs (out until Jan 5th; he/him) | Add 'New Window' and 'New Private Window' buttons to static hamburger menu | VERIFIED | FIXED | Firefox 55 |
| 1354097 | P1 | Toolbars and Customization | Blake Winton (:bwinton) (:☕️) | Add footer to overflow panel that opens customize mode | VERIFIED | FIXED | Firefox 56 |
| 1354105 | P1 | Toolbars and Customization | Mike de Boer [:mikedeboer] | Add a restyled zoom control to static hamburger menu | VERIFIED | FIXED | Firefox 55 |
| 1354108 | P1 | Toolbars and Customization | Mike de Boer [:mikedeboer] | Add a restyled edit control to static hamburger menu | VERIFIED | FIXED | Firefox 55 |
| 1354113 | P1 | Toolbars and Customization | :Gijs (out until Jan 5th; he/him) | Add 'Show Library', 'Extensions', 'Preferences' and 'Customize Toolbar' buttons to static hamburger menu | VERIFIED | FIXED | Firefox 55 |
| 1354116 | P1 | Toolbars and Customization | :Gijs (out until Jan 5th; he/him) | Add 'Open File...', 'Save Page As...', 'Page Setup...' and 'Print' buttons to static hamburger menu | VERIFIED | FIXED | Firefox 55 |
| 1354117 | P1 | Toolbars and Customization | :Gijs (out until Jan 5th; he/him) | On startup of a photon browser, migrate customized items from the hamburger panel to the overflow panel | VERIFIED | FIXED | Firefox 57 |
| 1354119 | P1 | Toolbars and Customization | Mike de Boer [:mikedeboer] | Add 'Find in Page...' and 'Help' buttons to static hamburger menu | VERIFIED | FIXED | Firefox 55 |
| 1354123 | P1 | Toolbars and Customization | :Gijs (out until Jan 5th; he/him) | Remove customize mode UI grid styling on window edges / behind the hamburger panel (and corresponding animations) | VERIFIED | FIXED | Firefox 56 |
| 1354126 | P1 | Toolbars and Customization | :Gijs (out until Jan 5th; he/him) | Restyle customize mode footer | VERIFIED | FIXED | Firefox 55 |
| 1354127 | P1 | Toolbars and Customization | Mike de Boer [:mikedeboer] | Add 'More' button to static hamburger menu | VERIFIED | FIXED | Firefox 55 |
| 1354128 | P1 | Toolbars and Customization | Mike de Boer [:mikedeboer] | Add 'Web Developer' button to static hamburger menu | VERIFIED | FIXED | Firefox 55 |
| 1354144 | P1 | Toolbars and Customization | Mike de Boer [:mikedeboer] | Allow basic keyboard navigation in panelmultiview subviews | VERIFIED | FIXED | Firefox 55 |
| 1354145 | P1 | Toolbars and Customization | :Gijs (out until Jan 5th; he/him) | Restyle customize mode main palette ('toolbox') | VERIFIED | FIXED | Firefox 56 |
| 1354155 | P1 | Toolbars and Customization | :Gijs (out until Jan 5th; he/him) | Create Library button and corresponding panel | VERIFIED | FIXED | Firefox 55 |
| 1354159 | P1 | Toolbars and Customization | Mike de Boer [:mikedeboer] | Add a 'Bookmarks' button to the Library panel | VERIFIED | FIXED | Firefox 56 |
| 1354532 | P1 | Toolbars and Customization | Mike de Boer [:mikedeboer] | Add a 'Downloads' button to the Library panel | VERIFIED | FIXED | Firefox 57 |
| 1354533 | P1 | Toolbars and Customization | Mike de Boer [:mikedeboer] | Update the 'History' view in the Library for photon | VERIFIED | FIXED | Firefox 56 |
| 1354534 | P1 | Toolbars and Customization | :Gijs (out until Jan 5th; he/him) | Add a 'Pocket List' button to the Library panel | VERIFIED | FIXED | Firefox 56 |
| 1354536 | P1 | Toolbars and Customization | Mike de Boer [:mikedeboer] | Add a 'Recent Activity' list to the Library panel | VERIFIED | FIXED | Firefox 57 |
| 1355020 | P1 | Toolbars and Customization | :Gijs (out until Jan 5th; he/him) | Include update and other 'notification' UI on hamburger panel in new Photon hamburger panel | VERIFIED | FIXED | Firefox 55 |
| 1355322 | P1 | Address Bar | Drew Willcoxon :adw | Add anchor button to urlbar for action menu | VERIFIED | FIXED | Firefox 55 |
| 1355323 | P1 | Address Bar | Drew Willcoxon :adw | Create action menu panel with initial "copy URL" and "email link" items | VERIFIED | FIXED | Firefox 55 |
| 1355324 | P1 | General | Brian Grinstead [:bgrins] | Create sidebar header switcher | VERIFIED | FIXED | Firefox 55 |
| 1355331 | P1 | General | Brian Grinstead [:bgrins] | Create an option to move sidebar between the left and right sides of the window | VERIFIED | FIXED | Firefox 55 |
| 1360282 | P1 | General | Brian Grinstead [:bgrins] | Remove the panel that opens when clicking on the sidebar toolbar button | VERIFIED | FIXED | Firefox 56 |
| 1363182 | P1 | Address Bar | Drew Willcoxon :adw | Add a "send to device" subview to the page action menu | VERIFIED | FIXED | Firefox 55 |
| 1363183 | P1 | Address Bar | Drew Willcoxon :adw | Add a "bookmark" item to the page action menu | VERIFIED | FIXED | Firefox 55 |
| 1363188 | P1 | Address Bar | Drew Willcoxon :adw | Add add/remove context menus to the different items in the page action menu to add/remove them from the location bar, adding 'save to pocket' by default | VERIFIED | FIXED | Firefox 57 |
| 1363753 | P1 | Toolbars and Customization | Mike de Boer [:mikedeboer] | Ensure that the width of panel views do not exceed that of the main view | VERIFIED | FIXED | Firefox 55 |
| 1364166 | P1 | Theme | Johann Hofmann [:johannh] | Combined toolbar buttons don't have toolbarbutton-1 class after opening the menu panel | VERIFIED | FIXED | Firefox 55 |
| 1364238 | P1 | Toolbars and Customization | Brian Grinstead [:bgrins] | Add the sidebar button into the default toolbar set | VERIFIED | FIXED | Firefox 56 |
| 1364672 | P1 | Toolbars and Customization | Mike de Boer [:mikedeboer] | Glitches in animation in photon hamburger panel | VERIFIED | FIXED | Firefox 55 |
| 1364738 | P1 | Toolbars and Customization | Mike de Boer [:mikedeboer] | [Photon] Update notification causes scroll bar in hamburger panel menu if the update label's text wraps | VERIFIED | FIXED | Firefox 55 |
| 1365294 | P1 | Toolbars and Customization | :Gijs (out until Jan 5th; he/him) | Updated Overflow Menu inverts where placed-objects and overflowed-in objects apear | VERIFIED | FIXED | Firefox 55 |
| 1365637 | P1 | Frontend | Shane Caraveo (:mixedpuppy) | Sidebar doesn't show up in the new Photon sidebar selector | VERIFIED | FIXED | mozilla55 |
| 1365647 | P1 | Toolbars and Customization | Mike de Boer [:mikedeboer] | Ensure that the height of panel views does not shrink smaller that of the main view | VERIFIED | FIXED | Firefox 55 |
| 1365663 | P1 | Toolbars and Customization | :Gijs (out until Jan 5th; he/him) | Update fixed items at top of synced tabs item in library panel to have icons, correct indenting | VERIFIED | FIXED | Firefox 56 |
| 1365705 | P1 | Theme | Brian Grinstead [:bgrins] | Sidebar header has a dark background and dark text with the dark compact theme installed (win10) | VERIFIED | FIXED | Firefox 55 |
| 1366026 | P1 | Toolbars and Customization | :Gijs (out until Jan 5th; he/him) | Add a Screenshots item to the library panel | VERIFIED | FIXED | Firefox 57 |
| 1366041 | P1 | Menus | Drew Willcoxon :adw | Add "Take Screenshot" button to Page Action Menu | VERIFIED | FIXED | --- |
| 1366079 | P1 | Toolbars and Customization | :Gijs (out until Jan 5th; he/him) | [Photon] Overflow menu button is visible on popups but empty | VERIFIED | FIXED | Firefox 55 |
| 1366207 | P1 | Toolbars and Customization | :Gijs (out until Jan 5th; he/him) | Keep subview buttons selected after subview became visible | VERIFIED | FIXED | Firefox 57 |
| 1366573 | P1 | Theme | :Gijs (out until Jan 5th; he/him) | Page action button looks almost vanished on mousehover | VERIFIED | FIXED | Firefox 55 |
| 1366813 | P1 | Toolbars and Customization | :Gijs (out until Jan 5th; he/him) | Add customizable flexible space item in customize mode | VERIFIED | FIXED | Firefox 56 |
| 1366844 | P1 | Theme | :Gijs (out until Jan 5th; he/him) | Update sync iconography for Photon | VERIFIED | FIXED | Firefox 57 |
| 1367012 | P1 | Toolbars and Customization | :Gijs (out until Jan 5th; he/him) | Update updateEditUIVisibility for Photon edit controls | VERIFIED | FIXED | Firefox 55 |
| 1367409 | P1 | Toolbars and Customization | :Gijs (out until Jan 5th; he/him) | New sync panel in hamburger menu stretches user image | VERIFIED | FIXED | Firefox 55 |
| 1367761 | P1 | Theme | :Paolo Amadini | Arrow for photon hamburger arrow panel doesn't blend in anymore | VERIFIED | FIXED | Firefox 55 |
| 1367909 | P1 | General | :Gijs (out until Jan 5th; he/him) | Sidebar switcher background hover should be the width of the item (not the full width of the container) | VERIFIED | FIXED | Firefox 55 |
| 1367927 | P1 | Address Bar | Drew Willcoxon :adw | Add a "save to pocket" item to the page action menu | VERIFIED | FIXED | Firefox 57 |
| 1367970 | P1 | Toolbars and Customization | Mike de Boer [:mikedeboer] | Weird popup effect in the Send to Device Photon menu | VERIFIED | FIXED | Firefox 55 |
| 1368194 | P1 | Menus | :Gijs (out until Jan 5th; he/him) | Page Action Menu, Send to Device items should have tooltips to allow reading titles that get cropped because they are too long | VERIFIED | FIXED | Firefox 55 |
| 1368317 | P1 | General | :Gijs (out until Jan 5th; he/him) | Sidebar splitter overlaps web content when moving the sidebar to the right | VERIFIED | FIXED | Firefox 56 |
| 1368734 | P1 | Toolbars and Customization | Mike de Boer [:mikedeboer] | Add a non-mac-only exit/quit item to the photon hamburger panel | VERIFIED | FIXED | Firefox 55 |
| 1369095 | P1 | Toolbars and Customization | Mike de Boer [:mikedeboer] | Photon panelmultiview subviews should be scrollable | VERIFIED | FIXED | Firefox 56 |
| 1369564 | P1 | Menus | :Gijs (out until Jan 5th; he/him) | [Photon] Menus are too wide. | VERIFIED | FIXED | Firefox 55 |
| 1369729 | P1 | Toolbars and Customization | :Gijs (out until Jan 5th; he/him) | Synced tabs view gets cut off when device descriptions are multiline (needs descriptionheightworkaround) | VERIFIED | FIXED | Firefox 56 |
| 1370083 | P1 | Toolbars and Customization | Mike de Boer [:mikedeboer] | [Photon] (some?) panels have ~4px blank space at the bottom underneath the footer/content | VERIFIED | FIXED | Firefox 56 |
| 1370580 | P1 | Toolbars and Customization | Mike de Boer [:mikedeboer] | Fix layout issues in Library Panel subviews | VERIFIED | FIXED | Firefox 56 |
| 1370686 | P1 | General | Blake Winton (:bwinton) (:☕️) | Extensions sidebar icon doesn't show up in sidebar switcher panel | VERIFIED | FIXED | Firefox 57 |
| 1370967 | P1 | Toolbars and Customization | :Gijs (out until Jan 5th; he/him) | Clicking WebExtension buttons doesn't close the overflow panel | VERIFIED | FIXED | Firefox 56 |
| 1370986 | P1 | Toolbars and Customization | :Gijs (out until Jan 5th; he/him) | Overflow panel subview misses anchor styling, cuts off subviews (needs minimum width?) | VERIFIED | FIXED | Firefox 55 |
| 1371236 | P1 | Toolbars and Customization | :Gijs (out until Jan 5th; he/him) | [Photon] Overflow panel shouldn't try to open in customize mode when dragging items over it | VERIFIED | FIXED | Firefox 56 |
| 1371311 | P1 | Toolbars and Customization | :Gijs (out until Jan 5th; he/him) | Toggling full-screen on Photon menu does not cause the Hamburger Menu to disappear on Windows operating systems | VERIFIED | FIXED | Firefox 56 |
| 1372601 | P1 | General | :Gijs (out until Jan 5th; he/him) | Persist title when toggling the sidebar with a web page loaded in it | VERIFIED | FIXED | Firefox 57 |
| 1373016 | P1 | Toolbars and Customization | :Gijs (out until Jan 5th; he/him) | Remove or update customization mode infopanel | VERIFIED | FIXED | Firefox 56 |
| 1373968 | P1 | Toolbars and Customization | :Gijs (out until Jan 5th; he/him) | Adding many items to overflow panel in customization mode breaks customize mode layout, makes it impossible to exit customize mode with the 'done' button | VERIFIED | FIXED | Firefox 56 |
| 1373969 | P1 | Toolbars and Customization | :Gijs (out until Jan 5th; he/him) | The overflow panel shows unnecessary scrollbars and isn't sized appropriately in some situations | VERIFIED | FIXED | Firefox 56 |
| 1373972 | P1 | Toolbars and Customization | :Gijs (out until Jan 5th; he/him) | Chevron for overflow panel doesn't disappear after using reset / restore defaults, showing empty overflow panel when clicked | VERIFIED | FIXED | Firefox 56 |
| 1374048 | P1 | General | Blake Winton (:bwinton) (:☕️) | Sidebar extension icon does not appear in Photon sidebar header | VERIFIED | FIXED | Firefox 57 |
| 1374315 | P1 | Theme | :Gijs (out until Jan 5th; he/him) | [Photon] overflow panel should have rounded corners (not square ones) on OS X | VERIFIED | FIXED | Firefox 57 |
| 1374509 | P1 | Toolbars and Customization | Mike de Boer [:mikedeboer] | Panel jiggles / twitches sideways when opening subpanel (in overflow / page action panels) | VERIFIED | FIXED | --- |
| 1374603 | P1 | Toolbars and Customization | :Gijs (out until Jan 5th; he/him) | history toolbar button dropdown panel is too wide | VERIFIED | FIXED | Firefox 56 |
| 1374650 | P1 | Theme | Mike de Boer [:mikedeboer] | Indenting of non-iconic subviewbutton items in the panels is wrong | VERIFIED | FIXED | Firefox 56 |
| 1374694 | P1 | Menus | Mike de Boer [:mikedeboer] | "Restart to update Nightly" and its icon are randomly aligned | VERIFIED | FIXED | Firefox 56 |
| 1374749 | P1 | Menus | Mike de Boer [:mikedeboer] | Update door hanger submenu panel animation | VERIFIED | FIXED | Firefox 57 |
| 1374815 | P1 | Menus | :Gijs (out until Jan 5th; he/him) | Sidebar switcher menu items need updated hover styling | VERIFIED | FIXED | Firefox 57 |
| 1375080 | P1 | General | Migrate sidebar into toolbar for current users in Firefox 57 | VERIFIED | FIXED | Firefox 57 | |
| 1375864 | P1 | Theme | :Gijs (out until Jan 5th; he/him) | [Linux] Alignment of some labels in hamburger menu is off | VERIFIED | FIXED | Firefox 56 |
| 1376098 | P1 | Menus | :Gijs (out until Jan 5th; he/him) | [hamburger panel] Remove Page Setup menu item | VERIFIED | FIXED | Firefox 56 |
| 1376100 | P1 | Theme | :Gijs (out until Jan 5th; he/him) | [hamburger panel][Linux] Icon is misaligned in icon-only buttons (without labels) like cut, copy, paste, zoom in/out, sync now and the fullscreen button | VERIFIED | FIXED | Firefox 56 |
| 1377139 | P1 | Toolbars and Customization | :Gijs (out until Jan 5th; he/him) | [Photon] back button in menu sub panels gets stuck in hover state | VERIFIED | FIXED | Firefox 56 |
| 1377165 | P1 | Theme | :Gijs (out until Jan 5th; he/him) | Bookmark star icon in location bar should be blue (not black) when filled in | VERIFIED | FIXED | Firefox 56 |
| 1377202 | P1 | Toolbars and Customization | :Gijs (out until Jan 5th; he/him) | Bookmark icon in location bar not visible with Compact Dark Theme (and potentially dark OS themes and/or other dark lightweight themes) | VERIFIED | FIXED | Firefox 56 |
| 1377227 | P1 | Theme | :Gijs (out until Jan 5th; he/him) | Bookmark and Page Action icons in the location bar are too dark | VERIFIED | FIXED | Firefox 56 |
| 1377413 | P1 | General | :Gijs (out until Jan 5th; he/him) | Chrome UI broken in non-Photon mode. | VERIFIED | FIXED | Firefox 56 |
| 1377967 | P1 | Toolbars and Customization | :Gijs (out until Jan 5th; he/him) | Middle click on Bookmark and History closed tab entry does not open it in new tab | VERIFIED | FIXED | Firefox 57 |
| 1378016 | P1 | Toolbars and Customization | Erica Wright [:ewright] | keyboard navigation broken on 'recent bookmarks' of Library Button | VERIFIED | FIXED | Firefox 57 |
| 1378277 | P1 | Toolbars and Customization | :Gijs (out until Jan 5th; he/him) | Overflow panel arrow is misaligned in customize mode | VERIFIED | FIXED | Firefox 56 |
| 1378427 | P1 | Toolbars and Customization | :Gijs (out until Jan 5th; he/him) | Context menus flicker when opened on edit/zoom controls in the panel menu | VERIFIED | FIXED | Firefox 56 |
| 1378560 | P1 | Address Bar | Drew Willcoxon :adw | The order of items in the url bar should be (from right-to-left) bookmarks, page action menu | VERIFIED | FIXED | Firefox 57 |
| 1378807 | P1 | Search | :Gijs (out until Jan 5th; he/him) | accel/ctrl/cmd-k should bring up the search box if it's in the overflow panel post-photon | VERIFIED | FIXED | Firefox 56 |
| 1380084 | P1 | Toolbars and Customization | :Gijs (out until Jan 5th; he/him) | When moving the library button to the overflow panel, it closes the panel when clicked (doesn't open subview) | VERIFIED | FIXED | Firefox 56 |
| 1380274 | P1 | Toolbars and Customization | :Gijs (out until Jan 5th; he/him) | Overflow panel customizable area doesn't declare an anchor (like the hamburger panel) breaking share widget and potentially other things | VERIFIED | FIXED | Firefox 56 |
| 1381155 | P1 | Address Bar | :Gijs (out until Jan 5th; he/him) | "Page actions" menu should hide after changing tab | VERIFIED | FIXED | Firefox 56 |
| 1381556 | P1 | Address Bar | :Gijs (out until Jan 5th; he/him) | Make page action panel, library, and overflow panels wider (larger min-width) to make them accommodate longer content | VERIFIED | FIXED | Firefox 57 |
| 1382145 | P1 | Toolbars and Customization | :Gijs (out until Jan 5th; he/him) | Update header in customize mode to make it clearer what things are | VERIFIED | FIXED | Firefox 57 |
| 1382570 | P1 | Toolbars and Customization | Erica Wright [:ewright] | right click on bookmark star shows both the bookmark edit popup and the context menu | VERIFIED | FIXED | Firefox 57 |
| 1383009 | P1 | Toolbars and Customization | :Gijs (out until Jan 5th; he/him) | Add flexible spaces around the URL and search bar by default and replace the bookmarks button with the library one | VERIFIED | FIXED | Firefox 57 |
| 1383458 | P1 | Toolbars and Customization | :Gijs (out until Jan 5th; he/him) | Flexible space item shows "Pin to Overflow Menu" item in context menu | VERIFIED | FIXED | Firefox 56 |
| 1383473 | P1 | Toolbars and Customization | Erica Wright [:ewright] | Some minor styling issues in the hamburger menu | VERIFIED | FIXED | Firefox 57 |
| 1383535 | P1 | Theme | :Gijs (out until Jan 5th; he/him) | "Sign into sync" option in new photon hamburger panel has end-side margin even when 'sync now' is not visible (should be flush with panel end) | VERIFIED | FIXED | Firefox 56 |
| 1385083 | P1 | Bookmarks & History | :Gijs (out until Jan 5th; he/him) | History button (and history panel in library, after bug 1354117) doesn't show the Recent History | VERIFIED | FIXED | Firefox 57 |
| 1387846 | P1 | Toolbars and Customization | Maya Messinger | Print item in hamburger panel should print instead of opening print preview (like file menu) | VERIFIED | FIXED | Firefox 57 |
| 1388131 | P1 | Toolbars and Customization | Dão Gottwald [:dao] | The "library" button does not have a tooltip | VERIFIED | FIXED | Firefox 57 |
| 1388832 | P1 | Toolbars and Customization | Sam Foster [:sfoster] (PTO until 2026-01-05) (he/him) | Right-clicking on the Search box within the overflow panel causes 'TypeError: parent.getAttribute is not a function' | VERIFIED | FIXED | Firefox 57 |
| 1388990 | P1 | Toolbars and Customization | :Gijs (out until Jan 5th; he/him) | Back toolbarbutton is perma-disabled after customize toolbar | VERIFIED | FIXED | Firefox 57 |
| 1390327 | P1 | Toolbars and Customization | :Gijs (out until Jan 5th; he/him) | Flexible Spacers should have a non-0 min-width | VERIFIED | FIXED | Firefox 57 |
| 1390985 | -- | Screenshots | Ian Bicking (:ianbicking) | Update Screenshots to version 16.1.0 | RESOLVED | FIXED | --- |
| 1391280 | P1 | Toolbars and Customization | :Gijs (out until Jan 5th; he/him) | Show sidebars button should show previously opened sidebar, even after closing the sidebar and a restart | VERIFIED | FIXED | Firefox 57 |
| 1391549 | P1 | Theme | :Gijs (out until Jan 5th; he/him) | Initial state of sidebar icon should reflect the sidebar side (left/right) pref even if sidebar was closed before restarting Firefox | VERIFIED | FIXED | Firefox 57 |
| 1391705 | P1 | General | :Gijs (out until Jan 5th; he/him) | Don't offer context menu on devices in Send Page to Device subview | VERIFIED | FIXED | Firefox 57 |
| 1392631 | P1 | Toolbars and Customization | :Gijs (out until Jan 5th; he/him) | Flexible spacers can end up in the overflow panel on narrow windows | VERIFIED | FIXED | Firefox 57 |
| 1393574 | P1 | Toolbars and Customization | :Gijs (out until Jan 5th; he/him) | Flexible Space cannot be removed on some profiles | VERIFIED | FIXED | Firefox 57 |
| 1397447 | P1 | Downloads Panel | :Gijs (out until Jan 5th; he/him) | Automatically hide/show the downloads button by default, providing an option to have it permanently visible | VERIFIED | FIXED | Firefox 57 |
| 1400604 | P1 | Menus | Mike de Boer [:mikedeboer] | Overflow Menu expanded (width doubled) after pinning add-on icon | VERIFIED | FIXED | --- |
| 1401238 | P1 | Menus | :Gijs (out until Jan 5th; he/him) | Deprecate Recent Bookmarks, and Pocket List from the Bookmarks Menu. | VERIFIED | FIXED | Firefox 57 |
| 1402311 | P1 | Theme | :Gijs (out until Jan 5th; he/him) | Overflow panel button icon is barely visible in customize mode when the dark theme is enabled | VERIFIED | FIXED | Firefox 58 |
| 1402721 | P1 | Menus | Drew Willcoxon :adw | Add/edit bookmark panel should open anchored on the page action (ellipsis) button instead of on the identity block (left side of the address bar) when the bookmarks star action is not pinned/visible | VERIFIED | FIXED | Firefox 58 |
128 Total; 0 Open (0%); 1 Resolved (0.78%); 127 Verified (99.22%);
Sign off
Criteria
Checklist
- All bugs are to be verified
- All test cases should be executed
- All blockers, criticals must be fixed and verified or have an agreed-upon timeline for being fixed (as determined by engineering/RelMan/QA)
Results
Nightly testing
TBD
Merge to Beta Sign-off
TBD
Checklist
Note: August 18, 2017 -- Formatting needs fixing.
| Exit Criteria | Status | Notes/Details | |
|---|---|---|---|
| Testing Prerequisites (specs, use cases) | In-Progress | | ||
| Testing Infrastructure setup | In-Progress | | ||
| Test Plan Creation | July-August 18, 2017 | | ||
| Test Cases Creation | In-Progress | | ||
| Automation Coverage | Out of Scope for Softvision | | ||
| Performance Testing | In-Progress | ||
| Critical/Blockers Fixed and Verified | |||
| Metrics/Telemetry | Not applicable | | ||
| Basic/Core functionality Nightly testing | In-Progress | | ||
| QA mid-Nightly Signoff | Mid-August 2017 | Email to be sent | | |
| QA Nightly - Full Testing | Beginning August 21, 2017 | | ||
| QA pre-Beta Signoff | TBD | ||
| QA Beta - Full Testing | TBD | | ||
| QA pre-Release Signoff | TBD | |