QA/FindToolbarTesting: Difference between revisions

From MozillaWiki
< QA
Jump to navigation Jump to search
 
(13 intermediate revisions by 3 users not shown)
Line 81: Line 81:
! Ref !! Function !! Test Objective !! Evaluation Criteria !! Test Type !! Owners  
! Ref !! Function !! Test Objective !! Evaluation Criteria !! Test Type !! Owners  
|-
|-
| 1 || Name of the feature or sub-function being tested || The objective the test is trying to demonstrate || The criteria that will be evaluated to demonstrate the test is successful || Manual/ Automation/ Regression/ Performance/ Usability/ Security/ Telemetry || Eng Team
| 1 || Access Find Toolbar || The objective of these tests suites is to verify that the Find Bar can be opened from different browser locations, using mouse or keyboard || Find Toolbar can be opened from:<br />
1. Edit > Find menu<br />
2. Open Menu > Find<br />
3. Keyboard shortcut: CTRL+F/CMD +F
|| Manual || Eng Team
|-
|-
| 2 || Repeat for each feature/sub-function || || || ||
| 2 || Find Toolbar Functionality || The objective of these test suites is to verify that all requirements related to the Find Toolbar functionality are met and that they are functioning as expected || All the elements of the Find Toolbar are working according with the requirements|| Manual || Eng Team
|-
|-
| 3 || || || || ||
| 3 || Find Toolbar Usability ||The objective of these test suites is to verify that the application is user friendly|| The Find Toolbar is easy and straight forward to understand. The user has no difficulty in understanding any of the offered functionality.|| Manual||Eng Team
|-
| 4 || Find Toolbar Accessibility || Find Toolbar is visible and usable from accessibility point of view || The accessibility scenarios are successful ||Manual || Eng Team
|-
| 5 || Browser Performance while find toolbar is opened || TBD || TBD || TBD || TBD
|-
| 6 || Regression testing on the existing logged and fixed Bugzilla bugs || Verify marked as fixed bugs against the Nightly Builds || || ||
|}
|}


== Builds ==
== Builds ==
Line 147: Line 156:
= Status =  
= Status =  
== Overview ==
== Overview ==
  First releases to Nightly: 06.10.2015 [http://archive.mozilla.org/pub/firefox/nightly/2016/06/2016-06-10-07-36-07-mozilla-central/ Nighltly Build]
  First releases to Nightly 50.0a1: 06.10.2015 [http://archive.mozilla.org/pub/firefox/nightly/2016/06/2016-06-10-07-36-07-mozilla-central/ Nighltly Build]
  Track the dates and build number where feature was merged to Aurora
  At merge with Aurora, feature was not sign-off to Aurora due to large number of bugs opened on this feature. Feature remains disabled on Aurora 50 and enabled on Nightly 51
  Track the dates and build number where feature was merged to Release/Beta
Continue testing on Nightly 51.0a1  - mostly focus on bug fixing.
  At merge with Aurora 51, feature was not sign-off to Aurora due to large number of bugs opened on this feature. Feature remains disabled on Aurora 51 and enabled on Nightly 52
Continue testing on Nightly 52.0a1
11/14/2016 - at merge to Aurora 52, feature remains enabled only on Nightly


== Risk analysis ==
Identify the high-risk assumptions
Identify existing bugs on the feature with high risk
Identify if other areas are affected by the fix
= References =
= References =
* Meta bug [https://bugzilla.mozilla.org/show_bug.cgi?id=384458 384458]
* Meta bug [https://bugzilla.mozilla.org/show_bug.cgi?id=384458 384458]
* New Meta bug - starting with Nightly 51: bug [https://bugzilla.mozilla.org/show_bug.cgi?id=1291278 1291278]
* Useful info related to this feature can be found at following [https://public.etherpad-mozilla.org/p/Find_Toolbar_-_QA_Kick-off_meeting etherpad]
* Useful info related to this feature can be found at following [https://public.etherpad-mozilla.org/p/Find_Toolbar_-_QA_Kick-off_meeting etherpad]


= Testcases =  
= Testcases =  
Testcases can be found at [https://docs.google.com/spreadsheets/d/1b6_dcsme2zE44vRB6V14qM_YvZmlAtoeLNCSaG9EDEc/edit#gid=0 link]
Testcases can be found at [https://docs.google.com/spreadsheets/d/1b6_dcsme2zE44vRB6V14qM_YvZmlAtoeLNCSaG9EDEc/edit#gid=0 link]
Testrail link for full testcases at [https://testrail.stage.mozaws.net/index.php?/suites/view/204&group_by=cases:section_id&group_order=asc link]


== Test Areas ==
== Test Areas ==
Line 324: Line 333:


= Bug Work =
= Bug Work =
Tracking bug – meta bug
Meta: [https://bugzilla.mozilla.org/show_bug.cgi?id=1291278 Bug 1291278 - [meta<nowiki>]</nowiki> Get dimmed highlighting mode ready to ship]
 
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto">


====== Bug fix verification ======
== Logged bugs ( blocking [https://bugzilla.mozilla.org/show_bug.cgi?id=1291278 1291278] ) ==
<div class="mw-collapsible-content">
<bugzilla>
{| class="wikitable" style="width:50%"
    {
|-
        "blocks":[1291278],
! Bug No !! Summary !! Status !! Firefox Verion
        "include_fields": "id, priority, component, assigned_to, summary, status, target_milestone"
|-
    }
|  123 || bug summary || NEW || Nighly 45
</bugzilla>
|-
| || || ||
|}
</div></div>
 
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto">
 
====== Logged bugs ======
<div class="mw-collapsible-content">
Bug 111111<br/>
Bug 211111<br/>
</div>
</div>


== Bug Verification  (blocking [https://bugzilla.mozilla.org/show_bug.cgi?id=1291278 1291278]) ==
<bugzilla>
    {
        "blocks":[1291278],
        "resolution":"FIXED",
        "include_fields": "id, priority, component, assigned_to, summary, status, target_milestone"
    }
</bugzilla>


= Sign off =
= Sign off =
Line 354: Line 356:
Check list
Check list
* All test cases should be executed
* All test cases should be executed
* Has sufficient automated test coverage (as measured by code coverage tools) - coordinate with RelMan
* All blockers, criticals must be fixed and verified or have an agreed-upon timeline for being fixed (as determined by engineering/RelMan/QA)
* All blockers, criticals must be fixed and verified or have an agreed-upon timeline for being fixed (as determined by engineering/RelMan/QA)


Line 362: Line 363:
List of OSes that will be covered by testing<br />
List of OSes that will be covered by testing<br />
*Link for the tests run
*Link for the tests run
** Daily Smoke, use template from [https://docs.google.com/spreadsheets/d/1ch0OubyOWn1W-_JLF-38nvSvVB76Wmo1hkLccEtU5hk/edit?usp=sharing link]
** Full Test suite, run on Nighlty 50.0a1 [https://docs.google.com/spreadsheets/d/1b6_dcsme2zE44vRB6V14qM_YvZmlAtoeLNCSaG9EDEc/edit#gid=0 link]
** Full Test suite, use template from [https://docs.google.com/spreadsheets/d/1ch0OubyOWn1W-_JLF-38nvSvVB76Wmo1hkLccEtU5hk/edit?usp=sharing link]
** Full Test suite, run on Nighlty 52.0a1 [https://testrail.stage.mozaws.net/index.php?/plans/view/886 link]
** Regression Test suite, if needed/available
 


'''Merge to Aurora Sign-off'''
'''Merge to Aurora Sign-off'''
Line 377: Line 378:
|-
|-
|  Testing Prerequisites (specs, use cases)  
|  Testing Prerequisites (specs, use cases)  
| style="text-align:center;" |  
| style="text-align:center;" | {{mdone|}}
| style="text-align:center;" |  
| style="text-align:center;" |  
|-
|-
|  Testing Infrastructure setup  
|  Testing Infrastructure setup  
|style="text-align:center;" |   ||  
|style="text-align:center;" | {{mdone|}}  ||  
|-
|-
|  Test Plan Creation  
|  Test Plan Creation  
| style="text-align:center;" |   ||  
| style="text-align:center;" | {{mdone|}} ||  
|-
|-
|  Test Cases Creation  
|  Test Cases Creation  
|style="text-align:center;" |   ||  
|style="text-align:center;" | {{mdone|}}  ||  
|-
|-
|  Full Functional Tests Execution  
|  Full Functional Tests Execution  
|style="text-align:center;" |   
|style="text-align:center;" |  {{mdone|}}
|style="text-align:center;" |   
|style="text-align:center;" |   
|-
|-
|  Automation Coverage ||
|  Automation Coverage  
|style="text-align:center;" |  
|style="text-align:center;" | TBD ||
|-
|-
|  Performance Testing  
|  Performance Testing  
|style="text-align:center;" | ||  
|style="text-align:center;" | TBD ||  
|-
|-
|  All Defects Logged || ||  
|  All Defects Logged  
|style="text-align:center;" | {{mdone|}}
|style="text-align:center;" |  
|-
|-
|  Critical/Blockers Fixed and Verified || ||
|  Critical/Blockers Fixed and Verified  
|-
|style="text-align:center;" |  {{mdone|}}
|  Daily Status Report (email/etherpad statuses/ gdoc with results) || ||  
|style="text-align:center;" |  
|-
|-
|  Metrics/Telemetry||  
|  Metrics/Telemetry||  

Latest revision as of 15:06, 14 November 2016

Revision History

This section describes the modifications that have been made to this wiki page. A new row has been completed each time the content of this document is updated (small corrections for typographical errors do not need to be recorded). The description of the modification contains the differences from the prior version, in terms of what sections were updated and to what extent.

Date Version Author Description
06/23/2016 1.0 Brindusa Tot Created first draft

Overview

Purpose

Detail the purpose of this document. For example:

  • The test scope, focus areas and objectives
  • The test responsibilities
  • The test strategy for the levels and types of test for this release
  • The entry and exit criteria
  • The basis of the test estimates
  • Any risks, issues, assumptions and test dependencies
  • The test schedule and major milestones
  • The test deliverables

Scope

This wiki details the testing that will be performed by the project team for the Find Toolbar project. Its purpose is to document:

  • What will be tested
  • How testing will be performed

Ownership

Engineering contact: Mike de Boer


QA:
Rares Bologa - PM for QA team

Brindusa Tot - leading QA efforts

Liviu Cirdei, QA

Testing summary

Scope of Testing

In Scope

Firefox's find toolbar has several usability problems that need to be addressed and redesigned. The most significant updates would be:
- background dims when at least one result is found, highlights, is being more visible
- first result found is displayed in a yellow square, highlighted. Next occurrences of the result are displayed with a white background.


The testing efforts will be invested on the following areas:

  • functionality: find toolbar functionality on different web pages(small, large, different web page background, pages with different font size, pdf/txt files testing, etc)
  • usability: the find toolbar must be easy to use and straightforward;
  • performance: make sure that browser performance is not affected (check-boarding, scrolling)
  • accessibility: High Contrast themes, Keyboard operation

Out of Scope

Detail what is out of scope from a testing perspective for the project team. Note: if usability testing is not in the scope of testing feature.

Requirements for testing

Environments

Full Testing will be performed on:

  • Windows 7
  • Windows 10
  • Ubuntu 15.04
  • Mac OS X 10.10

Exploratory/Smoke testing will be performed on

  • Windows XP
  • Windows 8.1

Specify other configuration/environmental setup needed: 

- Preference findbar.modalHighlight set on true will enable new implementation of Find Toolbar. On Nightly channel, this preference is set on true by default.

Test Strategy

Test Objectives

This section details the progression test objectives that will be covered. Please note that this is at a high level. For large projects, a suite of test cases would be created which would reference directly back to this master. This could be documented in bullet form or in a table similar to the one below.

Ref Function Test Objective Evaluation Criteria Test Type Owners
1 Access Find Toolbar The objective of these tests suites is to verify that the Find Bar can be opened from different browser locations, using mouse or keyboard Find Toolbar can be opened from:

1. Edit > Find menu
2. Open Menu > Find
3. Keyboard shortcut: CTRL+F/CMD +F

Manual Eng Team
2 Find Toolbar Functionality The objective of these test suites is to verify that all requirements related to the Find Toolbar functionality are met and that they are functioning as expected All the elements of the Find Toolbar are working according with the requirements Manual Eng Team
3 Find Toolbar Usability The objective of these test suites is to verify that the application is user friendly The Find Toolbar is easy and straight forward to understand. The user has no difficulty in understanding any of the offered functionality. Manual Eng Team
4 Find Toolbar Accessibility Find Toolbar is visible and usable from accessibility point of view The accessibility scenarios are successful Manual Eng Team
5 Browser Performance while find toolbar is opened TBD TBD TBD TBD
6 Regression testing on the existing logged and fixed Bugzilla bugs Verify marked as fixed bugs against the Nightly Builds

Builds

This section should contain links for builds with the feature:

  • Links for Nightly builds - available since 06.10.2016 link
  • Links for Aurora builds
  • Links for Beta builds

Test Execution Schedule

The following table identifies the anticipated testing period available for test execution.

Project phase Start Date End Date
Start project 06/22/2016
Study documentation/specs received from developers 06/22/2016 06/24/2016
QA - Test plan creation 06/23/2016 06/28/2016
QA - Test cases/Env preparation 06/24/2016 06/29/2016
QA - Nightly Testing 06/28/2016
QA - Aurora Testing
QA - Beta Testing
Release Date

Testing Tools

Detail the tools to be used for testing, for example see the following table:

Process Tool
Test plan creation Mozilla wiki
Test case creation Google docs
Test case execution Google docs
Bugs management Bugzilla

Status

Overview

First releases to Nightly 50.0a1: 06.10.2015 Nighltly Build
At merge with Aurora, feature was not sign-off to Aurora due to large number of bugs opened on this feature. Feature remains disabled on Aurora 50 and enabled on Nightly 51
Continue testing on Nightly 51.0a1  - mostly focus on bug fixing.
At merge with Aurora 51, feature was not sign-off to Aurora due to large number of bugs opened on this feature. Feature remains disabled on Aurora 51 and enabled on Nightly 52
Continue testing on Nightly 52.0a1
11/14/2016 - at merge to Aurora 52, feature remains enabled only on Nightly

References

  • Meta bug 384458
  • New Meta bug - starting with Nightly 51: bug 1291278
  • Useful info related to this feature can be found at following etherpad

Testcases

Testcases can be found at link Testrail link for full testcases at link

Test Areas

Test Areas Covered Details
Private Window Yes
Multi-Process Enabled Yes
Multi-process Disabled No
Theme (high contrast) Yes
UI
Mouse-only operation Yes
Keyboard-only operation Yes
Display (HiDPI) Yes
Interraction (scroll, zoom) Yes
Usable with a screen reader ?? e.g. with NVDA
Usability and/or discoverability testing ?? Is this feature user friendly
Help/Support
Help/support interface required No Make sure link to support/help page exist and is easy reachable.
Support documents planned(written) No Make sure support documents are written and are correct.
Install/Upgrade
Feature upgrades/downgrades data as expected No
Does sync work across upgrades No
Requires install testing No separate feature/application installation needed (not only Firefox)
Affects first-run or onboarding No Florin/Lawrence are investigating if there is a dedicated QA for this, or we should test? Should be an yes/no and if is yes should add in detail column the team/person assigned.
Does this affect partner builds? Partner build testing ?? yes/no options, add comment with details about who will lead testing
Enterprise Raise up the topic to developers to see if they are expecting to work different on ESR builds
Enterprise administration No
Network proxies/autoconfig No
ESR behavior changes ??
Locked preferences ??
Data Monitoring
Temporary or permanent telemetry monitoring No List of error conditions to monitor
Telemetry correctness testing No
Server integration testing No
Offline and server failure testing No
Load testing No
Add-ons If add-ons are available for testing feature, or is current feature will affect some add-ons, then API testing should be done for the add-on.
Addon API required? No
Comprehensive API testing No
Permissions No
Testing with existing/popular addons No
Security Security is in charge of Matt Wobensmith. We should contact his team to see if security testing is necessary for current feature.
3rd-party security review No
Privilege escalation testing No
Fuzzing No
Web Compatibility depends on the feature
Testing against target sites Yes
Survey of many sites for compatibility Yes
Interoperability depends on the feature
Common protocol/data format with other software: specification available. Interop testing with other common clients or servers. No
Coordinated testing/interop across the Firefoxes: Desktop, Android, iOS No
Interaction of this feature with other browser features No

Test suite

Full Test suite - Link with the gdoc, follow the format from link
Smoke Test suite - Link with the gdoc, follow the format from link
Regression Test suite - Link with the gdoc - if available/needed.

Bug Work

Meta: Bug 1291278 - [meta] Get dimmed highlighting mode ready to ship

Logged bugs ( blocking 1291278 )

Full Query
ID Priority Component Assigned to Summary Status Target milestone
1279652 -- Find Toolbar Find-Again highlights same word twice after scrolling REOPENED ---
1279682 -- Find Toolbar New find doesn't identify the correct locations of search terms VERIFIED ---
1279683 -- Find Toolbar Restore the lost "Highlight All" feature in the find toolbar and persistence of the find result NEW ---
1279695 -- Find Toolbar Mike de Boer [:mikedeboer] Search results in the MDN sidebar are wrongly positioned and move as you scroll VERIFIED mozilla51
1279704 -- Find Toolbar Highlighted word has an extra space after stylized characters VERIFIED ---
1279707 -- Find Toolbar Mike de Boer [:mikedeboer] the highlight will be accumulated and accumulated... VERIFIED mozilla51
1279708 -- Find Toolbar Mike de Boer [:mikedeboer] highlight is wrong if scrolled VERIFIED mozilla51
1279715 P4 Find Toolbar Brad Werth [:bradwerth] Highlight all does not work with css writing-mode: vertical-rl; RESOLVED mozilla61
1279723 -- Find Toolbar Highlight are placed over fixed element NEW ---
1279751 -- Find Toolbar With modal find-in-page, yellow popup is too low with small font sizes VERIFIED ---
1279802 -- Find Toolbar Mike de Boer [:mikedeboer] Highlight all disappears when I click middle mouse button to start autoscroll VERIFIED mozilla51
1279803 -- Find Toolbar Highlight all disappears when open a link in new tab with left mouse button and middle mouse button RESOLVED ---
1279843 -- Find Toolbar Mike de Boer [:mikedeboer] preceding and trailing character are obscured by the emphasized find term VERIFIED mozilla51
1280149 -- Find Toolbar Mike de Boer [:mikedeboer] Modal highlighting doesn't work in some iframes VERIFIED mozilla50
1280354 -- Find Toolbar New page search regression, cannot use link with "Enter" VERIFIED ---
1280751 -- Find Toolbar Search highlight is not displayed on the word when the page has iframe RESOLVED ---
1280876 -- Find Toolbar Mike de Boer [:mikedeboer] Find toolbar influences New Tab page VERIFIED mozilla51
1280978 -- Find Toolbar [meta] New find in page highlighting is very slow NEW ---
1282070 -- Find Toolbar Mike de Boer [:mikedeboer] New Find locates strings on partially loaded pages and doesn't notice when the position changes VERIFIED mozilla51
1282752 P2 Find Toolbar Mike de Boer [:mikedeboer] [New Find Toolbar] The highlight of a long String does not respect the structure of the page VERIFIED ---
1283041 -- Find Toolbar [New Findbar] On PDF files Find Toolbar is not working as expected NEW ---
1283042 -- Find Toolbar Mike de Boer [:mikedeboer] [New Find Toolbar] Highlighting is broken on XML pages VERIFIED mozilla51
1291284 -- Find Toolbar Mike de Boer [:mikedeboer] Enable modal highlighting by default in Firefox VERIFIED mozilla51
1294644 -- Find Toolbar Mike de Boer [:mikedeboer] "Find the previous" and "Find the next" arrows don't change scroll position when "Hightlight All" is enabled VERIFIED mozilla51
1295539 -- Find Toolbar Highlight all disappears when clicking a hash anchor link with left mouse button RESOLVED ---
1295540 -- Find Toolbar Highlight all disappears when open a link in new tab with Ctrl + left mouse button RESOLVED ---
1295759 -- Find Toolbar Mike de Boer [:mikedeboer] Highlight All doesn't work within iframe VERIFIED mozilla51
1296822 -- Find Toolbar Mike de Boer [:mikedeboer] Dimmed background is not correct VERIFIED mozilla51
1297543 -- Find Toolbar Find dimming becomes black when searching in multiple windows VERIFIED ---
1298323 P1 Find Toolbar Mike de Boer [:mikedeboer] Javascript error 'this._docShell is null' after closing [n+1]th window VERIFIED mozilla51
1298434 -- Find Toolbar Mike de Boer [:mikedeboer] Multiple clicking "Highlight All" dim become black VERIFIED ---
1298435 -- Find Toolbar Mike de Boer [:mikedeboer] Emphasized highlight does not follow browser resize VERIFIED mozilla51
1298438 -- Find Toolbar Mike de Boer [:mikedeboer] Typed text in Find toolbar is wrongly shown on the top left corner of browser. And content text disappears VERIFIED mozilla51
1300824 -- Find Toolbar Mike de Boer [:mikedeboer] Backspace on a match shows the white selection briefly VERIFIED mozilla51
1300869 -- Find Toolbar Mike de Boer [:mikedeboer] Dimmed highlighting mode on sometimes wraps the text line of the text being searched for VERIFIED mozilla52
1301941 -- Find Toolbar Mike de Boer [:mikedeboer] Dimmed highlighting mode: Deleting last character does not remove dimming VERIFIED mozilla52
1301953 P3 Find Toolbar Highlight position is broken when position: fixed is set dynamically NEW ---
1302011 P1 Find Toolbar Mike de Boer [:mikedeboer] Content process freezed if findbar.modalHighlight=true and iframe nested VERIFIED mozilla51
1302018 -- Find Toolbar Mike de Boer [:mikedeboer] Dimmed area is too dark in modal highlighting. VERIFIED mozilla52
1302019 -- Find Toolbar Highlighted words gets less contrast in modal highlighting. RESOLVED ---
1302029 -- Find Toolbar The highlight of partial match on single word hides adjacent characters. RESOLVED ---
1302032 -- Find Toolbar Dimmed area disappears after certain keyboard/mouse input. NEW ---
1302033 -- Find Toolbar Highlight jumps to wrong match. RESOLVED ---
1302035 -- Find Toolbar Mike de Boer [:mikedeboer] Inverse dimmed highlight is sometimes shown on light pages when the first match has bright text VERIFIED mozilla52
1302046 P5 Find Toolbar Modal highlight does not maintain position over animated content RESOLVED ---
1302170 -- Find Toolbar Mike de Boer [:mikedeboer] Performance of dimming find animation is bad VERIFIED mozilla52
1302178 -- Find Toolbar Mike de Boer [:mikedeboer] dimming affect has weird persistence across page loads VERIFIED mozilla51
1302244 -- Find Toolbar Scrolling dimmed pages is very slow RESOLVED ---
1302382 -- Find Toolbar Clicking in a page turns off Find in Page RESOLVED ---
1302386 -- Find Toolbar Find highlights matches in the wrong place RESOLVED ---
1302387 -- Find Toolbar Find highlighting doesn't reflect page changes NEW ---
1302470 P1 Find Toolbar Brad Werth [:bradwerth] Find in page should only find visible text VERIFIED mozilla58
1302522 -- Find Toolbar Mike de Boer [:mikedeboer] Find bar highlighter performance evaluation RESOLVED mozilla51
1302534 -- Find Toolbar Mike de Boer [:mikedeboer] On Bugzilla attachment pages, findbar "dimmed highlighting mode" moves matches outside of scrollable region & grows the page height VERIFIED mozilla52
1302749 P5 Find Toolbar Emphasized highlight jumps on maximizing/minimizing the browser RESOLVED ---
1302794 -- Find Toolbar Ctrl-F Find / Find next in Nightly is erratic RESOLVED ---
1302967 -- Find Toolbar Highlights are not hidden when scrolling down a page with iframe RESOLVED ---
1302969 -- Find Toolbar [New Find Toolbar] Highlighting is broken on SVG pages RESOLVED ---
1303207 -- Find Toolbar Find highlight partially obscures characters RESOLVED ---
1303287 -- Find Toolbar Add regression test that checks if AnonymousContent nodes are always inserted into the top-most window NEW ---
1303359 -- Find Toolbar No highlight on dark high contrast OS themes RESOLVED ---
1303874 -- Find Toolbar Mike de Boer [:mikedeboer] Sometimes the white highlights disappear VERIFIED mozilla52
1304073 -- Find Toolbar Mike de Boer [:mikedeboer] Dimmed highlight all should not disappear when you select the text with mouse drag VERIFIED mozilla52
1304292 P5 Find Toolbar Make enough contrast of highlight color in certain text/background color case NEW ---
1304311 -- Find Toolbar Inconsistent Dimmed highlight and background color after toggle [Highlight All] RESOLVED ---
1304313 -- Find Toolbar Dimmed background is reversed RESOLVED ---
1304477 -- Find Toolbar Result overlays do not respect paint order/z-index RESOLVED ---
1304497 -- Find Toolbar Mike de Boer [:mikedeboer] Distracting delayed highlighting of previous match when jumping between matches / Keep the current find match highlighted under the outline VERIFIED mozilla52
1304893 -- Find Toolbar Highlighted words don't move as you scroll horizontally on GitHub RESOLVED ---
1305020 -- Untriaged Firefox Nightly new dimmed highlighting on multiline RESOLVED ---
1305033 -- Find Toolbar Mike de Boer [:mikedeboer] Emphasized highlight of symbols overlaps in matching results VERIFIED mozilla52
1305057 P3 Find Toolbar Add a regression test for ranges in dynamic containers NEW ---
1305059 P1 Find Toolbar Mike de Boer [:mikedeboer] Focus ring on the match searches that contains link VERIFIED mozilla58
1305071 P5 Find Toolbar White flicker when going through the search results, in Mozreview RESOLVED ---
1305194 -- Find Toolbar Mike de Boer [:mikedeboer] Find highlights too quickly while I'm typing VERIFIED mozilla52
1305420 -- Find Toolbar Mike de Boer [:mikedeboer] In some iframes, modal highlight doesn't work correctly VERIFIED mozilla52
1306234 -- Find Toolbar Mike de Boer [:mikedeboer] Dimmed background is inconsistent after clicking "Highlight All" VERIFIED mozilla52
1306289 -- Find Toolbar Hidden words are wrongly highlighted RESOLVED ---
1306320 -- Find Toolbar New find in page highlighting is all over the page NEW ---
1306599 P5 Find Toolbar The white highlights disappear RESOLVED ---
1307328 -- Find Toolbar Mike de Boer [:mikedeboer] Find in page highlight doesn't match searched words VERIFIED mozilla52
1308187 -- Find Toolbar The highlight for matching terms is visible outside the iframe area and moves when you scroll RESOLVED ---
1308214 -- Find Toolbar Lagging and jumping when a match is highlighted RESOLVED ---
1308728 -- Find Toolbar The Find Toolbar doesn't notice when the current selected text changes NEW ---
1308928 -- Find Toolbar The number of matches is not updated RESOLVED ---
1309155 -- Find Toolbar Support complex text layout in the findbar modal highlighting mode NEW ---
1309275 -- Find Toolbar Text that is word-wrapped to another line shows up as blank in the current match RESOLVED ---
1310161 -- Find Toolbar Dimmed background is reversed for a short moment after clicking "Highlight All" RESOLVED ---
1310196 -- Find Toolbar The yellow highlight is interrupted (separated) RESOLVED ---
1310423 -- Find Toolbar delay between scrolling to find result and highlighting it as the current match RESOLVED ---
1310606 -- Find Toolbar The highlight background for the matches is not visible RESOLVED ---
1310613 -- Find Toolbar Background matches are found and highlighted RESOLVED ---
1310797 -- Find Toolbar searching for the next match selects text in the findbox, making incremental search impossible RESOLVED ---
1311320 -- Find Toolbar When highlighting inside XML tags the match highlight looks like teleporting RESOLVED ---
1311360 P4 Find Toolbar Emphasized highlight is wrongly positioned RESOLVED ---
1311663 -- Find Toolbar Content illegible in High contrast mode on Windows RESOLVED ---
1311742 -- Find Toolbar With dimmed highlighting, spaces are shifted around in the Find-In-Page highlighted result, at MozReview NEW ---
1311839 -- Find Toolbar Searching for links highlights everything *except* links RESOLVED ---
1312008 P2 Find Toolbar The white highlight is visible for a while in a wrong position RESOLVED ---
1314315 P3 Find Toolbar With findbar "dimmed highlighting mode", the "highlight all" feature draws visible highlight-area for *invisible* matches in overflowed region of scrollable areas NEW ---
1315428 -- Find Toolbar highlight not updated when pressing "match case" causes switch from zero-to-some or some-to-zero matches RESOLVED ---
1316043 -- Find Toolbar Text disappears unexpectedly RESOLVED ---
1316459 P2 Find Toolbar Mike de Boer [:mikedeboer] Animation on previously highlighted term shouldn't bounce RESOLVED mozilla54
1316513 -- Find Toolbar Mike de Boer [:mikedeboer] Findbar: sometimes "highlight all" button is enabled while the actual highlight feature is disabled (because of hidden regression bug 384458) VERIFIED mozilla53
1316514 -- Find Toolbar Mike de Boer [:mikedeboer] Findbar: sometimes "highlight all" button and the actual highlight feature are not in sync (because of hidden regression bug 384458) VERIFIED mozilla53
1316516 -- Find Toolbar Findbar: Please back out the dangerous "New findbar" code at least in ESR 52, as it causes undetectable bugs (because of hidden regression bug 384458) RESOLVED ---
1317694 -- Find Toolbar Ctrl+F highlighting covers website header NEW ---
1321003 -- Find Toolbar Search highlights not properly updated on partially loaded page. UNCONFIRMED ---
1321442 P2 Find Toolbar Highlight adds scrollable blank space to page after resize NEW ---
1322285 -- Find Toolbar With dimmed highlighting, automatically hyphenated matches are blanked out on all but the first line RESOLVED ---
1324143 -- Find Toolbar Mike de Boer [:mikedeboer] Find toolbar is very slow and uses 100% CPU on large page RESOLVED mozilla53
1326104 -- Find Toolbar With dimmed highlighting, some search results (for search with leading space character) show up as blank NEW ---
1328034 P3 Find Toolbar Findbar highlights old match when I search for new string and toggle Highlight All NEW ---
1330077 -- Find Toolbar find isn't wrapping (or even working?) on some pages RESOLVED ---
1331293 -- Find Toolbar Highlight All can't be enabled without reloading the page NEW ---
1332296 -- Find Toolbar Search highlights not updated in horizontal scrollable text zone. NEW ---
1332757 -- Find Toolbar Mike de Boer [:mikedeboer] With modal find-in-page, Ctrl+G highlights the current findbar contents, so additional typed characters *replace* instead of extending your search term RESOLVED mozilla54
1332943 -- Find Toolbar Dimmed highlighting UI persists even after findbar is closed, if you've navigated forward & back NEW ---
1334088 -- Find Toolbar Brad Werth [:bradwerth] [New Find Toolbar] The highlighted text changes the original position VERIFIED mozilla54
1334213 -- Find Toolbar Mike de Boer [:mikedeboer] Highlighted findbar results do not scroll with the page, on Twitter threads, Gmail, Google Groups RESOLVED mozilla54
1335360 -- Find Toolbar Highlighted word has no space after stylized characters RESOLVED ---
1335722 -- Find Toolbar [New Find Toolbar] Parts of highlighted text are not displayed when searching for longs strings RESOLVED ---
1335724 -- Find Toolbar [New find toolbar] The yellow highlight is not smoothly removed RESOLVED ---
1337869 -- Find Toolbar Mike de Boer [:mikedeboer] modalRepaintScheduler is too slow RESOLVED mozilla60
1338516 -- Find Toolbar [New Find Toolbar] The yellow highlight overlaps the adjacent words when page is zoomed in RESOLVED ---
1340731 -- Find Toolbar Dimmed highlighting mode omits leading space in highlight search results RESOLVED ---
1342080 -- Find Toolbar highlighted search result does not handle bidi properly NEW ---
1343198 -- Find Toolbar [New Find Toolbar] Words that contain links are connected with the next word in highlight mode RESOLVED ---
1352328 -- Find Toolbar Dimmed background disappear when click "Highlight All". previous matching text is remain highlighted NEW ---
1398447 P3 Find Toolbar edge character is covered when findbar.modalHighlight=true NEW ---
1422257 P1 Find Toolbar Emilio Cobos Álvarez [:emilio] Make FinderHighlighter not use -moz-border-*-colors. RESOLVED mozilla59
1452038 P3 Find Toolbar Current text match is white with no highlight until page is scrolled, often making it invisible NEW ---
1600909 P2 Find Toolbar Find on page does not reset result on “Whole Word” change RESOLVED ---
1872349 -- Find Toolbar Remove modalhighlight implementation UNCONFIRMED ---

134 Total; 29 Open (21.64%); 60 Resolved (44.78%); 45 Verified (33.58%);


Bug Verification (blocking 1291278)

Full Query
ID Priority Component Assigned to Summary Status Target milestone
1279682 -- Find Toolbar New find doesn't identify the correct locations of search terms VERIFIED ---
1279695 -- Find Toolbar Mike de Boer [:mikedeboer] Search results in the MDN sidebar are wrongly positioned and move as you scroll VERIFIED mozilla51
1279704 -- Find Toolbar Highlighted word has an extra space after stylized characters VERIFIED ---
1279707 -- Find Toolbar Mike de Boer [:mikedeboer] the highlight will be accumulated and accumulated... VERIFIED mozilla51
1279708 -- Find Toolbar Mike de Boer [:mikedeboer] highlight is wrong if scrolled VERIFIED mozilla51
1279715 P4 Find Toolbar Brad Werth [:bradwerth] Highlight all does not work with css writing-mode: vertical-rl; RESOLVED mozilla61
1279751 -- Find Toolbar With modal find-in-page, yellow popup is too low with small font sizes VERIFIED ---
1279802 -- Find Toolbar Mike de Boer [:mikedeboer] Highlight all disappears when I click middle mouse button to start autoscroll VERIFIED mozilla51
1279843 -- Find Toolbar Mike de Boer [:mikedeboer] preceding and trailing character are obscured by the emphasized find term VERIFIED mozilla51
1280149 -- Find Toolbar Mike de Boer [:mikedeboer] Modal highlighting doesn't work in some iframes VERIFIED mozilla50
1280354 -- Find Toolbar New page search regression, cannot use link with "Enter" VERIFIED ---
1280876 -- Find Toolbar Mike de Boer [:mikedeboer] Find toolbar influences New Tab page VERIFIED mozilla51
1282070 -- Find Toolbar Mike de Boer [:mikedeboer] New Find locates strings on partially loaded pages and doesn't notice when the position changes VERIFIED mozilla51
1282752 P2 Find Toolbar Mike de Boer [:mikedeboer] [New Find Toolbar] The highlight of a long String does not respect the structure of the page VERIFIED ---
1283042 -- Find Toolbar Mike de Boer [:mikedeboer] [New Find Toolbar] Highlighting is broken on XML pages VERIFIED mozilla51
1291284 -- Find Toolbar Mike de Boer [:mikedeboer] Enable modal highlighting by default in Firefox VERIFIED mozilla51
1294644 -- Find Toolbar Mike de Boer [:mikedeboer] "Find the previous" and "Find the next" arrows don't change scroll position when "Hightlight All" is enabled VERIFIED mozilla51
1295759 -- Find Toolbar Mike de Boer [:mikedeboer] Highlight All doesn't work within iframe VERIFIED mozilla51
1296822 -- Find Toolbar Mike de Boer [:mikedeboer] Dimmed background is not correct VERIFIED mozilla51
1297543 -- Find Toolbar Find dimming becomes black when searching in multiple windows VERIFIED ---
1298323 P1 Find Toolbar Mike de Boer [:mikedeboer] Javascript error 'this._docShell is null' after closing [n+1]th window VERIFIED mozilla51
1298434 -- Find Toolbar Mike de Boer [:mikedeboer] Multiple clicking "Highlight All" dim become black VERIFIED ---
1298435 -- Find Toolbar Mike de Boer [:mikedeboer] Emphasized highlight does not follow browser resize VERIFIED mozilla51
1298438 -- Find Toolbar Mike de Boer [:mikedeboer] Typed text in Find toolbar is wrongly shown on the top left corner of browser. And content text disappears VERIFIED mozilla51
1300824 -- Find Toolbar Mike de Boer [:mikedeboer] Backspace on a match shows the white selection briefly VERIFIED mozilla51
1300869 -- Find Toolbar Mike de Boer [:mikedeboer] Dimmed highlighting mode on sometimes wraps the text line of the text being searched for VERIFIED mozilla52
1301941 -- Find Toolbar Mike de Boer [:mikedeboer] Dimmed highlighting mode: Deleting last character does not remove dimming VERIFIED mozilla52
1302011 P1 Find Toolbar Mike de Boer [:mikedeboer] Content process freezed if findbar.modalHighlight=true and iframe nested VERIFIED mozilla51
1302018 -- Find Toolbar Mike de Boer [:mikedeboer] Dimmed area is too dark in modal highlighting. VERIFIED mozilla52
1302035 -- Find Toolbar Mike de Boer [:mikedeboer] Inverse dimmed highlight is sometimes shown on light pages when the first match has bright text VERIFIED mozilla52
1302046 P5 Find Toolbar Modal highlight does not maintain position over animated content RESOLVED ---
1302170 -- Find Toolbar Mike de Boer [:mikedeboer] Performance of dimming find animation is bad VERIFIED mozilla52
1302178 -- Find Toolbar Mike de Boer [:mikedeboer] dimming affect has weird persistence across page loads VERIFIED mozilla51
1302244 -- Find Toolbar Scrolling dimmed pages is very slow RESOLVED ---
1302470 P1 Find Toolbar Brad Werth [:bradwerth] Find in page should only find visible text VERIFIED mozilla58
1302522 -- Find Toolbar Mike de Boer [:mikedeboer] Find bar highlighter performance evaluation RESOLVED mozilla51
1302534 -- Find Toolbar Mike de Boer [:mikedeboer] On Bugzilla attachment pages, findbar "dimmed highlighting mode" moves matches outside of scrollable region & grows the page height VERIFIED mozilla52
1303874 -- Find Toolbar Mike de Boer [:mikedeboer] Sometimes the white highlights disappear VERIFIED mozilla52
1304073 -- Find Toolbar Mike de Boer [:mikedeboer] Dimmed highlight all should not disappear when you select the text with mouse drag VERIFIED mozilla52
1304497 -- Find Toolbar Mike de Boer [:mikedeboer] Distracting delayed highlighting of previous match when jumping between matches / Keep the current find match highlighted under the outline VERIFIED mozilla52
1305033 -- Find Toolbar Mike de Boer [:mikedeboer] Emphasized highlight of symbols overlaps in matching results VERIFIED mozilla52
1305059 P1 Find Toolbar Mike de Boer [:mikedeboer] Focus ring on the match searches that contains link VERIFIED mozilla58
1305194 -- Find Toolbar Mike de Boer [:mikedeboer] Find highlights too quickly while I'm typing VERIFIED mozilla52
1305420 -- Find Toolbar Mike de Boer [:mikedeboer] In some iframes, modal highlight doesn't work correctly VERIFIED mozilla52
1306234 -- Find Toolbar Mike de Boer [:mikedeboer] Dimmed background is inconsistent after clicking "Highlight All" VERIFIED mozilla52
1306289 -- Find Toolbar Hidden words are wrongly highlighted RESOLVED ---
1307328 -- Find Toolbar Mike de Boer [:mikedeboer] Find in page highlight doesn't match searched words VERIFIED mozilla52
1308187 -- Find Toolbar The highlight for matching terms is visible outside the iframe area and moves when you scroll RESOLVED ---
1309275 -- Find Toolbar Text that is word-wrapped to another line shows up as blank in the current match RESOLVED ---
1310423 -- Find Toolbar delay between scrolling to find result and highlighting it as the current match RESOLVED ---
1310613 -- Find Toolbar Background matches are found and highlighted RESOLVED ---
1316459 P2 Find Toolbar Mike de Boer [:mikedeboer] Animation on previously highlighted term shouldn't bounce RESOLVED mozilla54
1316513 -- Find Toolbar Mike de Boer [:mikedeboer] Findbar: sometimes "highlight all" button is enabled while the actual highlight feature is disabled (because of hidden regression bug 384458) VERIFIED mozilla53
1316514 -- Find Toolbar Mike de Boer [:mikedeboer] Findbar: sometimes "highlight all" button and the actual highlight feature are not in sync (because of hidden regression bug 384458) VERIFIED mozilla53
1324143 -- Find Toolbar Mike de Boer [:mikedeboer] Find toolbar is very slow and uses 100% CPU on large page RESOLVED mozilla53
1332757 -- Find Toolbar Mike de Boer [:mikedeboer] With modal find-in-page, Ctrl+G highlights the current findbar contents, so additional typed characters *replace* instead of extending your search term RESOLVED mozilla54
1334088 -- Find Toolbar Brad Werth [:bradwerth] [New Find Toolbar] The highlighted text changes the original position VERIFIED mozilla54
1334213 -- Find Toolbar Mike de Boer [:mikedeboer] Highlighted findbar results do not scroll with the page, on Twitter threads, Gmail, Google Groups RESOLVED mozilla54
1337869 -- Find Toolbar Mike de Boer [:mikedeboer] modalRepaintScheduler is too slow RESOLVED mozilla60
1422257 P1 Find Toolbar Emilio Cobos Álvarez [:emilio] Make FinderHighlighter not use -moz-border-*-colors. RESOLVED mozilla59

60 Total; 0 Open (0%); 15 Resolved (25%); 45 Verified (75%);


Sign off

Criteria

Check list

  • All test cases should be executed
  • All blockers, criticals must be fixed and verified or have an agreed-upon timeline for being fixed (as determined by engineering/RelMan/QA)

Results

Nightly testing

List of OSes that will be covered by testing

  • Link for the tests run
    • Full Test suite, run on Nighlty 50.0a1 link
    • Full Test suite, run on Nighlty 52.0a1 link


Merge to Aurora Sign-off List of OSes that will be covered by testing

  • Link for the tests run
    • Full Test suite

Checklist

Exit Criteria Status Notes/Details
Testing Prerequisites (specs, use cases) [DONE]
Testing Infrastructure setup [DONE]
Test Plan Creation [DONE]
Test Cases Creation [DONE]
Full Functional Tests Execution [DONE]
Automation Coverage TBD
Performance Testing TBD
All Defects Logged [DONE]
Critical/Blockers Fixed and Verified [DONE]
Metrics/Telemetry
QA Signoff - Nightly Release Email to be sent
QA Aurora - Full Testing
QA Signoff - Aurora Release Email to be sent
QA Beta - Full Testing
QA Signoff - Beta Release Email to be sent
Retrieved from "https://wiki.mozilla.org/index.php?title=QA/FindToolbarTesting&oldid=1154535"