QA/Search refactoring: Difference between revisions

No edit summary
 
(15 intermediate revisions by 3 users not shown)
Line 106: Line 106:
|-
|-
| QA - Aurora Testing
| QA - Aurora Testing
|style="text-align:center;" | ||
|style="text-align:center;" | 11.30.2015 || 01.25.2016
|-
|-
| QA - Beta Testing  
| QA - Beta Testing  
|style="text-align:center;" | ||  
|style="text-align:center;" | 01.26.2016 ||  
|-
|-
| Release Date  
| Release Date  
Line 195: Line 195:
|-
|-
| [https://bugzilla.mozilla.org/show_bug.cgi?id=1226608 1226608] || When restore a removed search engine, Google is set the default search engine || RESOLVED INVALID||  
| [https://bugzilla.mozilla.org/show_bug.cgi?id=1226608 1226608] || When restore a removed search engine, Google is set the default search engine || RESOLVED INVALID||  
|-
| [https://bugzilla.mozilla.org/show_bug.cgi?id=1227045 1227045] ||  The default search engine is not kept after selecting the "restore default search engines" || Verified FIXED|| Firefox 45
|}
|}
</div></div>
</div></div>
Line 206: Line 208:
[https://bugzilla.mozilla.org/show_bug.cgi?id=1218368 Bug 1218368] - Search engines like Aol.com and Wow.com can't be added on the list of search engines from the Search Toolbar.<br/>
[https://bugzilla.mozilla.org/show_bug.cgi?id=1218368 Bug 1218368] - Search engines like Aol.com and Wow.com can't be added on the list of search engines from the Search Toolbar.<br/>
[https://bugzilla.mozilla.org/show_bug.cgi?id=1226608 Bug 1226608] - When restore a removed search engine, Google is set the default search engine <br />
[https://bugzilla.mozilla.org/show_bug.cgi?id=1226608 Bug 1226608] - When restore a removed search engine, Google is set the default search engine <br />
[https://bugzilla.mozilla.org/show_bug.cgi?id=1227045 Bug 1227045] - The default search engine is not kept after selecting the "restore default search engines"
[https://bugzilla.mozilla.org/show_bug.cgi?id=1227045 Bug 1227045] - The default search engine is not kept after selecting the "restore default search engines"<br />
[https://bugzilla.mozilla.org/show_bug.cgi?id=1228258 Bug 1228258] - One click search aliases should be left trimmed<br />
[https://bugzilla.mozilla.org/show_bug.cgi?id=1228263 Bug 1228263] - One click search alias save issue<br />[https://bugzilla.mozilla.org/show_bug.cgi?id=1229678 Bug 1229678] - Change search settings inaccessible under search engine list load<br />
 
[https://bugzilla.mozilla.org/show_bug.cgi?id=1228318 Bug 1228318] - Checklist for one click engine aren't restored when "Restore Default Engines" is used<br />
[https://bugzilla.mozilla.org/show_bug.cgi?id=1229685 Bug 1229685] - Aliasses function only in address bar<br />
[https://bugzilla.mozilla.org/show_bug.cgi?id=1228594 Bug 1228594] - Firefox Search toolbar is not restored when Yandex Extension is removed<br />
 
</div>
</div>
</div>
</div>
Line 218: Line 227:
== Results ==
== Results ==
'''Nightly testing'''
'''Nightly testing'''
* [In progress] Full Test  suite results [https://docs.google.com/spreadsheets/d/1xd31SYxmMfr5s-7C0AVS0v4oGDrxvripqgyIAK6Qae0/edit?usp=sharing ]<br />
* {{mdone}} Full Test  suite results [https://docs.google.com/spreadsheets/d/1xd31SYxmMfr5s-7C0AVS0v4oGDrxvripqgyIAK6Qae0/edit?usp=sharing ]<br />
** There were no blockers found while testing this feature.
** There were no blockers found while testing this feature.
** Manual testing covered Windows 7 x64, Windows 8 x64, Windows 8.1 x32  Windows 10 x64, Windows XP x64, Windows Vista x32, Ubuntu 14.04 x32, Ubuntu 15.04 x 64, Mac OS x 10.10, Mac OS x 10.11.
** Manual testing covered Windows 7 x64, Windows 8 x64, Windows 8.1 x32  Windows 10 x64, Windows XP x64, Windows Vista x32, Ubuntu 14.04 x32, Ubuntu 15.04 x 64, Mac OS x 10.10, Mac OS x 10.11.
<br />
<br />


'''Merge to Aurora Sign-off'''
{{mdone|}} '''Merge to Aurora Sign-off''' (2015-12-14)
 
'''Mid-Aurora Sign-off''' (2016-01-11)
* Full Test suite results [https://docs.google.com/spreadsheets/d/1sCNv3h5gVJkT9QKvs8lFVJ0Wpgta-SGsTH3ofyVE0Yw/edit#gid=1652877211 ]<br />
** Manual testing covered Windows 7 x64, Ubuntu 14.04 x32 and Mac OS X 10.9.5.
** There were no new issues found during sign-off.
 
'''Pre-Beta Sign-off''' (2016-01-22)
** Smoke testing covered Windows 7 x64, Ubuntu 14.04 x64 and Mac OS X 10.9.5.
 
'''Pre-Release Sign-off''' (2016-02-29)
** Smoke testing covered Windows 7 x64, Ubuntu 14.04 x64 and Mac OS X 10.9.5.
 


== Checklist ==
== Checklist ==
Line 245: Line 266:
|-
|-
|  Full Functional Tests Execution  
|  Full Functional Tests Execution  
|style="text-align:center;" | {{mprog|}}  
|style="text-align:center;" | {{mdone|}}
|style="text-align:center;" |   
|style="text-align:center;" |   
|-
|  Automation Coverage ||
|style="text-align:center;" | TBD
|-
|-
|  Performance Testing  
|  Performance Testing  
|style="text-align:center;" | N/A ||  
|style="text-align:center;" | N/A ||  
|-
|-
|  All Defects Logged || {{mdone|}} ||  
|  All Defects Logged  
|style="text-align:center;"| {{mdone|}} ||  
|-
|-
|  Critical/Blockers Fixed and Verified || ||  
|  Critical/Blockers Fixed and Verified  
|style="text-align:center;"| {{mdone|}} ||  
|-
|-
|  Daily Status Report (email/etherpad statuses/ gdoc with results) || {{mdone|}} ||
|  Metrics/Telemetry
|-
|style="text-align:center;" | N/A  ||
|  Metrics/Telemetry||
|style="text-align:center;" | TBD
|-
|-
|  UAT Test Cases (signoff By Users)
|  UAT Test Cases (signoff By Users)
|style="text-align:center;" |  N/A  ||  
|style="text-align:center;" |  N/A  ||  
|-
|-
|  QA Signoff  - Nightly Release ||  
|  QA Signoff  - Nightly Release  
|style="text-align:center;" | Email to be sent  
|style="text-align:center;" | {{mdone|}}
|style="text-align:center;" | Email sent: [https://wiki.mozilla.org/images/4/43/Nighty_45_build_-_Search_Refactor_SignOFF_1.pdf Search SignOff email]
 
|-
|  QA Postmortem
|style="text-align:center;" | {{mdone|}}
|style="text-align:center;" | [https://public.etherpad-mozilla.org/p/r.cb6c5a88838a1f3369153af4476ba62f Meeting Notes]
|}
|}
533

edits