QA/Search refactoring: Difference between revisions

 
(12 intermediate revisions by 3 users not shown)
Line 106: Line 106:
|-
|-
| QA - Aurora Testing
| QA - Aurora Testing
|style="text-align:center;" | ||
|style="text-align:center;" | 11.30.2015 || 01.25.2016
|-
|-
| QA - Beta Testing  
| QA - Beta Testing  
|style="text-align:center;" | ||  
|style="text-align:center;" | 01.26.2016 ||  
|-
|-
| Release Date  
| Release Date  
Line 227: Line 227:
== Results ==
== Results ==
'''Nightly testing'''
'''Nightly testing'''
* [In progress] Full Test  suite results [https://docs.google.com/spreadsheets/d/1xd31SYxmMfr5s-7C0AVS0v4oGDrxvripqgyIAK6Qae0/edit?usp=sharing ]<br />
* {{mdone}} Full Test  suite results [https://docs.google.com/spreadsheets/d/1xd31SYxmMfr5s-7C0AVS0v4oGDrxvripqgyIAK6Qae0/edit?usp=sharing ]<br />
** There were no blockers found while testing this feature.
** There were no blockers found while testing this feature.
** Manual testing covered Windows 7 x64, Windows 8 x64, Windows 8.1 x32  Windows 10 x64, Windows XP x64, Windows Vista x32, Ubuntu 14.04 x32, Ubuntu 15.04 x 64, Mac OS x 10.10, Mac OS x 10.11.
** Manual testing covered Windows 7 x64, Windows 8 x64, Windows 8.1 x32  Windows 10 x64, Windows XP x64, Windows Vista x32, Ubuntu 14.04 x32, Ubuntu 15.04 x 64, Mac OS x 10.10, Mac OS x 10.11.
<br />
<br />


'''Merge to Aurora Sign-off'''
{{mdone|}} '''Merge to Aurora Sign-off''' (2015-12-14)
 
'''Mid-Aurora Sign-off''' (2016-01-11)
* Full Test suite results [https://docs.google.com/spreadsheets/d/1sCNv3h5gVJkT9QKvs8lFVJ0Wpgta-SGsTH3ofyVE0Yw/edit#gid=1652877211 ]<br />
** Manual testing covered Windows 7 x64, Ubuntu 14.04 x32 and Mac OS X 10.9.5.
** There were no new issues found during sign-off.
 
'''Pre-Beta Sign-off''' (2016-01-22)
** Smoke testing covered Windows 7 x64, Ubuntu 14.04 x64 and Mac OS X 10.9.5.
 
'''Pre-Release Sign-off''' (2016-02-29)
** Smoke testing covered Windows 7 x64, Ubuntu 14.04 x64 and Mac OS X 10.9.5.
 


== Checklist ==
== Checklist ==
Line 254: Line 266:
|-
|-
|  Full Functional Tests Execution  
|  Full Functional Tests Execution  
|style="text-align:center;" | {{mprog|}}  
|style="text-align:center;" | {{mdone|}}
|style="text-align:center;" |   
|style="text-align:center;" |   
|-
|  Automation Coverage ||
|style="text-align:center;" | TBD
|-
|-
|  Performance Testing  
|  Performance Testing  
|style="text-align:center;" | N/A ||  
|style="text-align:center;" | N/A ||  
|-
|-
|  All Defects Logged || {{mdone|}} ||
|  All Defects Logged  
|-
|style="text-align:center;"| {{mdone|}} ||  
|  Critical/Blockers Fixed and Verified || {{mdone|}} ||  
|-
|-
Daily Status Report (email/etherpad statuses/ gdoc with results) || {{mdone|}} ||  
Critical/Blockers Fixed and Verified
|style="text-align:center;"| {{mdone|}} ||  
|-
|-
|  Metrics/Telemetry
|  Metrics/Telemetry
Line 275: Line 284:
|style="text-align:center;" |  N/A  ||  
|style="text-align:center;" |  N/A  ||  
|-
|-
|  QA Signoff  - Nightly Release ||  
|  QA Signoff  - Nightly Release  
|style="text-align:center;" | Email to be sent  
|style="text-align:center;" | {{mdone|}}
|style="text-align:center;" | Email sent: [https://wiki.mozilla.org/images/4/43/Nighty_45_build_-_Search_Refactor_SignOFF_1.pdf Search SignOff email]
 
|-
|  QA Postmortem
|style="text-align:center;" | {{mdone|}}
|style="text-align:center;" | [https://public.etherpad-mozilla.org/p/r.cb6c5a88838a1f3369153af4476ba62f Meeting Notes]
|}
|}
533

edits