MozillaWiki

QA/Loop/Firefox 35: Difference between revisions

< QA‎ | Loop
 
(20 intermediate revisions by 2 users not shown)
Line 11: Line 11:
* Execute a testday for the new feature set
* Execute a testday for the new feature set


= Blockers =
= Smoketest Coverage =
Guest Mode
* Branding ?
* Terms of Service/Privacy (panel, standalone page) https://moztrap.mozilla.org/manage/case/15102/
* Start a conversation https://moztrap.mozilla.org/manage/case/15115/
* Copy a conversation URL https://moztrap.mozilla.org/manage/case/15099/
* Revoke a conversation URL https://moztrap.mozilla.org/manage/case/15117/
* Cancel a call ?
* Join a conversation https://moztrap.mozilla.org/manage/case/15116/
* Video mute/unmute a call https://moztrap.mozilla.org/manage/case/15101/
* Audio mute/unmute a call https://moztrap.mozilla.org/manage/case/15101/
* Leave/rejoin a call https://moztrap.mozilla.org/manage/case/15118/
* Join a call with audio only N/A
* Join a call with video only ?
* Do not disturb mode https://moztrap.mozilla.org/manage/case/15113/, https://moztrap.mozilla.org/manage/case/15114/
* Sign-in https://moztrap.mozilla.org/manage/case/15091/
 
Accounts
* Import contacts https://moztrap.mozilla.org/manage/case/15111/
* Video call https://moztrap.mozilla.org/manage/case/15110/
* Audio call https://moztrap.mozilla.org/manage/case/15109/
* Block/unblock contact https://moztrap.mozilla.org/manage/case/15108/
* Add/edit/remove contact https://moztrap.mozilla.org/manage/case/15105/, https://moztrap.mozilla.org/manage/case/15106/, https://moztrap.mozilla.org/manage/case/15107/
 
Conversation Widget
* Pop-in/out https://moztrap.mozilla.org/manage/case/15085/
* Minimize/Restore https://moztrap.mozilla.org/manage/case/15084/
* Close https://moztrap.mozilla.org/manage/case/15118/
 
Exploratory
* Move conversation tab to a new window https://moztrap.mozilla.org/manage/case/15082/
* Move conversation tab to a new screen https://moztrap.mozilla.org/manage/case/15083/
* Start multiple conversations https://moztrap.mozilla.org/manage/case/15119/
* Test with different locales - ? should refer to the logo (telefonica, o2, vivo, movistar) testing on specific locales ?
* Test with different networks https://moztrap.mozilla.org/manage/case/15120/
* Test with calling a Firefox OS phone
* Test with calling other browsers https://moztrap.mozilla.org/manage/case/15104/
* Test with private browsing https://moztrap.mozilla.org/manage/case/15121/
* Test with session restore https://moztrap.mozilla.org/manage/case/15122/
* Test with themes/addons installed https://moztrap.mozilla.org/manage/case/15123/
 
= Bugs blocking Firefox 35 =
<bugzilla>
<bugzilla>
{
{
  "include_fields":"id,summary,cf_status_firefox35",
  "include_fields":"id,summary,cf_status_firefox35",
  "product":"Loop",
  "product":"Loop",
"component":"Client",
  "f1":"cf_blocking_loop",
  "f1":"cf_blocking_loop",
  "o1":"equals",
  "o1":"equals",
  "v1":"Fx35+"
  "v1":"Fx35+",
"resolution":"FIXED"
}
}
</bugzilla>
</bugzilla>


= QE verifications =
= Bugs needing QE verification =
<bugzilla>
<bugzilla>
{
{
Line 30: Line 73:
  "o1":"anywordssubstr",
  "o1":"anywordssubstr",
  "v1":"fixed verified",
  "v1":"fixed verified",
  "flagtypes.name":"qe-verify+"
  "flagtypes.name":"qe-verify+",
"f2":"flagtypes.name",
"o2":"notequals",
"v2":"qe-verify-"
}
}
</bugzilla>
</bugzilla>


= Tracked Bugs =
= Bugs needing QE review =
<bugzilla>
<bugzilla>
{
"include_fields":"id,summary,cf_status_firefox35",
"product":"Loop",
"f1":"cf_status_firefox35",
"o1":"notequals",
"v1":"---"
}
</bugzilla>
= Triage =
{| class="wikitable collapsible collapsed" style="width:100%"
! style="text-align:left" | Bugs without ''status-firefox35'', set the appropriate status
|-
| <bugzilla>
{
"include_fields":"id,summary",
"product":"Loop",
"resolution":"FIXED",
"target_milestone":"mozilla35",
"f1":"cf_status_firefox35",
"o1":"equals",
"v1":"---"
}
</bugzilla>
|}
{| class="wikitable collapsible collapsed" style="width:100%"
! style="text-align:left" | Bugs without ''qe-verify'', nominate for QE verification
|-
| <bugzilla>
{
{
  "include_fields":"id,summary",
  "include_fields":"id,summary",
Line 82: Line 99:
}
}
</bugzilla>
</bugzilla>
|}
{| class="wikitable collapsible collapsed" style="width:100%"
! style="text-align:left" | Bugs without ''in-moztrap'', nominate for smoketest coverage
|-
| <bugzilla>
{
"include_fields":"id,summary",
"product":"Loop",
"target_milestone":"mozilla35",
"resolution":"FIXED",
"f1":"flagtypes.name",
"o1":"notequals",
"v1":"in-moztrap+",
"f2":"flagtypes.name",
"o2":"notequals",
"v2":"in-moztrap-",
"f3":"flagtypes.name",
"o3":"notequals",
"v3":"in-moztrap?"
}
</bugzilla>
|}
{| class="wikitable collapsible collapsed" style="width:100%"
! style="text-align:left" | Bugs without ''in-testsuite'', nominate for Developer automation coverage
|-
| <bugzilla>
{
"include_fields":"id,summary",
"product":"Loop",
"target_milestone":"mozilla35",
"resolution":"FIXED",
"f1":"flagtypes.name",
"o1":"notequals",
"v1":"in-testsuite+",
"f2":"flagtypes.name",
"o2":"notequals",
"v2":"in-testsuite-",
"f3":"flagtypes.name",
"o3":"notequals",
"v3":"in-testsuite?"
}
</bugzilla>
|}
{| class="wikitable collapsible collapsed" style="width:100%"
! style="text-align:left" | Bugs without ''in-qa-testsuite'', nominate for QA automation coverage
|-
| <bugzilla>
{
"include_fields":"id,summary",
"product":"Loop",
"target_milestone":"mozilla35",
"resolution":"FIXED",
"f1":"flagtypes.name",
"o1":"notequals",
"v1":"in-qa-testsuite+",
"f2":"flagtypes.name",
"o2":"notequals",
"v2":"in-qa-testsuite-",
"f3":"flagtypes.name",
"o3":"notequals",
"v3":"in-qa-testsuite?"
}
</bugzilla>
|}


= Test Coverage =
= Bugs for Volunteers =
== User story bugs pending test coverage review ==
; ''If you're a volunteer and want to help verifying some fixes (or want to learn how) please comment in the bug to identify yourself.''
<bugzilla>
<bugzilla>
{
{
  "include_fields":"id,summary",
  "include_fields":"id,summary",
  "product":"Loop",
  "product":"Loop",
"target_milestone":"mozilla35",
  "f1":"cf_status_firefox35",
"resolution":"FIXED",
  "o1":"equals",
  "f1":"cf_user_story",
  "v1":"fixed",
  "o1":"isnotempty",
  "f2":"status_whiteboard",
"f2":"flagtypes.name",
  "o2":"anywordssubstr",
"o2":"notequals",
  "v2":"[good first verify]"
"v2":"in-moztrap-",
"f3":"flagtypes.name",
"o3":"notequals",
"v3":"in-moztrap+"
}
</bugzilla>
 
== Regression bugs pending test coverage review ==
<bugzilla>
{
"include_fields":"id,summary",
"product":"Loop",
"target_milestone":"mozilla35",
"resolution":"FIXED",
"f1":"keywords",
"o1":"anywordssubstr",
  "v1":"regression",
  "f2":"flagtypes.name",
  "o2":"notequals",
  "v2":"in-moztrap-",
"f3":"flagtypes.name",
"o3":"notequals",
"v3":"in-moztrap+"
}
}
</bugzilla>
</bugzilla>

Latest revision as of 21:47, 16 December 2014

Summary

Owner: Anthony Hughes

This page documents the testing strategy for the Firefox Hello client in Firefox 35.

Sign-off Criteria

  • 0 unresolved blocker bugs
  • 0 unverified qe-verify+ bugs
  • All new use cases covered by smoketests and executed across all platforms without finding new blockers
  • All regression smoketests and automation executed across all platforms without finding new blockers
  • Execute a testday for the new feature set

Smoketest Coverage

Guest Mode

Accounts

Conversation Widget

Exploratory

Bugs blocking Firefox 35

Bugzilla query error

Array ( [type] => error [message] => http-bad-status [params] => Array ( [0] => 400 [1] => Bad Request ) ) 1


Bugs needing QE verification

No results.

0 Total; 0 Open (0%); 0 Resolved (0%); 0 Verified (0%);


Bugs needing QE review

No results.

0 Total; 0 Open (0%); 0 Resolved (0%); 0 Verified (0%);


Bugs for Volunteers

If you're a volunteer and want to help verifying some fixes (or want to learn how) please comment in the bug to identify yourself.

No results.

0 Total; 0 Open (0%); 0 Resolved (0%); 0 Verified (0%);

Retrieved from "https://wiki.mozilla.org/index.php?title=QA/Loop/Firefox_35&oldid=1041591"