QA/testwiki mockup/runs/firefox os/2 2/smoketest 20150307 001/metrics: Difference between revisions

From MozillaWiki
Jump to navigation Jump to search
(Added mock up test result)
 
(→‎Summary: updated count)
 
(One intermediate revision by the same user not shown)
Line 1: Line 1:
<div style="border:1px solid; background-color:lightgrey">This is an example of test result per module</div>
<div style="border:1px solid; background-color:lightgrey">This is an example of test result per module</div>
== Summary ==
== Summary ==
<span style="color:#008000"> 1 PASSED </span> <span style="color:#FF0000"> 1 FAILED </span>
Total 2 cases


= Metrics =
= Metrics =
Line 28: Line 31:
| No SIM || Empty SIM information || <span style="color:#008000">'''PASS'''</span>
| No SIM || Empty SIM information || <span style="color:#008000">'''PASS'''</span>
|-
|-
| 1 SIM || One SIM information ||<span style="color:#FF0000">'''FAIL'''</span> - [[http://bugzilla.mozilla.org|Bug 123456789]] - FTU ping is not transmitting with one SIM
| 1 SIM || One SIM information ||<span style="color:#FF0000">'''FAIL'''</span> - [[http://bugzilla.mozilla.org|Bug 123456789]] - FTU ping is not transmitting with one SIM<div style="border:1px solid; background-color:lightgrey">Reason for failure can be written here</div>
 
|-
|-
| <s>1 SIM with PIN lock</s> || <s>Empty SIM information</s> || skipped in this suite
| <s>1 SIM with PIN lock</s> || <s>Empty SIM information</s> || skipped in this suite <div style="border:1px solid; background-color:lightgrey">We only cherry-pick what we need for a test suite. The others are skipped automatically</div>
|-
|-
| <s>2 SIM</s> || <s>2 SIM information</s> || skipped in this suite
| <s>2 SIM</s> || <s>2 SIM information</s> || skipped in this suite
|}
|}
<div style="border:1px solid; background-color:lightgrey">By adding some specail tags, we can make these test cases runable. Testers can click the PASS and FAIL checkbox while running it.</div>

Latest revision as of 07:21, 7 March 2015

This is an example of test result per module

Summary

1 PASSED 1 FAILED

Total 2 cases

Metrics

Test Environment Setup

(TBD)

Common setup steps and prerequisites can be extracted so you don't repeat them in every test case

FTU Ping

How it works/Spec/UX spec

(How FTU Ping works)

Test Cases

To test the FTU ping, you have to prepare (these precondition)

  1. Flash your phone
  2. Wait for the FTU ping to be transmitted the test server

Expected Behaviour

The ping payload should have the following format: (TBD)

You have to run the above steps with these configurations:

Configuration Expected Test Result
No SIM Empty SIM information PASS
1 SIM One SIM information FAIL - [123456789] - FTU ping is not transmitting with one SIM
Reason for failure can be written here
1 SIM with PIN lock Empty SIM information skipped in this suite
We only cherry-pick what we need for a test suite. The others are skipped automatically
2 SIM 2 SIM information skipped in this suite