QA/Execution/Web Testing/Browser Matrix: Difference between revisions

(New page: = '''Thunderbird 1.5.0.13 (rc1)''' = {| class="fullwidth-table" ! ! Windows XP SP2 ! Windows Vista ! Mac ! Linux |- | Firefox < 2.0.0.6 | en-US (partial+fallback)<br>'''PASS'''<br><br>es-...)
 
 
(33 intermediate revisions by 2 users not shown)
Line 1: Line 1:
= '''Thunderbird 1.5.0.13 (rc1)''' =
#REDIRECT [[QA/Execution/Web Testing/Template]]
 
= '''Web browser testing matrix template''' =
{| class="fullwidth-table"
{| class="fullwidth-table"
!  
!  
Line 7: Line 9:
! Linux
! Linux
|-
|-
| Firefox < 2.0.0.6
| Firefox < = 2.0.0.12
| en-US (partial+fallback)<br>'''PASS'''<br><br>es-ES (partial)<br>'''PASS'''<br><br>de(partial+fallback)<br>'''PASS'''
| P1


| en-US (partial + fallback)<br>'''PASS'''<br><br>ja-jp (partial)<br>'''PASS'''
| P1


| en-US (partial + fallback)<br>'''PASS'''<br><br>ko (partial+fallback)<br>'''PASS'''
| P1
 
| P1
| en-US (partial+fallback)<br>'''PASS'''<br><br>fi (partial)<br>'''PASS'''
|-
|-
|-
| Internet Explorer 7
| P1
| P1
| '''N/A'''
| '''N/A'''
|-
|-
| 1.5.0.10
| Internet Explorer 6
| en-US (partial+fallback)<br>'''PASS'''<br><br>es-ES (partial)<br>'''PASS'''<br><br>de(partial+fallback)<br>'''PASS'''
| P1


| en-US (partial + fallback)<br>'''PASS'''<br><br>ja-jp (partial)<br>'''PASS'''
| '''N/A'''


| en-US (partial + fallback)<br>'''PASS'''<br><br>ko (partial+fallback)<br>'''PASS'''
| '''N/A'''


| en-US (partial+fallback)<br>'''PASS'''<br><br>fi (partial)<br>'''PASS'''
| '''N/A'''
|-
|-
| 1.5.0.9
| Opera 9.25
| en-US (partial+fallback)<br>'''PASS'''<br><br>es-ES (partial)<br>'''PASS'''
| P2
 
| P2
| en-US (partial + fallback)<br>'''PASS'''<br><br>ja-jp (partial)<br>'''PASS'''
| P2
 
| P2
| en-US (partial + fallback)<br>'''PASS'''<br><br>fr (partial+fallback)<br>'''PASS'''
 
| en-US (partial+fallback)<br>'''PASS'''<br><br>fi (partial)<br>'''PASS'''
 
|-
|-


| Safari 2.0.4 / 3.0
| P1
| P1
| P1
| '''N/A'''
|-
|-
| 1.5.0.7
| Flock 1.09
| en-US (complete)<br>'''PASS'''<br><br>de (complete)<br>'''PASS'''
| P2
| P2
| P2
| P2
|}


| en-US (complete)<br>'''PASS'''
Issues raised:
| en-US (complete)<br>'''PASS'''<br><br> fi (complete)<br>'''PASS'''
| en-US (complete)<br>'''PASS'''


|-
1) Do we want to assume JS is always enabled?<br>
| 1.5
* No; for P1s, test both enabled and disabled
| en-US (complete)<br>'''PASS'''
2) What about popups?<br>
| fr (complete)<br>'''PASS'''
* Not a concern at the moment, but keep an eye out for it
|
3) Should we just test defaults?<br>
| nl (complete)<br>'''PASS'''
* Yes, unless specifically requested to do otherwise
|
4) What's considered a blocker?  Do we want a tier system, much like Yahoo! has, WRT 'http://developer.yahoo.com/yui/articles/gbs/ graded support'?<br>
|}
* TBD; varies with each project.  Obviously, major functionality/layout issues would probably be a blocker.
5) Escalation policy if we find major issues?<br>
* There should be both a Project Lead and a QA Lead.  QA Lead is responsible for signing off for his/her team, and for escalating issues.
6) How do we report on our testing results?
* There should be a Wiki table with the results of what was tested, by whom, and when.
7) '''OPEN ISSUE''': What about screen readers and non-graphical browsers?  Mobile testing?

Latest revision as of 21:42, 3 July 2008

Web browser testing matrix template

Windows XP SP2 Windows Vista Mac Linux
Firefox < = 2.0.0.12 P1 P1 P1 P1
Internet Explorer 7 P1 P1 N/A N/A
Internet Explorer 6 P1 N/A N/A N/A
Opera 9.25 P2 P2 P2 P2
Safari 2.0.4 / 3.0 P1 P1 P1 N/A
Flock 1.09 P2 P2 P2 P2

Issues raised:

1) Do we want to assume JS is always enabled?

  • No; for P1s, test both enabled and disabled

2) What about popups?

  • Not a concern at the moment, but keep an eye out for it

3) Should we just test defaults?

  • Yes, unless specifically requested to do otherwise

4) What's considered a blocker? Do we want a tier system, much like Yahoo! has, WRT 'http://developer.yahoo.com/yui/articles/gbs/ graded support'?

  • TBD; varies with each project. Obviously, major functionality/layout issues would probably be a blocker.

5) Escalation policy if we find major issues?

  • There should be both a Project Lead and a QA Lead. QA Lead is responsible for signing off for his/her team, and for escalating issues.

6) How do we report on our testing results?

  • There should be a Wiki table with the results of what was tested, by whom, and when.

7) OPEN ISSUE: What about screen readers and non-graphical browsers? Mobile testing?