Firefox:1.5.0.10-2.0.0.2:Test Plan:Distro Test Results: Difference between revisions

m
Reverted edit of Ima Dumfuk, changed back to last version by Jbecerra
m (Reverted edit of Ima Dumfuk, changed back to last version by Jbecerra)
 
(29 intermediate revisions by 3 users not shown)
Line 2: Line 2:


== Non-Google/Yahoo Builds (Spotchecks) ==
== Non-Google/Yahoo Builds (Spotchecks) ==
Partner Builds [http://people.mozilla.com/files/testing/partners/]  
Partner Builds [http://people.mozilla.com/files/testing/partners/] (This link had been copied over from a previous wiki).
 
Partner Builds from our releases directory: [http://releases.mozilla.org/pub/mozilla.org/firefox/releases/partners/ This link is from our releases directory]
 
Note: Earlier tests were done using the latest RC's in the testing directory.


Quick Guide to Testing Distros [https://intranet.mozilla.org/Firefox:Distribution:TestPlan]
Quick Guide to Testing Distros [https://intranet.mozilla.org/Firefox:Distribution:TestPlan]
Line 40: Line 44:
[https://intranet.mozilla.org/index.php?title=Firefox:Distribution:1.5.0.10_Test_Results 1510 Distro Results]
[https://intranet.mozilla.org/index.php?title=Firefox:Distribution:1.5.0.10_Test_Results 1510 Distro Results]


== Google (spot checks) ==
== Google ==
Google is Windows only.  Testing Tier 1 and CJKT locales only. For each build, spot check the following:
Google is Windows only.  Testing Tier 1 and CJKT locales only. For each build, spot check the following:
* Start page - tools.google.com/firefox/fftb or tools.google.com/firefox/fftb/intl/<locale>
* Start page - tools.google.com/firefox/fftb or tools.google.com/firefox/fftb/intl/<locale>
Line 79: Line 83:
|| 1.5.0.9 -> 1.5.0.10 '''PASS'''
|| 1.5.0.9 -> 1.5.0.10 '''PASS'''
|}
|}
=== Google non-CJKT Updates Test Results ===
Tester: tchung
* 1.5.0.9 -> 1.5.0.10
* Locale: en-US
* Type: partial + fallback
* Build ID: Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:1.8.0.10) Gecko/20070216 Firefox/1.5.0.10
* Talkback ID: 2007021601
* Notes: did a partial + fallback update.  Success.
Tester: tchung
* 1.5.0.9 -> 1.5.0.10
* Locale: de
* Type: partial
* Build ID: Mozilla/5.0 (Windows; U; Windows NT 5.1; de; rv:1.8.0.10) Gecko/20070216 Firefox/1.5.0.10
* Talkback ID: 2007021601
* Notes: did a partial update.  Success.
Tester: tchung
* 1.5.0.9 -> 1.5.0.10
* Locale: en-GB
* Type: complete
* Build ID: Mozilla/5.0 (Windows; U; Windows NT 5.1; en-GB; rv:1.8.0.10) Gecko/20070216 Firefox/1.5.0.10
* Talkback ID: 2007021601
* Notes: did a complete update with bookmarks and saved links.  Success.
Tester: tchung
* 1.5.0.9 -> 1.5.0.10
* Locale: es-ES
* Type: partial
* Build ID: Mozilla/5.0 (Windows; U; Windows NT 5.1; es-ES; rv:1.8.0.10) Gecko/20070216 Firefox/1.5.0.10
* Talkback ID: 2007021601
* Notes: did a partial update. Success.
==== Google Live Updates ====
* 1509-15010, google, en-US, partial, juanb: '''PASS'''
** User Agent: Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:1.8.0.10) Gecko/20070216 Firefox/1.5.0.10
** Build IDs: 2006120612-2007021601
* 1507-15010, google, ko, complete, juanb: '''PASS'''
** User Agent: Mozilla/5.0 (Windows; U; Windows NT 5.1; ko; rv:1.8.0.10) Gecko/20070216 Firefox/1.5.0.10
** Build IDs: 2006090918-2007021601
* 1506-15010, Seznam, cs, complete, juanb: '''PASS'''
** User Agent: Mozilla/5.0 (Windows; U; Windows NT 5.1; cs; rv:1.8.0.10) Gecko/20070216 (CK-seznam) Firefox/1.5.0.10
** Build IDs: 2006072814-2007021601
* 1507-15010, Packard, en-GB, complete, juanb: '''PASS'''
** User Agent: Mozilla/5.0 (Windows; U; Windows NT 5.1; en-GB; rv:1.8.0.10) Gecko/20070216 Firefox/1.5.0.10
** Build IDs: 2006090918-2007021601


== Yahoo CJKT ==
== Yahoo CJKT ==
* Start page - tools.google.com/firefox/fftb or tools.google.com/firefox/fftb/intl/<locale>
* Start page - http://<locale>.www.mozilla.com/<locale>/firefox/2.0/firstrun/
* Home Page
* Home Page
** url: <locale>.google.mozilla.com/firefox
** url: http://<locale>.yahoo.mozilla.com/firefox
** Google branded Firefox Start Page
** Yahoo! branded Firefox Start Page
* Search
* Search
** Google default search bar engine.
** Yahoo! default search bar engine.
** url: www.google.com/search
** url: <locale>start.mozilla.com/firefox
** rls=com.google:<locale>:official
** rls=org.mozilla:<locale>:official
** client=firefox-a
** client=N/A
* app.update.channel: release-google
* app.update.channel: release-yahoo
** For testing, use "releasetest-google" or "releasetest-yahoo"
** For testing, use "releasetest-yahoo" or "betatest-yahoo"
* keyword.URL: http://www.google.com/search?btnI=I%27m+Feeling+Lucky&ie=UTF-8&oe=UTF-8&q=
* keyword.URL: http://www.google.com/search?btnI=I%27m+Feeling+Lucky&ie=UTF-8&oe=UTF-8&q= '''NEED TO VERIFY'''
* User Agent:  
* User Agent:  
* Talkback BuildID:  
* Talkback BuildID:  
Line 103: Line 157:
|-
|-
|bgcolor=#D5D5D4|'''ja'''
|bgcolor=#D5D5D4|'''ja'''
||  
|| '''PASS''' (2007021601 retested on 2/27)
|| 1.5.0.7 -> 1.5.0.10  
|| 1.5.0.7 -> 1.5.0.10 '''PASS'''
|-
|-
|bgcolor=#D5D5D4|'''ko'''
|bgcolor=#D5D5D4|'''ko'''
||  
|| '''PASS''' (2007021601)
|| 1.5.0.9 -> 1.5.0.10 '''PASS'''
|| 1.5.0.7 -> 1.5.0.10 '''PASS'''
|-
|-
|bgcolor=#D5D5D4|'''zh-TW'''
|bgcolor=#D5D5D4|'''zh-TW'''
||
|| '''PASS''' (2007021601)
|| 1.5.0.9 -> 1.5.0.10  
|| 1.5.0.7 -> 1.5.0.10 '''PASS'''
|-
|-
|bgcolor=#D5D5D4|'''zh-CN'''
|bgcolor=#D5D5D4|'''zh-CN'''
||  
|| '''PASS''' (2007021601)
|| 1.5.0.9 -> 1.5.0.10  
|| 1.5.0.9 -> 1.5.0.10 '''PASS'''
|}
|}


=== Yahoo CJKT Updates Test Results ===
Tester: tchung - '''PASS'''
* 1.5.0.7 -> 1.5.0.10
* Locale: ko
* Type: complete
* Build ID: Mozilla/5.0 (Windows; U; Windows NT 5.1; ko; rv:1.8.0.10) Gecko/20070216 Firefox/1.5.0.10
* Talkback ID: 2007021601
* Notes: complete update.  Success.


=== Branding spot checks ===
Tester: tchung - '''FAILED'''  Retested.  '''PASSED 2/27/07'''
{| class="fullwidth-table"
* 1.5.0.9 -> 1.5.0.10
|- style="background:#D5D5D4; color:black"
* Locale: ja
|| '''Locale'''
* Type: partial
|| '''Windows''' (buildID)
* Build ID:
|| '''Mac'''  (buildID)
* Talkback ID:
|| '''Linux''' (buildID)
* Noted: updates are not working for yahoo japan.  I have pointed to releasetest-yahoo channel, but its not triggering the aus2 server.  I triggered HTTP headers, and it does ping back with:
|-
  uri=https://aus2.mozilla.org/update/1/Firefox/1.5.0.7/2006090622/WINNT_x86/ja/betatest-yahoo/update.xml
|bgcolor=#D5D5D4|'''ja'''
* UPDATED: I was testing the RC5 build of ja, instead of the RC6 build.  Thus, updates was not enabled for RC5, which is why it was failing.  Restoring RC6 showed updates to 1.5.0.10 was successful.
|| '''PASS'''
||
||
|-
|bgcolor=#D5D5D4|'''ko'''
|| '''PASS'''
||
||
|-
|bgcolor=#D5D5D4|'''zh-CN'''
|| '''PASS'''
||
||
|-
|bgcolor=#D5D5D4|'''zh-TW'''
|| '''PASS'''
||
||
|}


== Yahoo CJKT Updates Test Results ==
Tester: tchung - '''PASS'''
Tester: tchung
* 1.5.0.7 -> 1.5.0.10
* 1.5.0.7 -> 1.5.0.10
* Locale: ko
* Locale: zh-CN
* Type: partial + fallback
* Type: complete
* Build ID: Mozilla/5.0 (Windows; U; Windows NT 5.1; ko; rv:1.8.0.10) Gecko/20070216 Firefox/1.5.0.10
* Build ID: Mozilla/5.0 (Windows; U; Windows NT 5.1; ko; rv:1.8.0.10) Gecko/20070216 Firefox/1.5.0.10
* Talkback ID: 2007021601
* Talkback ID: 2007021601
* Notes: partial update.  Success.
* Notes: complete update.  Success.


 
Tester: tchung - '''PASS'''
 
* 1.5.0.7 -> 1.5.0.10
 
* Locale: zh-TW
== Google non-CJKT Updates Test Results ==
Tester: tchung
* 1.5.0.9 -> 1.5.0.10
* Locale: en-US
* Type: partial + fallback
* Type: partial + fallback
* Build ID: Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:1.8.0.10) Gecko/20070216 Firefox/1.5.0.10
* Build ID: Mozilla/5.0 (Windows; U; Windows NT 5.1; ko; rv:1.8.0.10) Gecko/20070216 Firefox/1.5.0.10
* Talkback ID: 2007021601
* Talkback ID: 2007021601
* Notes: did a partial + fallback update.  Success.
* Notes: partial + fallback update.  Success.


Tester: tchung
Tester: juanb - '''PASS'''
* 1.5.0.9 -> 1.5.0.10
* 1.5.0.9 -> 1.5.0.10
* Locale: de
* Locale: ja
* Type: partial
* Type: partial
* Build ID: Mozilla/5.0 (Windows; U; Windows NT 5.1; de; rv:1.8.0.10) Gecko/20070216 Firefox/1.5.0.10
* Build ID: 2007021601
* Talkback ID: 2007021601
* Notes: Originally the test failed because we were using an RC5 build. When we used the latest RC build (rc6) the update went through successfully.
* Notes: did a partial update.  Success.


Tester: tchung
Tester: juanb - '''PASS'''
* 1.5.0.9 -> 1.5.0.10
* 1.5.0.7 -> 1.5.0.10
* Locale: en-GB
* Locale: ja
* Type: complete
* Type: complete
* Build ID: Mozilla/5.0 (Windows; U; Windows NT 5.1; en-GB; rv:1.8.0.10) Gecko/20070216 Firefox/1.5.0.10
* Build ID: 2006090918-2007021601
* Talkback ID: 2007021601
 
* Notes: did a complete update with bookmarks and saved links.  Success.
==== Yahoo Live Updates ====
* 1507-15010, Yahoo, ja, complete, juanb: '''PASS'''
** User Agent: Mozilla/5.0 (Windows; U; Windows NT 5.1; ja; rv:1.8.0.10) Gecko/20070216 Firefox/1.5.0.10
** Build IDs: 2006090918-2007021601
 
* 1509-15010, Yahoo, ko, Mac OSX, partial, juanb: '''FAIL'''
** NOTES: rhelmer investigating, but we don't have a mac partial.
 
* 1509-15010, Yahoo, ko, Mac OSX, fallback (see above), juanb: '''PASS'''
** User Agent:
** Build IDs: 2006120612-2007021600
** Notes: The fallback update (complete mar), after the partial fails, is downloaded successfully and it is applied.
 
* 1509-15010, Yahoo, ja, Windows, partial, juanb: '''PASS'''
** User Agent:
** Build IDs: 2006120612-2007021600
 
* 1509-15010, Yahoo, zh-TW, Linux, partial, juanb: '''PASS'''
** User Agent:
** Build IDs: 2006120612-2007021600


Tester: tchung
* 1507-15010, Yahoo, ja, Linux, complete, juanb: '''PASS'''
* 1.5.0.9 -> 1.5.0.10
** User Agent:
* Locale: es-ES
** Build IDs: 2006090918-2007021600
* Type: partial
* Build ID: Mozilla/5.0 (Windows; U; Windows NT 5.1; es-ES; rv:1.8.0.10) Gecko/20070216 Firefox/1.5.0.10
* Talkback ID: 2007021601
* Notes: did a partial update. Success.


= 2.0.0.2 =
== Branding Tests ==
== Google ==
[https://intranet.mozilla.org/index.php?title=Firefox:Distribution:1.5:Google:1.5.0.10_Test_Results 1510 Results]
[https://intranet.mozilla.org/index.php?title=Firefox:Distribution:1.5:Google:1.5.0.10_Test_Results 1510 Results]


Line 201: Line 252:


[https://intranet.mozilla.org/index.php?title=Firefox:Distribution:2.0:Google:2.0.0.1_Test_Results ''2001 Reference'']
[https://intranet.mozilla.org/index.php?title=Firefox:Distribution:2.0:Google:2.0.0.1_Test_Results ''2001 Reference'']
=== Update spot checks ===
* en-US 2.0.0.1 -> 2.0.0.2 partial
* en-GB 2.0.0.1 -> 2.0.0.2 partial+fallback
* fr 2.0.0.1 -> 2.0.0.2 partial
* ja 2.0.0.0 -> 2.0.0.2 full
Confirmed users
503

edits