MozillaWiki

Stub Installer/QA: Difference between revisions

Page Discussion

Stub Installer/QA (view source)

Revision as of 21:15, 1 May 2013

1,559 bytes added ,  1 May 2013
no edit summary
No edit summary
 
(44 intermediate revisions by 6 users not shown)
Line 90: Line 90:


Spot check downloading and installing stub installer builds from https://www.mozilla.org/en-US/firefox/aurora/ to ensure that the right builds are served and installed correctly.
Spot check downloading and installing stub installer builds from https://www.mozilla.org/en-US/firefox/aurora/ to ensure that the right builds are served and installed correctly.
==== Peer Sign-off ====
A peer on the Desktop QA team has to signoff on this test plan to declare signoff on the build.
=== Funnelcake Beta ===
==== Builds ====
* [https://ftp.mozilla.org/pub/mozilla.org/firefox/releases/stub/Firefox%2017.0b1%20Beta%20Stub%20Installer.exe Stub Installer]
* [http://ftp.mozilla.org/pub/mozilla.org/firefox/candidates/17.0b1-candidates/build2/partner-repacks/funnelcake15/win32/en-US/ Funnelcake Full Installer]
==== Checklist ====
* {{done|}} Smoke and basic functional test pass on Beta Stub Installer
** {{done|}} Marcia: Windows Vista
** {{done|}} John: Windows 7
** {{done|}} Jason: Windows XP
* {{done|}} Spot check the Beta Full Installer with Funnelcake bits
** Juan is owning this
* {{done|}} Spot check the Beta stub installer with Funnelcake bits
** Juan and Jason is owning this
* {{done|}} Exploratory test pass on Beta
** {{done|}} Marcia: Windows Vista
** {{done|}} Juan: Windows 7
** {{done|}} Juan: Windows XP
* {{done|}} Peer Sign-off
** Juan and Jason are owning this
==== Smoke and Basic Functional Test Pass on Beta ====
Do a smoke and basic functional test pass against the Beta builds to make sure nothing serious shows up incorrectly in the builds. To check these builds, we will run the Stub Installer - Beta Signoff test run in Desktop Firefox 19 for each operating system listed.
==== Spot Check the Beta Full Installer with Funnelcake Bits ====
Spot check the funnelcake build for beta for the full installer by checking the following:
* Make sure that firefox installs
* Make sure the fc string is correct for the first run page
* Make sure the about:config update channel is correct
* Make sure you can load a website, open a new tab, crash firefox with the crash reporter
* Make sure in about firefox mentions something about funnelcake with the right funnelcake version
* Make sure app.partner.mozilla15 is set in about:config
==== Spot Check the Beta Stub Installer with Funnelcake Bits ====
Spot check the funnelcake build for beta for the stub installer by checking the following:
* Make sure that firefox installs
* Make sure the fc string is correct for the first run page
* Make sure the about:config update channel is correct
* Make sure you can load a website, open a new tab, crash firefox with the crash reporter
* Make sure the about:config funnelcake setting is set
* Make sure app.partner.mozilla16 is set in about:config
==== Exploratory Test Pass on Beta ====
Exploratory test the stub installer on beta by trying the following scenarios:
* After launching the stub installer, change the screen resolution to a few different values on your machine. Verify that the artwork does not get pixelated or patched.
* Try launching the stub installer multiple times - make sure only one instance of the stub installer is active
* Try a pave-over install while firefox is running twice in a row. Then, close firefox and try to re-launch it. Then, you should get a prompt to restart your computer. Upon completing a restart, try launching firefox again. It should launch with no restart required prompt.
* Try installing firefox with the stub installer at different user account levels with the stub installer.


==== Peer Sign-off ====
==== Peer Sign-off ====
Line 192: Line 130:
* STATUS {{bug|811573}} Add more data points to the metrics ping for the stub installer (tester)
* STATUS {{bug|811573}} Add more data points to the metrics ping for the stub installer (tester)
* {{done|}} VERIFIED {{bug|829207}} Fix Expires header settings for firefox nightly/aurora (Virgil)
* {{done|}} VERIFIED {{bug|829207}} Fix Expires header settings for firefox nightly/aurora (Virgil)
* {{done|}} VERIFIED {{bug|797998}} In the "download phase" of the stub installer without an internet connection, the stub installer should eventually time out and report an error
* STATUS Commented {{bug|797998}} In the "download phase" of the stub installer without an internet connection, the stub installer should eventually time out and report an error (Virgil)
* STATUS Commented {{bug|848794}} Can't re-run Firefox stub installer after cancelling Install (Virgil)
* STATUS Commented {{bug|848794}} Can't re-run Firefox stub installer after cancelling Install (Virgil)


Line 213: Line 151:
  |-
  |-
  | Windows 7 32-bit en-US
  | Windows 7 32-bit en-US
  | FAIL - Bug 849233 (Mihaela)
  | PASS (Mihaela)
  | PASS(Mihaela)
  | PASS (Mihaela)
  | PASS(Mihaela)
  | PASS (Mihaela)
  |-
  |-
  | Windows Vista en-US
  | Windows Vista en-US
  | Fail - Bug 848789 (Simona)
  | Fail - Bug 848789 (Simona)
  | Fail - Bug 849233 (Simona)
  | PASS (Simona)
  | In progress (Simona)
  | Fail - Bugs: 849803, 849818  (Simona)
  |-
  |-
  | Windows 8 64-bit en-US
  | Windows 8 64-bit en-US
  | FAIL (Cornel) - First Run page is not shown
  | Pass (Cornel)  
  | FAIL (Cornel) - bug 797998
  | PASS (Cornel)
  | PASS (Cornel)
  | PASS (Cornel)
  |}
  |}


==== Issues ====
==== Issues ====
* '''BLOCKER''' {{bug|731299}} Create bouncer links for Aurora downloads - ''Blocks testing localized stub installers''
* NEW
* NEW {{bug|849199}} - Stub installer: Flicker when reaching the Install phase (Virgil)
** {{bug|849803}} [Guest] UAC prompts twice when installing Firefox using the stub installer (Simona)
* NEW {{bug|849233}} - All the builds installed with the stub installer have the same Build ID (Simona)
** {{bug|849818}} [Vista] OS restart required after pave over install while Firefox running (Simona)
* {{ok|}} '''BLOCKER''' {{bug|848794}} - Can't re-run Firefox stub installer after cancelling Install (Virgil)
* {{ok|}}
* {{drop|}} {{bug|848789}} - First run page not displayed after installing Aurora - both stub and old installer (Virgil) - ''Not a Stub Installer bug''
** {{bug|849233}} All the builds installed with the stub installer have the same Build ID (Simona)
* {{done|}} {{bug|849130}} - Localized Stub-Installer installs en-US build (Mihaela) - ''Duplicate of {{bug|731299}}''
** {{bug|849199}} Flicker when reaching the Install phase (Virgil)
* NEW {{bug|849803}} - On a guest account - UAC prompts twice when installing Firefox using the stub installer
** {{bug|731299}} Create bouncer links for Aurora downloads - ''Blocks testing localized stub installers''
* {{done|}}
** {{bug|849130}} Localized Stub-Installer installs en-US build (Mihaela) - ''Duplicate of {{bug|731299}}''
** {{bug|848794}} Can't re-run Firefox stub installer after cancelling Install (Virgil) - ''Verified fixed''
* {{drop|}}
** {{bug|848789}} First run page not displayed after installing Aurora (Virgil) - ''Not a Stub Installer bug''
 
=== Funnelcake / Stub Installer Beta 20.0b4 ===
 
==== Builds ====
* [http://ftp.mozilla.org/pub/mozilla.org/firefox/candidates/20.0b4-candidates/build1/firefox-20.0.en-US.win32.installer-stub.exe Beta Stub Installer]
* [http://ftp.mozilla.org/pub/mozilla.org/firefox/candidates/20.0b4-candidates/build1/partner-repacks/funnelcake19/ Funnelcake Full Installer v19]
* [http://ftp.mozilla.org/pub/mozilla.org/firefox/candidates/20.0b4-candidates/build1/partner-repacks/funnelcake20/ Funnelcake Full Installer v20]
* [https://bugzilla.mozilla.org/show_bug.cgi?id=848794 Verify Bug 848794]


=== Beta 20 Sign-off ===
==== Funnelcake Checklist ====
* {{done|}} Installation and functionality spot check with [http://ftp.mozilla.org/pub/mozilla.org/firefox/candidates/20.0b4-candidates/build1/firefox-20.0.en-US.win32.installer-stub.exe Stub Installer (Beta)]
** {{done|}} Paul: Windows XP
** {{done|}} Cornel: Windows 7
** {{done|}} Simona: Windows Vista
* {{done|}} Installation and functionality spot check with [http://ftp.mozilla.org/pub/mozilla.org/firefox/candidates/20.0b4-candidates/build1/partner-repacks/funnelcake19/ Funnelcake Full Installer v19 (Beta)]
** {{done|}} juanb: Windows XP
** {{done|}} Cornel: Windows 7
** {{done|}} Simona: Windows Vista
* {{done|}} Installation and functionality spot check with [http://ftp.mozilla.org/pub/mozilla.org/firefox/candidates/20.0b4-candidates/build1/partner-repacks/funnelcake20/ Funnelcake Full Installer v20 (Beta)]
** {{done|}} juanb: Windows XP
** {{done|}} Cornel: Windows 7
** {{done|}} Simona: Windows Vista
 
==== Spot Check Stub Installer (Beta) ====
Use same smoketest methodology as in Aurora.
 
==== Spot Check Funnelcake Full Installer (Beta) ====
Spot check the funnelcake build for beta for the full installer by checking the following:
 
* Make sure that firefox installs
* Make sure the funnelcake string is correct for the first run page
<pre> http://www.mozilla.org/en-US/firefox/20.0/firstrun/?f=19 </pre>
<pre> http://www.mozilla.org/en-US/firefox/20.0/firstrun/?f=20 </pre>
* Make sure the about:config update channel is correct
<pre> beta </pre>
* Make sure you can load a website, open a new tab, crash firefox with the crash reporter
* Make sure in About Firefox dialog contains the right information:
<pre> Funnelcake Mar 2013 mozilla19 - 1.0 </pre>
<pre> Funnelcake Mar 2013 mozilla20 - 1.0 </pre>
* Make sure partner config preference is set correctly in about:config
<pre> app.partner.mozilla19 = mozilla19 </pre>
<pre> app.partner.mozilla20 = mozilla20 </pre>
 
==== Issues ====
* NEW
** {{bug|850192}} Stub installer process stays opened after the install is finished (Simona)
 
 
=== Funnelcake / Stub Installer 20.0.1 ===
 
==== Builds ====
* [http://ftp.mozilla.org/pub/mozilla.org/firefox/releases/20.0.1/win32/en-US/ Beta Stub Installer]
* [http://download.mozilla.org/?product=firefox-20.0.1-funnelcake21&os=win&lang=en-US Funnelcake Full Installer v21]
* [http://download.mozilla.org/?product=firefox-20.0.1-funnelcake22&os=win&lang=en-US Funnelcake Full Installer v22]
 
==== Funnelcake Checklist ====
* {{done|}} Installation and functionality spot check with [http://ftp.mozilla.org/pub/mozilla.org/firefox/releases/20.0.1/win32/en-US/ Stub Installer]
** {{done|}} retornam, juanb: Windows XP
** {{done|}} juanb: Windows 7
** {{done|}} juanb: Windows Vista
* {{done|}} Installation and functionality spot check with [http://download.mozilla.org/?product=firefox-20.0.1-funnelcake21&os=win&lang=en-US Funnelcake Full Installer v21]
** {{done|}} juanb: Windows 7
** {{done|}} juanb: Windows XP
* {{done|}} Installation and functionality spot check with [http://download.mozilla.org/?product=firefox-20.0.1-funnelcake22&os=win&lang=en-US Funnelcake Full Installer v22]
** {{done|}} juanb: Windows 7
** {{done|}} juanb: Windows Vista
 
==== Spot Check Funnelcake Full Installer  ====
Spot check the funnelcake build for the full installer by checking the following:
 
* Make sure that firefox installs
* Make sure the funnelcake string is correct for the first run page
<pre> http://www.mozilla.org/en-US/firefox/20.0.1/firstrun/?f=21 </pre>
<pre> http://www.mozilla.org/en-US/firefox/20.0.1/firstrun/?f=22 </pre>
* Make sure the about:config update channel is correct
<pre> release </pre>
* Make sure you can load a website, open a new tab, crash firefox with the crash reporter
* Make sure in About Firefox dialog contains the right information:
<pre> Funnelcake April 2013 mozilla21 - 1.0 </pre>
<pre> Funnelcake April 2013 mozilla22 - 1.0 </pre>
* Make sure partner config preference is set correctly in about:config
<pre> app.partner.mozilla21 = mozilla21 </pre>
<pre> app.partner.mozilla22 = mozilla22 </pre>
 
==== Issues ====
* NEW
** {{bug|850192}} Stub installer process stays opened after the install is finished (tester)
Jbecerra
canmove, Confirmed users
7,810

edits

Retrieved from "https://wiki.mozilla.org/Special:MobileDiff/606337...651242"