QA/Fennec/Milestones/2.0/ReleaseTest/Beta3/Build3

From MozillaWiki
< QA‎ | Fennec‎ | Milestones‎ | 2.0‎ | ReleaseTest/Beta3
Jump to: navigation, search

Testing for bug 620811

12/21: This bug fixes a critical crash in the restart code. Exploratory testing around the fix:

  • Android notifications (download/addons/updates (but no updates),
  • app launcher
  • restarting after installing an addon
  • Fennec installation
  • Fennec shut down

Update Testing for bug 620584

12/21: There is a respin of Fennec Beta 3 build 2, that will pick up the changes to bug 620584. This changes the appname for fennec so the Android Market can host the app

  • Known Issues (Android Only)
    • There will be two instances of Mobile Firefox if the user has beta 1 or beta 2 previously installed. Both operate on completely different profiles
    • The app launcher may show two instances of Fennec when launching a url. They may be labeled both as Firefox, one being beta 1, the other beta 2.
    • AUS Updates for Fennec beta 1 and beta 2 will be disabled. Going forward, users will only get their updates from Android Market.
  • Testing (Android Only)
    1. Single install of Fennec beta 3 on android. Result: one instance of Firefox beta 3. Updates are disabled.
    2. Have an existing Fennec beta 2 on android. Install Fennec beta 3. Result: two instances of Firefox on android, with two different profiles. Both will work as expected. Updates are disabled.
    3. Have an existing Fennec beta 1 on android. Install Fennec beta 3. Result: two instances of Firefox on android, with two different profiles. Both will work as expected. Updates are disabled.
    4. Uninstall the existing instances in steps 2-3. Result: one instance of Firefox beta 3
    5. For steps 2-3, do not select a default browser, and launch a URL. Result: the app launcher appears with 2 instances of Firefox to choose from
    6. Run step 4, then step 5. Result: the app launcher appears with Firefox beta 3 to choose from

Builds

  • Build 3 candidates: here
  • Fennec 2.0 Litmus tests here

Test Results

Types of Tests Maemo Android
Smoketests (see breakdown below) martijn - PASS Ioana - PASS
Ahoza - PASS
Anna - PASS
BFTs (see breakdown below) n/a Ioana - PASS
Ahoza - PASS
Anna - PASS
Updates martijn - PASS Ioana - PASS - no update offered

Smoketests

N900 (martijn)

  • Build: Mozilla/5.0 (Maemo; Linux armv7l; rv:2.0b8) Gecko/20101221 Firefox/4.0b8 Fennec/4.0b3
  • Run all smoketests
    • PASS

Android - HTC Desire (Ioana)

  • Build: Mozilla/5.0 (Android; Linux armv7l; rv:2.0b8pre) Gecko/20101221 Firefox/4.0b8 Fennec/4.0b3
  • Results: result

Android - Samsung Galaxy S (ahoza)

  • Build: Mozilla/5.0 (Android; Linux armv7l; rv:2.0b8pre) Gecko/20101221 Firefox/4.0b8 Fennec/4.0b3
  • Results: PASS
    • No blocker issues found

Android - Motorola Droid 2 (Anna)

  • Build: Mozilla/5.0 (Android; Linux armv7l; rv:2.0b8pre) Gecko/20101221 Firefox/4.0b8pre Fennec/4.0b3
  • Result: PASS

BFTs

Android - Samsung Galaxy S (ahoza) Installation -> History

  • Build: Mozilla/5.0 (Android; Linux armv7l; rv:2.0b8pre) Gecko/20101221 Firefox/4.0b8pre Fennec/4.0b3
  • Results: PASS
  • Known bugs:
    • bug 617326 - Inconsistencies while searching in google.com

Android - Motorola Droid 2 (Anna) Add-ons -> Sync

  • Build: Mozilla/5.0 (Android; Linux armv7l; rv:2.0b8pre) Gecko/20101221 Firefox/4.0b8pre Fennec/4.0b3
  • Result: PASS
  • Known Issues:
    • Add-ons Manager:
    • Assistant bar
      • bug 606466 - Unnecessary ">" button in form autocomplete suggestions list
    • Layout:
    • Password:
      • bug 607504 - HTC Sense keyboard suggestion buffer doesn't commit when you click on a URL
    • Find in Page:
      • bug 613485 - Right side panel always appears after visiting about:config
    • Sync
      • bug 618858 - Items in about:sync-tabs are not refreshed.
  • New Issues:
    • Form Assistant:
      • bug 620929 - VKB flickers when tapping on the search field in the Form
  • Unreproducible Issues:
    • Zooming is not working properly. When double tapping the page is heavily zoomed and not centered at all. Please see the following video
    • Strange behavior when entering an e-mail address in a login page (e.g.: www.litmus.mozilla.org). For example, after entering: anamaria.moldovan@softvision.ro and tapping the down arrow from the form assistant to get to the "password" input field, "ro" will dissapear. Please see the following video

Android - HTC Desire (Ioana) Site Panel -> Screen Navigation

  • Build: Mozilla/5.0 (Android; Linux armv7l; rv:2.0b8pre) Gecko/20101221 Firefox/4.0b8pre Fennec/4.0b3
  • Results:
  • Known Issues:
    • Downloads :
      • bug 597953 - Downloads: Dependent behavior on other files
      • bug 619054 - Downloads: Inconsistency at auto-renaming
    • Web Usage
      • bug 610344 - Black filled text fields on Gmail login page.

Updates

N900 (martijn)

PASS

Android - HTC Desire (Ioana)

  • There are no updates offered for beta 2 or beta 3
  • Two instances can be installed (bug 620584)

Exploratory Testing

  • Install this crash extension (http://ted.mielczarek.org/mozilla/crashme.html) on fennec and force a crash to get the crash reporter
    • The crash extension can be used only with Android 2.2 (not working with android 2.1 nor Android 2.1 update 1)

Nexus One and Motorola Droid 2 (ashah)

Samsung Galaxy S (ahoza)

  • Unreproducible issues:
    • when selecting "Restart" after previously installing add-on/changing language browser does not restart, but it does not crash either. I've tried several things after this:
      • reinstalling the application - this didn't solved the problem
      • changed default Home app (used LauncherPro instead TwLauncher) - sometimes I got a dialog "Activity TwLauncher (in progress TwLauncher) is not responding" so I thought there must be something wrong with the app launcher. This didn't fixed the problem either
      • I've used "adb reboot-bootloader" command to reboot my device. After this I could not reproduce the above behavior. The browser restarts after installing add-on/ changing localization.
    • Note: our device (Samsung Captivate I897 for AT&T) is not rooted. We install Fennec using adb tool.

Bugs Filed