QA/Fennec1.0/ReleaseTest/1.0Maemo RC1: Difference between revisions

 
(39 intermediate revisions by 6 users not shown)
Line 18: Line 18:


== Schedule ==  
== Schedule ==  
;Code Freeze: -- 12/1
;Code Freeze: -- 12/28
;Builds hand to QA: -- 12/3
;Builds hand to QA: -- 12/30
;QA test signoff: --
;QA test signoff: -- 12/31
* See Test Coverage below
* See Test Coverage below


Line 32: Line 32:
== Test Coverage ==  
== Test Coverage ==  
* Areas Covered:
* Areas Covered:
** Smoketests - '''result'''
** Smoketests - '''PASS'''
** BFTs - '''PASS'''
** BFTs - '''PASS'''
** Bug Fixes - '''result'''
** Bug Fixes - '''PASS'''
** Website Spotchecks
** Website Spotchecks
** L10n Spotchecks - '''PASS'''
** L10n Spotchecks - '''PASS'''
Line 46: Line 46:
|-
|-
| Smoketests
| Smoketests
| marcia - '''result'''
| tchung - '''PASS'''
| jmaher - '''PASS'''
| jmaher - '''PASS'''
|-
|-
| BFTs
| BFTs
| aakashd/marcia - '''PASS'''/'''result'''
| aakashd/marcia - '''PASS'''/'''PASS'''
| jmaher - '''PASS'''
| jmaher - '''PASS'''
|}
|}
Line 130: Line 130:
== Smoketests Results ==
== Smoketests Results ==
=== n900 [tchung] ===
=== n900 [tchung] ===
* Build:  
* Date: 12/30/2009
* Results: '''in prog'''
* Build: Mozilla/5.0 (X11; U; Linux armv71; en-US; rv:1.9.2b6pre) Gecko/20091230 Firefox/3.6b6pre Fennec/1.0b6pre
* Results: '''PASS'''
* Notes:
* Notes:
** See litmus for results, buildID "20091230"
** Failed [https://litmus.mozilla.org/single_result.cgi?id=227181 litmus testcase 7245] Need a clean profile to re-verify.
*** ''update'' joel confirmed the testcase is wrong and needs an update.
** Failed [https://litmus.mozilla.org/single_result.cgi?id=227204 litmus testcase 7908] Need another n900 to verify.
*** ''update'' joel confirms youtube video playback for him.  could be my profile.
** Filed '''BLOCKER''' {{Bug|537341}} -  Change fennec 1.0 rc to firefox branding
** Filed {{Bug|537336}} -  Fennec uninstaller doesnt uninstall when app is still open
** Filed {{Bug|537336}} -  Fennec uninstaller doesnt uninstall when app is still open


=== n810 [jmaher] ===
=== n810 [jmaher] ===
* Build: Mozilla/5.0 (X11; U; Linux armv7l; Nokia N900; en-US; rv:1.9.2b3pre) Gecko/20091229 Namoroka/3.6b6pre Fennec/1.0b6  
* Build: Mozilla/5.0 (X11; U; Linux armv6l; en-US; rv:1.9.2b6pre) Gecko/20091230 Firefox/3.6b6pre Fennec/1.0b6  
* Results: '''PASS'''  
* Results: '''PASS'''  
* Notes:
* Notes:
Line 150: Line 157:


=== n900 [marcia] Layout - Screen Navigation ===
=== n900 [marcia] Layout - Screen Navigation ===
* Litmus results under Build ID: 20091229
* Build: 20091228010629
* Build: 20091228010629
**Did Layout
**Did Layout
* Results: '''result'''
* Build: 1.9.2b6pre-20091230135310 (Release Candidate)
* Results: '''PASS''' Please review Litmus results for failures.
* Notes:
* Notes:
**Had trouble crashing when trying to login to yahoo mail. Did disable plugins and that seemed to fix the issue
**Had trouble crashing when trying to login to yahoo mail. Did disable plugins and that seemed to fix the issue
**Crashed when loading the wallet test page on archive.mozilla.org
**Crashed when loading the wallet test page on archive.mozilla.org
** Build: 20091229 (Build ID tchung started using)
**Crashed while loading youtube video
**[https://bugzilla.mozilla.org/show_bug.cgi?id=537402 Bug 537402] - http://www.deviantart.com/ does not render properly
**Crashed running https://litmus.mozilla.org/show_test.cgi?id=7593


=== n900 [tchung] ===
=== n900 [tchung] ===
* '''Covering:''' general, content handling, addons manager, downloading, password manager, menu bar, installation, Search, tile caching, layout
* '''Covering:''' general, content handling, addons manager, downloading, password manager, menu bar, installation, Search, tile caching, layout
* Build: Mozilla/5.0 (X11; U; Linux armv71; en-US; rv:1.9.2b6pre) Gecko/20091229 Firefox 3.6b6pre Fennec/1.0b6pre
* Build: Mozilla/5.0 (X11; U; Linux armv71; en-US; rv:1.9.2b6pre) Gecko/20091229 Firefox 3.6b6pre Fennec/1.0b6pre
* Results: '''in prog'''
* Results: '''PASS'''
* Notes:
* Notes:
** Filed {{Bug|537109}} - Flash video content on dailymotion.com wont play  (
** Filed {{Bug|537109}} - Flash video content on dailymotion.com wont play  (
Line 171: Line 182:
** restarting the added addon takes about 30 seconds to restart.  ({{bug|534982}}
** restarting the added addon takes about 30 seconds to restart.  ({{bug|534982}}
** For some reason, my "allow cookies" keeps disabling by itself.  Investigating the cause.
** For some reason, my "allow cookies" keeps disabling by itself.  Investigating the cause.
*** ''update'' turns out i was double tapping the options button, which directly overlays the cookie toggle switch.  We should probably redesign this as it can be a common issue


=== n810 [jmaher] Installation - Language Selector ===
=== n810 [jmaher] Installation - Language Selector ===
Line 197: Line 209:
* Notes:
* Notes:
** Testing sites from [http://bit.ly/5ZDSRF troublesome sites for the n810 list], along with Alexa top 50, and a bunch of login sites (bank, memberships, etc)
** Testing sites from [http://bit.ly/5ZDSRF troublesome sites for the n810 list], along with Alexa top 50, and a bunch of login sites (bank, memberships, etc)
*** Tested troublesome sites:
** Tested troublesome sites:
**** boingboing.net (including video)
*** boingboing.net (including video)
**** fan590.com - slow loading and scrolling
*** fan590.com - slow loading and scrolling
**** csnation.net - (including video) - loads super slow but has lots of graphics
*** csnation.net - (including video) - loads super slow but has lots of graphics
**** espn.com - "Herbstreit On Leach" video takes _forever_ to load.  Like 8 minutes.  Then very stuttery and only bottom half of video is showing.
*** espn.com - "Herbstreit On Leach" video takes _forever_ to load.  Like 8 minutes.  Then very stuttery and only bottom half of video is showing.
**** jquerystyle.com - ok
*** jquerystyle.com - ok
**** maxim.com - very slow site
*** maxim.com - very slow site
**** Fandango - trouble playing videos - "This video player has encountered a problem please refresh the page".  Refresh doesn't help.  Want to try microbee to compare.  
*** Fandango - trouble playing videos - "This video player has encountered a problem please refresh the page".  Refresh doesn't help.  Fandango videos work on microbee. Filed {{bug|537397}}.
*** Alexa top 50
** Top Alexa sites
**** tbd
**# google.com - ok
*** login sites
**# facebook.com - ok
**** Bank
**# yahoo.com - very slow site, particularly videos.  1 minute vid took 20 minutes+ to play.  Lost sound after the first 5 minutes.  Browser hung when trying to get back to URL bar and type in next top site.  Came back after about 15 mins. This happened when watching the [http://video.yahoo.com/network/100000086?v=5289218&l=100000085 Young Raccoons Saved from Pepsi Machine] video.
**** MLB.com
**# youtube.com - crashed about about 50sec loading first page.  Worked great the secod time. I think the browser was still hosed from yahoo.com.  Yeah.  youtube seems fine.  One of the better responding sites for fennec.
**** Apple store
**# live.com - good
**** others tbd
**# wikipedia.org - English site ok.  pictures are good.  Japanese site - no pictures!?
**# blogger.com - good, responsive.
**# baidu.com - simple site.  Like google.com.  responsive.
**# msn.com - good.  responsive.
**# yahoo.co.jp - good.
** login sites
*** Bank - one bank login, acct review, on-line billpay was successful.  One time I miss-typed a password I got a crash.  Not reproducible.
*** MLB.com - ok.  _Very_ slow to update.
*** Apple Developer Connection member site
**** Scrolling Terms and Conditions box doesn't work.  Not sure how I am going to repro this as it only comes up if you haven't reviewed this in the last 2 years.
**** Otherwise ok
*** Amazon.com member site - ok


== L10n Testing ==
== L10n Testing ==
=== n900 [abillings] ===
=== n900 [abillings] ===
* Build:  
* Build: Mozilla/5.0 (X11; U; Linux armv7l; Nokia N900; en-US; rv:1.9.2b3pre) Gecko/20091229 Namoroka/3.6b6pre Fennec/1.0b6
* Results: '''result'''
* Results: '''PASS'''
* Notes:
* Notes:


=== n810 [jmaher] ===
=== n810 [jmaher] ===
* Build:  
* Build: Mozilla/5.0 (X11; U; Linux armv7l; Nokia N900; en-US; rv:1.9.2b3pre) Gecko/20091229 Namoroka/3.6b6pre Fennec/1.0b6
* Results: '''result'''
* Results: '''PASS'''
* Notes:
* {{bug|537270}} - n810 (de): browsing to ww.mozilla.org, yields a possible xml error page
* {{bug|537292}} -  n810 (fi): amazon.com is en-us version, not fi
 
== Desktop Testing ==
=== Mac OSX [tchung] ===
* Build: Mozilla/5.0 (Macintosh; U; Intel Mac OS X 10.5; en-US; rv:1.9.2b6pre) Gecko/20091231 Namoroka/3.6b6pre Fennec/1.0b6pre
* Results: '''PASS'''
* Notes:
** Flash audio streams normal, but video is super laggy.  (still images, instead of video).
*** ''update'' this is {{bug|331462}}.  flash doesnt render on canvas.
** Fennec crashes after playing video for awhile, and then toggling the plugins option.
** Tested websites, bookmarks, addons, enable/disable prefs, downloads, layout
 
* Build: Mozilla/5.0 (Macintosh; U; Intel Mac OS X 10.5; en-US; rv:1.9.2b6pre) Gecko/20091231 Namoroka/3.6b6pre Fennec/1.0rc1
* Results: '''PASS'''
* Notes:
** Ran the same tests as above
 
=== Linux [jmaher] ===
* Build: Mozilla/5.0 (X11; U; Linux i686; en-US; rv:1.9.2b6pre) Gecko/20091231 Namoroka/3.6b6pre Fennec/1.0b6pre
* Results: '''PASS'''
* Notes:
** {{bug|537411}} - text spacing on linux desktop
 
 
=== Windows (xp) [jmaher] ===
* Build: Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:1.9.2b6pre) Gecko/20091231 Namoroka/3.6b6pre Fennec/1.0b6pre
* Results: '''PASS'''
* Notes:
* Notes:
** {{bug|537412}} - text spacing on windows desktop
** {{bug|529169}} - Unable to locate msvcr80.dll
Confirmed users
6,300

edits