QA/Weave Test Plan/FirefoxHome/1.0.3 testplan 1.0.3 Testplan

From MozillaWiki
Jump to: navigation, search

Summary of Changes

What's new in this version:

  • localization fixes

Builds

Schedule

Test Plan

  • Run standard smoketests
  • Verify other bugs that were fixed in this version. (See notes)
Testcases
  • Test account sync Custom Server
  • Settings > Firefox Home
    • Version number shown
    • Toggle Custom Server switch
    • Specify Server URL
  • Test network handling use cases (need to create a matrix for known ones)
  • Test string localization changes (need to figure out how to do this with a simulator)
  • Test automatic refresh has been added on iOS 4 when the app has been suspended for more than 5 minutes
  • Check network timeouts from 30 to 60 seconds
  • Check added localization strings bug 583241. Supported locales are:
    • de
    • es-ES
    • it
    • nl
    • fr
    • zh-CN
    • zh-TW
    • ko
    • si
    • pl
    • cs
    • ca
    • ru
    • ja
    • tr
    • pt-BR

Results (nhirata)

  • Build ID: FF Home 1.0.3
  • Result: Fail
  • Concerns:
    • Localization :
      • bug 602713 - Help! button on the sign in page for traditional chinese is not localized
      • bug 602719 - authorization word overlap when refreshing the connection.
      • bug 602711 - Going to a bookmark after signing in with the OS set to Chinese will show the form slightly lifted
      • bug 602417 - On initial load, the information sent via email is not localized when sending information
    • Other:
      • bug 602676 - Cannot go back to portrait mode after playing a video in landscape from youtube.com clicking done.
      • bug 602722 - User cannot reconnect when the network settings is fixed after trying to connect when the server is not available. error -1003
      • bug 602735 - Can get an error message of wrong sync key if another machine is updating the sync account while home is syncing

Related bugs

Notes

Bugs Fixed:

  • Reopened bug 595871 Allow usage of native apps
  • ? bug 582278 Set up delivery of localized emails for Firefox Home
  • ? bug 578793 Firefox Home needs to be less stringent when receiving 401
  • ? bug 572796 Firefox Home crashes during sync (iPhone 3G) (OOM)
  • ? bug 568154 Wrong HMAC generated from iPhone client
  • ? bug 567569 Bad client records from iPhone client
  • ? bug 566667 Firefox Home install workflow/first run copy edits
  • ? bug 550605 iPhone Weave client needs security review
  • ? bug 549781 Remove unwrapping of encrypted payloads
  • WFM bug 574047 Crash when emailing link without iPod Touch email configured
  • WFM bug 567279 Iphone Weave: support show/hide tree view of bookmarks
  • WFM bug 565503 tabs on app sometimes do not match tabs on desktop client
  • WFM bug 565212 Weave1.0b8 for iPhone crashes when resuming sync after device goes to sleep

Bugs Unconfirmed:

  • Move to New? bug 579507 Browsing bookmarks by tag in Firefox Home
  • ? bug 579952 Firefox Home initial sync crashes if viewing Settings tab
  • Move to New? bug 582425 Sort order of unsorted bookmarks is wrong; should be newest to oldest, or switchable
  • bug 595747 Impossible remove a unused computer's sync name from tabs list

Known Bugs Encountered:

  • bug 573608 - Send maps.google.com URLs to the Maps app instead of WebKit

Bugs filed:

  • bug 602359 - If there's more than one keyboard, the keyboard will switch to the top active keyboard when going to the next field.
  • bug 602406 - After switching the iOS to a different language, the Firefox policy still redirects to an English page
  • bug 602410 - short tap on mailto link does nothing on the iPod Touch
  • bug 602417 - On initial load, the information sent via email is not localized when sending information
  • bug 602419 - If the wifi is turned off, it acts as if a blank account is signed in.
  • bug 602676 - Cannot go back to portrait mode after playing a video in landscape from youtube.com clicking done
  • bug 602719 - authorization word overlap when refreshing the connection.
  • x bug 602713 - Help! button on the sign in page for traditional chinese is not localized
  • bug 602711 - Going to a bookmark after signing in with the OS set to Chinese will show the form slightly lifted
  • bug 602676 - Cannot go back to portrait mode after playing a video in landscape from youtube.com clicking done.
  • bug 602722 - User cannot reconnect when the network settings is fixed after trying to connect when the server is not available. error -1003
  • bug 602735 - Can get an error message of wrong sync key if another machine is updating the sync account while home is syncing

Notes to Self:

  • Comments:
    • email to dialog sheet is localized
    • username is not case sensitive
  • Questions Encountered:
    • Should the usage of native apps go to the native apps themselves or should the portion of the native app open inside home? If the native apps do open, then should the apps redirect back to home once they are quit out of?
      • (tony) only Safari native app is supported and should open there. Future versions (maps, twitter, others) will support native apps being launched. (eg. bug 573608)
    • Is bug 602417 related to 582278?
      • (tony) sounds like a dupe. confirm it with buchanae on irc #webdev or #webdevqa
    • what's considered a beta blocker on this beta? localization?
      • (tony) if smoketests fail, and the loc fix fails. also, not necessary to check all the localized pages. Just pick 3-4 tier 1 locales to spotcheck and thats fine. (eg. fr, ja, es-ES, zh-TW)
    • is there any way of reseting the email that was sent information to for the "send information" screen for localization testing of the email?
      • (tony) no. they have to send a new one. and just fyi, https://services.mozilla.com/ is the server side page for resetting passwords and deleting sync accounts.
    • Not sure how to force a 401 error
      • (tony) dont know if we can really. 401 is a permissions error, so we'll need to work with ops to point to a test server to do it. Talk to zandr, st3fan, or dwalkowski in #labs to see if they have something like that you can point to to test with.
      • (tony) one other thing, please verify the new Help button takes you to the updated support page that talks about email login and Sync Key, and not Secret phrase. Anything after 1.0.3 shipped should be pointing to documentation there. (see michael from Support team for any questions on that)

7 October 2010

  • Is there some sort of debug mode where you can see logs, such as sync-logs?
  • If another account is syncing while home is syncing, it will state that you have the wrong sync-key and kick you out of sync? wrote a bug.
  • tabs aren't syncing? Not sure the reason why... [update] mental note : check the preferences before wondering.
  • Crashed once after bug 602676 then going to video.google.com, possibly syncing at the same time? Not sure. Can't repeat