Fennec/NativeUI/GAReadinessReview

June 18, 2012

GA + Release Schedule

Moco confidential: pls. refer to weekly status email or feel free to contact elancaster directly.

GA Go-To Market Plan

Promotion timeline: https://www.smartsheet.com/b/publish?EQBCT=1b9a19bd30804b03ae1bcb3da43f7b01

Web pages being updated/localized/launched on GA day

NOTE: If there are existing pages that need updating but are not the responsibility of PMM; please state below :)

Product pages:

• mozilla.org/firefox/fx#mobile
• mozilla.org/mobile/features
• mozilla.org/mobile/faq
• mozilla.org/mobile/platforms
• mozilla.org/mobile
• Bug 755411 - "About Firefox Beta" Release Notes link is 404
  
• Bug 756908 - Link to FAQ on About Firefox Beta page points to a missing page
  
  • Release notes
    

Website promos:

• mozilla.org
• Tabzilla

Other Promos

Reddit IamA campaign (Day prior to GA as a primer)

Other recommended Blog Posts & Activities

• Performance blog post (similar to something like this)
• Eideticker blog post (William already has this drafted)

List of Benchmarks

https://intranet.mozilla.org/FN14GAbenchmarks

Since performance is a large part of our story, we need to have all benchmark numbers ready to go (JS, Eideticker, Ringmark, HTML5)

PR Intro Plan

• "Future of Firefox" blog post
  
• Friendly reporters have been given a head's up
  
• FAQ for inbound press questions
  
• Press coverage report
  

Support Plan

• Release notes
  <== akeybl handles this webpage
  
• Minimum System Requirements & Device Compatibility
• https://www.mozilla.org/en-US/mobile/platforms/ Updated Platforms page targeted for a beta very soon]
• en-us support docs complete for Google Play launch; l10n ready
• New Firefox 14 for Mobile Support Site; 20 new articles and new tutorials
• L10N 70% complete for top articles in default non-English languages
• firefoxforandroid@mozilla.com: one-time push notification about Flash
• army of awesome will monitor social sites and direct problem solving on sumo;
• Keep feedback flowing into Google Play for best support; monitoring throughout the day
• Daily reports for the first week or so, depending upon traffic:

-Positives
-Negatives
-Rating change
-Interesting comments/trending

Issues and Risks

• bug 760098 - Default (minTwips; 120) text-inflation on YouTube makes us look bad
• Sync on Android is not translated at all in Suomi (fi)
  
• Sync on Android is not translated completely in Português (Brasil)(pt-BR)

Cross-Functional

• Web site compatibility effort is ongoing
  
• Need to grow add-on developer adoption for compatibility with new architecture
• Telemetry is disabled for GA due to bug 762620 - Evidence that idle-daily can start misfiring

Bug Metrics and Testing

396 Release Blockers Resolved Since Beta (all inclusive)

GA Test Coverage

• bug 765871 Please test 10.0.5 -> 14.0 (beta 7? RC?) migration one last time Final Migration Verification in progress
• Test cases based on each functional area will be 100% complete; this includes verification of fixed blockers across a variety of devices, smoke testing, usability, and exploratory testing
• Installation, update, and migration testing will be 100% complete
• Google Play pre-testing will be 100% complete

Beta Build Verification Testing/Sign Offs
[5/15] https://wiki.mozilla.org/QA/Fennec/14/Beta/1
[5/18] https://wiki.mozilla.org/QA/Fennec/14/Beta/2
[5/25] https://wiki.mozilla.org/QA/Fennec/14/Beta/3
[6/01] https://wiki.mozilla.org/QA/Fennec/14/Beta/4 & https://wiki.mozilla.org/QA/Fennec/14/Beta/5
[6/8] https://wiki.mozilla.org/QA/Fennec/14/Beta/6
[6/14] https://wiki.mozilla.org/QA/Fennec/14/Beta/7#Native_Fennec_14_Beta_7_Test_Plan_.28build_3.29

Deferred Bugs Scheduled for 14.0.1

• We will continue to approve until the cut-off for go-to build
• [https://bugzilla.mozilla.org/buglist.cgi?quicksearch=blocking-fennec1.0%3AbetaN%2B;list_id=3083812 tracking issues we want fixed early in the beta cycle with a specific flag
• Other notable bugs in Known Issues

Web Compatibility

DOs/DONTs when talking about website compatibility in public

• Are We Compatible Yet?
• Query for all open Web Compat Bugs reported against Fennec Native
• Product Sign Off for Beta
• Investigation is ongoing (crowd sourcing test tool launched 20120508), actively working with select partners to fix site issues
• High level goals for k9o are captured in bug 747123. Are targeting active involvement with top apps/sites and mitigation strategies for Alexa top sites in specific locales.
• We are working on top sites. Goals are aligned around k9o. Coordinating with evangelism as needed top priority issues:

bug 668288 - [meta] Google evangelism issues in Firefox for Android
bug 759986 - [meta] Issues with facebook.com
bug 763510 - [meta] Issues with twitter.com
bug 763512 - [meta] Issues with microsoft.com

Features Summary

• Performance
• click-2-play Flash support
• Readability
• Refined UI, better tab management,smoother in-content UI
• Sync
• Add-On Support

Reliability

1. As of June 19th, we are at 4 crashes per 100 ADU
2. This is down from 22 crashes per 100 adu on May 14th
3. Criteria for GA is no more than 5 crashes per 100 ADU

Performance

Goals

• Fast start up time
• UI is up and running and ready for user interaction quickly
• Responsive browsing: page load, panning & zooming performance
• Better Memory Usage

====Where are we today====

• Perception of start-up time is within an acceptable range: continued optimization is planned

• Canvas(fps) and Rendering Performance is competitive and beats other browsers:
  

Eideticker Measures What the Users Sees:
http://wrla.ch/blog/2011/11/measuring-what-the-user-sees/

Clock benchmark (better canvas framerate than any other browser):
http://wrla.ch/eideticker/benchmarks/metric.html?data=clock-jun13.json#/fps<br?

CNN.com performance (lower checkerboarding than Chrome, smoother panning/zooming than any other browser):
http://wrla.ch/eideticker/benchmarks/metric.html?data=cnn-jun12.json#/checkerboard
http://wrla.ch/eideticker/benchmarks/metric.html?data=cnn-jun12.json#/fps

l10n

Shipping the Following Locales:

1. Czech (cs)
2. Danish (da)
3. German (de)
4. Spanish (es-ES)
5. Finnish (fi)
6. French (fr)
7. Japanese (ja)
8. Korean (ko)
9. Italian (it)
10. Norwegian bokmal (nb-NO)
11. Dutch (nl)
12. Polish (pl)
13. Brazilian Portuguese (pt-BR)
14. Portuguese (pt-PT)
15. Russian(ru)

All available locales, those not included above to be hosted: https://l10n.mozilla.org/teams/

QA sign off: Two bugs being tracked for possible ride-alongs before we GA. If not, they will go into 14.0.1.

1. Sync on Android is not translated at all in Suomi (fi)
   
2. Sync on Android is not translated completely in Português (Brasil)(pt-BR)

Mobile Test Drivers

• Number of testers: 453 (down from 500 around May 14th)
• Number of bugs filed to date 158 (this not include bugs filed outside of the MTD form which auto-magically tags them for tracking).
• Areas of focus: Web compatibility, panning and zooming, flash,
• Builds released: 2 specific aurora builds with gfx changes we wanted extra validation on. Otherwise, the updater provides a new build every day.
• We are *keeping* MTD testers on Aurora