B2G/QA/Meetings/2015-10-14

From MozillaWiki
< B2G‎ | QA‎ | Meetings
Jump to: navigation, search

// For 2015/10/14

Overview

Announcements:

  • List your ideas for Topics for Moz Orlando work week : qa@mozlando
    • same idea as what we did for work week for Whistler
    • Al has submit the meeting to google submit on Wednesday
    • Next milestone: Oct. 30th - Finalize the meeting topics for FxOS teams

Off plan

Gerry - Oct. 7~23, Oct. 30~Nov. 6 (Euro Star) Paul - Oct. 14-19 Al - Oct. 16-21 TPE office - Oct 9 marcia traveling 10-21 and 10-27

2.2r

  • Contact Window: Shing Lyu
    • Status: Shing and Al starts to reach some QA outsource partners

// Following items are for read-only

2.5 Feature

  • Bugzilla lite: Cynthia/Gerry
    • Marigold will run the test this week
    • Bug list: http://mzl.la/1SmOoEQ (51 bugs) - none of them are blockers
      • Done
  • Telemetry: Iris/Gerry
    • Test plan draft: https://goo.gl/6ANJuO
    • Writing test cases
    • executing test cases in progress
    • Bug list: https://goo.gl/GXRnIH
    • User stories: code not landed, have played local patches
      • bug 1181295 - FTE UX changes for privacy
      • bug 1208205 - Settings changes for privacy
      • bug 1177099 - compression
  • Pin the Web: Alison
    • 1 MVP feature not yet landed : Bug 1168970 - [User Story] Un-pin Site, under review
    • 8 Blockers: http://mzl.la/1PfDmyI

[PY] - Allison, after this lands, how much time do you need for testing? [Alison] - At least 3 days to run full test

  • Tracking Protection: Alison
    • Remove control panel from v2.5
   *** v2.5 only includes enable/disable toggle in Settings, and a quick pop-up page to explain TP for the first time user launches the browser

[PY] - Had meeting with Mars, clord, gmarty,... today. Meeting notes here -> https://docs.google.com/document/d/1uHZHZqYeRJmt8lj7qgVU6gTbiu_n11MiNNsxE6_qEHw/edit Called out as a risk.

  • Late Customization: Teri
    • Bug 1180707 - (2.5_LateCustomisation) late customisation
    • Talked to EPM - Lindsay about how to test and scope
    • Code in review, target to land this week

[PY] - Suggestion from Wilfred on how to test this: Pasting his comments as is. Pls evaluate. [10/14/15, 2:42:26 AM] Wilfred Mathanaraj: use a operator like Orange and we as mozilla setup a test shelf - we then use SIMs from that country (e.g. France) from all operators in France to test the different scenarios [10/14/15, 2:42:52 AM] Wilfred Mathanaraj: the other example would be we create a vodafone france shelf - test it out with other sims [10/14/15, 2:43:07 AM] Wilfred Mathanaraj: i dont think we need operator involvement for us to test the late customisation shelf idea 


   *** Waiting for review: https://bugzilla.mozilla.org/show_bug.cgi?id=1207097

   *** Test run: https://moztrap.mozilla.org/runtests/run/8128/env/347/
    • Target milestone for kill switch is 10/16 and it won’t have any UX for add-on
   *** Need more detailed design information from developer
  • Performance: Mike
    • App/Device startup time
   *** Music NGA causes performance regression: https://bugzilla.mozilla.org/show_bug.cgi?id=1210440
    • Media performance move landing to S10
   *** https://bugzilla.mozilla.org/show_bug.cgi?id=1159343

   *** v2.5 will only have a prototype for user to use
   *** Need to create nsec packages for every API test

_* NGA: Gerry/Johan

    • [jlorenzo] No weekly meeting this week. From the bug activity, the gaia devs are still on working on catching up the performance regressions introduced by the NGA architecture. No functional work on progress.
  • RTL: William
    • 366/384+ (95.31%) test cases have been updated/created
    • Marigold has completed testing on System, FTE, Homescreen.

[PY] - Other than System, have we completed testing on homescreen, settings, ftu? Are dev still waiting on gaia-header issue?

  • updates: FOTA : nhirata
    • overview : https://docs.google.com/drawings/d/1x6dG6cVu68Oc_TKaTLV2rCb56ofLqjpvv-P2lnJoxtQ/edit
    • Aries FOTA
      • FOTA update released last week
      • blocked by needing location for FOTA build
      • client sending IMEI patch works
      • blocked by needing changes from releng to make it work: Bug 1201556, Bug 1201540, bug 1211973
    • Flame FOTA
      • fingerprint needed in order to FOTA properly, patch going to land soon
      • blocked by needing changes from releng to make it work: Bug 1213824,Bug 1213929, bug 1213926
      • wrong signature UX bug filed: bug 1214737
  • Vaani : nhirata -
    • dropped for 2.5; work still being done, QA still needed. Will be an ongoing tweak of fuzzy logic
    • please use the MozSpeech app in dogfood-latest build
  • Others
    • View Source: No-Jun
      • All major features are verified, there is only one bug that's being checked right now, but it's not a blocker (Bug 1204011)
      • Test suite is in moztrap

2.5 Spark/Aries-KK Smoketests

  • Tester: QAnalysts (KevinT)
    • Health Status: Aries: Yellow 1 blocker

New: None

Existing: - https://bugzil.la/1214280 Users are unable to import contacts from memory card in FTU/FTE 

 *Fails [6119]

Severe Issues: - https://bugzil.la/1211266 - Occasional missing icons after flashing homescreen - https://bugzil.la/1213233 - [Homescreen] All icons on homescreen can't be shown, after user selected "New Home Screen" or "Default Home Screen" - https://bugzil.la/1213762 - [Browser]When user plays a video in YouTube site in Full Screen mode, if it switches between portrait and landscape mode, a half-screen blank area will flash past. -https://bugzil.la/1190434 - Browser app stops playing audio when screen turns off

  • Patch has been created waiting for landing.

- https://bugzil.la/1212960 User can see homescreen background behind SHB when watching full screen videos in browser on youtube or other sources - https://bugzil.la/1183033 [B2G] Keyboard doesn't have click sound - https://bugzil.la/1210190 Alarm time created is displayed as a different time.

2.5 Aries Dogfood

  • Health Status: Aries: Yellow 1 blocker

Existing: -https://bugzil.la/1190434 - Browser app stops playing audio when screen turns off

  • Patch has been created waiting for landing.

2.5 Exploratory

  • Tester: QAnalysts (KevinT)

=== 2.5 fullrun === (Update: 10/15)

=== 2.5 smoketest (Marigold) === (Update: 10/15)

  • Aries
    • Bug 1214280 -Users are unable to import contacts from memory card in FTU/FTE
   *** https://bugzil.la/1214280
  • Flame
   1. Bug 1214280 -Users are unable to import contacts from memory card in FTU/FTE
   2. Bug 1188992 - [OTA] Latest Flame build is a day behind
   3. Bug 1213762 - [Flame KK][Browser]When user plays a video in YouTube site in Full Screen mode, if it switches between portrait and landscape mode, a half-screen blank area will flash past.


2.5 MTBF

flame-kk 512MB avg. running hours: 34.26 Blocker: 

- https://bugzilla.mozilla.org/show_bug.cgi?id=1206634
- https://bugzilla.mozilla.org/show_bug.cgi?id=1198950

mtbf bugs in Q3 https://bugzilla.mozilla.org/show_bug.cgi?id=1182954

    • RA exit criteria: 100 hrs
    • CC exit criteria: 200 hrs

Previous action items

(Update: Oct. 7th)

  • -DONE [marcia] Action item to follow up with Michael Treese in Orlando
  • [team] Finalize sessions/Items for Agenda for Orlando
  • [Al/Pallavi] To follow up the QA ww between Moz ww
  • [In progress] marcia: follow up with pallavi regarding community budget.
  • [In progress][whsu] William to confirm ETA for RTL test case ready
 [William 10/07] It will be 10/16 or earlier. 
 GIP for OGA music still works; follow up for NGA music with GIP in Q4

== Agenda == (update October 14))

https://gaia-l10n.allizom.org/integration/gaia-central/rev/e96ce12ed450 (Not shown in the diff, but you don't have anything to do about it)

  • Foxfooding [marcia]
    • Are people in the team actively foxfooding?
    • If so, can you help answer questions that are sent to the mailing list?


- Firefox Sync strings will likely be covered by automation, but needs to be confirmed as it seems not everything is covered

  • [Jamie_] Test day info, also a few questions.


  • Scope of this meeting: Is it supposed to be public or private?
    • If private: Remove this event from the public QA calendar, and remove the notes the public wiki
    • If public: Use a public etherpad for the meeting notes

Community Updates [marcia-read only]

[Jamie_]

  • will be starting on revamp of firefox OS QA pages soon, have to talk to some people about it.


This Week - Decisions & Action Items

  • [marcia] remove Pin the Web from Test Day


Testing information

Retrieved from "https://wiki.mozilla.org/index.php?title=B2G/QA/Meetings/2015-10-14&oldid=1100710"