Unified Telemetry/Status reports/Android/April 27 2016

From MozillaWiki
Jump to: navigation, search

UT for Android status report April 27, 2016, 2015

Overall Project Health

Last week: Green

This week: Green

Project summary

  • Q2 - Using UT in firefox android to make business decisions, including populating KPI dashboard.

Exec Summary

  • Fennec-dashboard (firefox for android) backfill and validation should happen after initial 46 validation
  • ongoing work on core pings (see timeline here)
  • main ping content review kicked off
  • Validation work on release once 46 is live

Accomplished for Last Period

  • Distribution field Uplifted to 46
  • Docs missing
  • Testing? Pending mkaply
  • Robustness discussion on reuploader
  • core ping work
  • main ping content review work


Planned for Next Period

Validation:

  • Waiting to see data for fixes as it comes back in
  • Planning to engage Mobile QA with an eye to network packet sniffing as validation effort.
  • ongoing sprint based work


Risks and items to retire

Dashboards and consumers:

  • Dashboard form core pings (need min requirements)
  • PM input
  • Significance of abnormal session and search counts for first rev.

Validation:

  • automated tests
  • manual QA
    • mobile team has in-house and SoftVision QA
    • scope of v0 ping version is not be appropriate for heavy test effort
    • manual QA will happen from v3 on
  • Android Nightly has small population, so:
    • Sanity-check on Nightly
    • use Beta for validation
    • update latency to beta ~2 weeks to 90% of population
  • server-side analysis
    • quality checks for ordering of pings, etc. and verifying the data looks sane
    • sanity checks at volume (look for large gaps etc)
  • validate against adjust data?
    • we should get to an ongoing "health of data" report from there
    • QA & analysis work needs to be defined and scoped/packed
  • schema validation
    • pipeline-side schema validation support is on the way
    • pipeline team may be interested to start this with the "core" ping

Important Links/References