Kilimanjaro/Basecamp/Sherpa

From MozillaWiki
Jump to: navigation, search

Contents

Overview

Sherpa is the codename for overall test plan across the QA organization for the Basecamp milestone. Below, it aims to provide a mapping to relevant test plans, strategies, ownership and more for each major user story in the Basecamp milestone.

High-Level Requirements

B2G software stack ready for device to launch in the Brazil market

Summary

<Provide a summary of the overall test strategy at a very high-level for what is being tested as part of this user story>

Open Questions

The ownership here feels foggy - what's the scope of this? Does this imply the OS pieces are there with all of the required pieces? Sounds like we need to define acceptance criteria and have a certain set of people drive that.

QA Owners

  • B2G QA

Relevant Test Plans

  • <list references to relevant test plans here>

Other References

All content needs to be localized content in English (US), Spanish (LatAm) and Portuguese (Brazil)

Summary

Core apps, Marketplace app need to be localized

Open Questions

  • A bit foggy - can we get more concrete scope defined here?

QA Owners

  • B2G QA
  • Marketplace app: Krupa

Relevant Test Plans

  • <list references to relevant test plans here>

Other References

  • localized in pt-BR, es-BR, en-BR

Mozilla to build and operate a Brazil-targeted App Marketplace

Summary

Localized content and locale-aware content (apps which are popular in Brazil will be featured in the Brazilian locale, etc.), users that buy apps will need to buy in the Brazilian currency, Real

Open Questions

QA Owners

  • Krupa Raj

Relevant Test Plans

  • <list references to relevant test plans here>

Other References

  • <list any other important references here>

B2G users will have the ability to create a Telefonica account

Summary

General: Need to have the ability to associate a Telefonica phone with a Telefonica account

Open Questions

  • Need to define a lead to drive communication for this? Tony?

QA Owners

  • Probably Telefonica ownership, but need to work with B2G QA to define and coordinate

Relevant Test Plans

  • <list references to relevant test plans here>

Other References

  • <list any other important references here>

The Telefonica accounts system implements the Persona identity provider protocol

Summary

<Provide a summary of the overall test strategy at a very high-level for what is being tested as part of this user story>

Open Questions

  • This sounds like a good area to get assistance from whoever drives persona client testing - Tracy?
  • Scope needs better definition on who's owning it

QA Owners

  • Services? Web QA? Both?

Relevant Test Plans

  • <list references to relevant test plans here>

Other References

  • <list any other important references here>

The ability to sign into application using various account management services

Summary

<Provide a summary of the overall test strategy at a very high-level for what is being tested as part of this user story>

Open Questions

  • Who owns testing of top apps on B2G? They probably own this as well

QA Owners

  • Whoever owns testing top apps owns this as well

Relevant Test Plans

  • <list references to relevant test plans here>

Other References

  • Open questions: PersonaID, Facebook ID, Twitter, Brazil-specific ID -- what's a "Brazil-specific ID"?

Gaia Settings app is a touch-point for creating/managing the user's Telefonica ID

Summary

<Provide a summary of the overall test strategy at a very high-level for what is being tested as part of this user story>

Open Questions

QA Owners

  • <list owners here>

Relevant Test Plans

  • <list references to relevant test plans here>

Other References

  • <list any other important references here>

Billing integration between Apps Marketplace and the network operator

Summary

Intent is to allow the end-user to buy an app and be billed by Telefonica (presumably, or any B2G carrier)

QA Owners

  • n/a

Relevant Test Plans

  • <list references to relevant test plans here>

Other References

  • <list any other important references here>

Business development efforts for Brazil app developers

Summary

<Provide summary of what this is and testing strategy at a high-level>

Open Questions

  • Whoever owns top apps testing also owns this

QA Owners

  • <list owners here>

Relevant Test Plans

  • <list references to relevant test plans here>

Other References

  • <list any other important references here>

B2G front-end experience, Gaia version 1 - core set of default applications

Summary

<Provide a summary of the overall test strategy at a very high-level for what is being tested as part of this user story>

QA Owners

  • Telefonica, B2G

Relevant Test Plans

  • <list references to relevant test plans here>

Other References

  • <list any other important references here>

High-Level Tasks Tracked

Offline Capabilities

Summary

  • Allow apps and (anything?) that interfaces or uses the apps to work offline (IndexDB, offline cache...)

QA Owners

  • Desktop QA, A-Team, others?

Relevant Test Plans

  • <list references to relevant test plans here>

Other References

  • <list any other important references here>

Layout Compatibility

Summary

The overall strategy here to get top Brazil sites and apps to serve mobile gecko using the Fennec native user agent the correct mobile optimized content without webkit prefixes. The scope of testing includes testing top Brazil sites and apps on mobile Gecko vs. webkit, identifying problems with user-agent sniffing and webkit usage, and pursue an appropriate mitigation strategy to make the optimized site be served functionally. Mitigation strategy is determined by analyzing partner communication requirements and effort and Gecko layout engine changes if needed. Then, we move forward with the appropriate strategy through working with business development to notify top sites of compatibility problems and identifying and ensuring fixes of any applicable Gecko issues.

Open Questions

QA Owners

  • Aaron Train
  • Jason Smith
  • Tony Chung

Relevant Test Plans

Other References

Media Playback / Streaming

Summary

Verify h.264 / mp3 playback works as expected, and the (20?) HTMLMediaElement callbacks / functions are working as expected.

Open Questions

QA Owners

  • David Clarke

Relevant Test Plans

  • <list references to relevant test plans here>

Other References

  • <list any other important references here>

Orientation Lock

Summary

<Provide a summary of the overall test strategy at a very high-level for what is being tested as part of this user story>

Open Questions

QA Owners

  • Geo

Relevant Test Plans

  • <list references to relevant test plans here>

Other References

  • <list any other important references here>

Finish Multi-Touch

Summary

<Provide a summary of the overall test strategy at a very high-level for what is being tested as part of this user story>

Open Questions

QA Owners

  • Desktop, Mobile QA

Relevant Test Plans

  • <list references to relevant test plans here>

Other References

  • <list any other important references here>

Hardware accelerated Canvas or WebGL (Mobile only)

Summary

<Provide a summary of the overall test strategy at a very high-level for what is being tested as part of this user story>

Open Questions

QA Owners

  • B2G QA

Relevant Test Plans

  • <list references to relevant test plans here>

Other References

  • <list any other important references here>

Security and Permissions Model for Apps on B2G

Summary

<Provide a summary of the overall test strategy at a very high-level for what is being tested as part of this user story>

Open Questions

QA Owners

  • B2G, Desktop QA ("Apps?")

Relevant Test Plans

  • <list references to relevant test plans here>

Other References

Mozilla Marketplace SLAs

Summary

Outlined in metrics form here, basically IT/Dev/QA need a way to measure availability and performance of the Mozilla Marketplace -- IT's evaluating solutions which will help them collate the various metrics in a single dashboard

Open Questions

  • Could the Services QA team help out here? This sounds like something James's team could help out with

QA Owners

  • Web QA <-- Needs more details, and should services QA help here?

Relevant Test Plans

  • <list references to relevant test plans here>

Customer Support process defined and agreed on

Summary

Avenue for collecting feedback on B2G and marketplace and being able to respond to that feedback in a timely manner. Lots of unknowns here, but the details I know is that there is debate right now on how to provide a feedback avenue through B2G and customer support for Marketplace. QA's job will likely involve providing support when issues are escalated to QA and if needed, testing of any feedback avenues that are actually concrete software applications.

Open Questions

  • What feedback avenue would be used through B2G?
  • For support issues escalated to QA, who should take ownership?

QA Owners

  • Open question on who should own this, but likely Krupa at least for Marketplace
  • Others are TBD

Relevant Test Plans

  • N/A
Retrieved from "https://wiki.mozilla.org/index.php?title=Kilimanjaro/Basecamp/Sherpa&oldid=444859"