Apps/QA: Difference between revisions

From MozillaWiki
Jump to navigation Jump to search
 
(126 intermediate revisions by 3 users not shown)
Line 1: Line 1:
__NOTOC__
__NOTOC__
==Overview==
==Overview==
Purpose of this page is to provide a level of communication / information flow across the different QA Teams to allow for the testing of the HTML5 Web Store. The purpose of this page is not to explain QA team structure, provide status or provide a background into HTML5 web apps in general.  
Welcome to the Web Apps QA team! We focus on testing the [https://apps.mozillalabs.com/ Open Web Apps] platform that allows HTML 5 applications to run on any device. We also focus our testing on the [http://marketplace.mozilla.org/ marketplace] to allow consumers to get apps they desire and seller to sell their apps. Interested in helping us test this platform? Then, see the community section on how to get started helping us out.
 
==Team==


{| style="width: 90%; margin: 0 0 1em 1em" |
{| style="width: 90%; margin: 0 0 1em 1em" |
  | style="width: 20%" |
  | style="width: 30%" |
  | style="width: 80%" |
  | style="width: 70%" |
  |- valign="top"
  |- valign="top"
  | '''QA Lead'''
  | '''Kilimanjaro QA Lead:'''
| [mailto:sdonner@mozilla.com Stephen Donner]
|- valign="top"
| '''QA MozApps API:'''
  | [mailto:dclarke@mozilla.com David Clarke]
  | [mailto:dclarke@mozilla.com David Clarke]
  |- valign="top"
  |- valign="top"
  | '''QA Automation:'''
  | '''QA Desktop Automation Framework:'''
  | [mailto:hskupin@mozilla.com Henrik Skupin]
  | [mailto:dburns@mozilla.com David Burns]
  |- valign="top"
  |- valign="top"
  | '''QA Mobile:'''
  | '''QA Mobile for WebRT & AITC:'''
  | [mailto:atrain@mozilla.com Aaron Train], [mailto:jbonacci@mozilla.com James Bonacci]
  | [mailto:atrain@mozilla.com Aaron Train]
  |- valign="top"
  |- valign="top"
  | '''QA MarketPlace:'''
  | '''QA Marketplace:'''
  | [mailto:zcampbell@mozilla.com Zac Campbell], [mailto:krupa@mozilla.com Krupa Raj], [mailto:mcompton@mozilla.com Marlena Compton]
  | [mailto:krupa@mozilla.com Krupa Raj]
  |- valign="top"
  |- valign="top"
  | '''QA OWA Extension:'''
  | '''QA Desktop for WebRT & AITC:'''
  | [mailto:jsmith@mozilla.com Jason Smith]
  | [mailto:jsmith@mozilla.com Jason Smith]
|- valign="top"
| '''QA AITC Server:'''
| [mailto:jbonacci@mozilla.com James Bonacci]
|}
|}


General Purpose Docs:<br>
== Components ==
[https://intranet.mozilla.org/images/1/19/Open-web-apps-v7-FINAL.pdf Open Web Apps User Study]
 
== Meeting Notes ==
*https://mozqa.etherpad.mozilla.org/mozappsqa-111111
*https://mozqa.etherpad.mozilla.org/mozappsqa-111811
*https://mozqa.etherpad.mozilla.org/mozappsqa-112311
*https://mozqa.etherpad.mozilla.org/mozappsqa-120111
*https://mozqa.etherpad.mozilla.org/mozappsqa-120911
*https://mozqa.etherpad.mozilla.org/mozappsqa-121611
=== Deprecated ===
https://mozqa.sync.in/apps-qa-2011
 
== Meetings ==
===Dial in===
  # 650-903-0800 or 650-215-1282 x92 Conf# 315 (US/INTL)
  # 1-800-707-2533 (pin 369) Conf# 315 (US)
  # irc.mozilla.org #qa for backchannel
  # Vidyo Room: WarpCore
 
The Open WebApps QA  meeting is being held each monday morning. For notes of previous meetings please check the references below:
 
* 2011
** [[Apps/QA/Meetings/110920|2011-09-20]]
** [[Apps/QA/Meetings/110926|2011-09-26]]
** [[Apps/QA/Meetings/111003|2011-10-03]]
** [[Apps/QA/Meetings/111024|2011-10-24]]
** [[Apps/QA/Meetings/111031|2011-10-31]]
** [[Apps/QA/Meetings/110711|2011-11-07]]
** [[Apps/QA/Meetings/111411|2011-11-14]]
 
== Q4/11  ==


{| class="fullwidth-table"
{| class="fullwidth-table"
|-
|-
| style="background:#EFEFEF; width: 15%" | Project
| style="background:#EFEFEF; width: 15%" | Component
| style="background:#EFEFEF; width: 15%" | Lead QA
| style="background:#EFEFEF; width: 15%" | Tracking Bug
| style="background:#EFEFEF; width: 10%" | Status QA
| style="background:#EFEFEF; width: 10%" | P1 and P2 Bugs
| style="background:#EFEFEF; width: 10%" | Q4 Plan
|- valign="top"
|- valign="top"
| MarketPlace OWA
| [[Apps/QA/WebAPI|MozApps API]]
| Krupa Raj
| [https://bugzilla.mozilla.org/show_bug.cgi?id=746465 Tracking]
| on track / blocked / at risk<br>
| N/A
| [[Apps/QA/MarketPlace/TestPlan/QuarterlyPlan|QA/Marketplace]]
|- valign="top"
|- valign="top"
| Native Install Android
| [https://wiki.mozilla.org/Apps/QA/MarketPlace Marketplace]
| Aaron Train
| [https://bugzilla.mozilla.org/show_bug.cgi?id=735054 Tracker]
| In Progress
| [http://bit.ly/HIsSEL Bug List]
| [[Apps/QA/Native Install Android|Native Install Android]]
|- valign="top"
|- valign="top"
| OWA Extension
| Apps in the Cloud
| Mohamed Dabbagh
| N/A
| on track / blocked / at risk<br>
| N/A
| [https://wiki.mozilla.org/Apps/QA/OWA_Extension QA/Extension]
|- valign="top"
|- valign="top"
| HTML5 Shim
| [https://wiki.mozilla.org/Web_Apps_integration Web Apps Integration into Firefox]
| David Clarke
| [https://bugzilla.mozilla.org/show_bug.cgi?id=731054 Tracker]
| on track / blocked / at risk<br>
| [https://bugzilla.mozilla.org/buglist.cgi?list_id=2571547;field0-0-0=blocked;resolution=---;query_format=advanced;bug_status=UNCONFIRMED;bug_status=NEW;bug_status=ASSIGNED;bug_status=REOPENED;type0-0-0=equals;value0-0-0=731054 Bug List]
| [[Apps/QA/Quarterly Plan|QA/Quarterly_Plan]]
|}
 
<br> The plan for Q4 is to deliver an app infrastructure capable of supporting 10's of thousands of users. We aim to do this by executing on the following concepts.  
 
#Test Reuse across the different software delivery platforms. Meaning unit tests should run across firefox+extension, ie (9/10), chrome, firefox.  
#Market Place testing will be purely selenium based, and will execute test cases across Android Devices as well as the desktop.
#Android Native Application will most likely be a manual effort, but we will work towards devising a strategy that makes sense as time permits.
#Load Testing. The relevant pieces of the platform that need to be tested are the following: WebApps Web Service, Receipt Verification, App Sync Service. * There is a need to verify browserid can handle the load.
#Mozmill Automation across desktop. This is an easy win for reliability, but still requires a fair amount of work to get a set of tests written / shared API's etc.
 
Sprint 1.  
 
#Need experts in writing mozmill tests, so we can focus on other parts of the infrastructure
#Need to have clear goals from the QA Leads as how we intend to execute on the company strategy.
 
Android Testing: On Hold until software delivery.
 
#Exploration into load testing.
##Investigate tool set required for the driving / reporting of load within our test infrastructure.  
##Any ability to cache images
 
== Q3/11  ==
 
Goal for Q3 is to release a 1.0 version of the HTML5 Web Apps Store. There are a few different products that will be shipping simultaneously, but there will be some that can be tested separately.
 
{| class="fullwidth-table"
|-
| style="background:#EFEFEF; width: 15%" | Project
| style="background:#EFEFEF; width: 15%" | Lead Developer
| style="background:#EFEFEF; width: 10%" | Spec Reviewed
| style="background:#EFEFEF; width: 10%" | When can we begin testing?
| style="background:#EFEFEF; width: 10%" | Test Strategy
|- valign="top"
|- valign="top"
| MarketPlace OWA
| Desktop Runtime
| Wil Clouser
| [https://bugzilla.mozilla.org/show_bug.cgi?id=737571 Tracker]
| No
| [https://bugzilla.mozilla.org/buglist.cgi?list_id=2571547;field0-0-0=blocked;resolution=---;query_format=advanced;bug_status=UNCONFIRMED;bug_status=NEW;bug_status=ASSIGNED;bug_status=REOPENED;type0-0-0=equals;value0-0-0=737571 Bug List]
| 09/??/2011
| [[/MarketPlace|MarketPlace]]
|- valign="top"
|- valign="top"
| Native Install Android
| [[Apps/QA/Dashboard|Dashboard]]
| Anant Narayanan
| [https://bugzilla.mozilla.org/show_bug.cgi?id=710315 Tracker]
| No
| [https://bugzilla.mozilla.org/buglist.cgi?priority=P1&priority=P2&field0-0-0=blocked&classification=Server%20Software&query_format=advanced&bug_status=UNCONFIRMED&bug_status=NEW&bug_status=ASSIGNED&bug_status=REOPENED&type0-0-0=equals&value0-0-0=710315&product=Web%20Apps&component=Dashboard Bug List]
| End of October 2011
| [[Apps/QA/Native_Install_Android|Native Install Android]]
|- valign="top"
| Dashboards
| Dan Walkowski
| Yes
| 9/??/2011
| [[#Dashboards|Dashboards]]
|- valign="top"
| OWA Extension
| Anant, Shane, (Mike Hanson)
| No
| 09/??/2011
| [[/OWA Extension|OWA Extension]]
|- valign="top"
| WebAPI's
| Ian Bicking / Mike Hanson
| No
| Continuous Change / Integration
| [[/WebAPI| OWA WebAPI]]
|}
|}


== Community ==
== Community ==
# What is cool about WebApps ?
  This is the latest and greatest web technologies on the market. 
  The development team is delivering a mind blowing experience, and we are hoping to do the same in QA
# How do I get involved ?
  Well join up in irc #openwebapps, or #automation. 
  Contact myself dclarke@mozilla.com
# Where do we need help ?
  Everywhere.  :)
  Manual Testing, Automation (mobile, desktop), Javascript
# Technologies we are running with ?
  Javascript, HTML5, Mozmill, Selenium, Jstestnet, Doctestjs. 
  If you are looking to help out, improve your skills.
  Feel free to contact and we will get you dialed into the project.
== Bugs ==
[[Image:Webapps_Bug_Flow.png]]
=== Relevant Bugzilla Queries / Tracking Bugs ===
==== Dashboard ====
Tracking Bug<br>
https://bugzilla.mozilla.org/show_bug.cgi?id=710315
https://bugzilla.mozilla.org/buglist.cgi?priority=P1&priority=P2&field0-0-0=blocked&classification=Server%20Software&query_format=advanced&bug_status=UNCONFIRMED&bug_status=NEW&bug_status=ASSIGNED&bug_status=REOPENED&type0-0-0=equals&value0-0-0=710315&product=Web%20Apps&component=Dashboard
==== Marketplace ====
Tracking Bug<br>
https://bugzilla.mozilla.org/show_bug.cgi?id=710074
P1 & P2 Bugs:<br>
https://bugzilla.mozilla.org/buglist.cgi?priority=P1&priority=P2&field0-0-0=blocked&classification=Server%20Software&query_format=advanced&bug_status=UNCONFIRMED&bug_status=NEW&bug_status=ASSIGNED&bug_status=REOPENED&type0-0-0=equals&value0-0-0=710074&product=addons.mozilla.org
==== Extension ====
Tracking Bug<br>
https://bugzilla.mozilla.org/show_bug.cgi?id=710337
P1 & P2 Bug <br>
https://bugzilla.mozilla.org/buglist.cgi?priority=P1&priority=P2&field0-0-0=blocked&classification=Server%20Software&query_format=advanced&bug_status=UNCONFIRMED&bug_status=NEW&bug_status=ASSIGNED&bug_status=REOPENED&type0-0-0=equals&value0-0-0=710337&product=Web%20Apps&component=Extension
==== Soup ====
Tracking Bug <br>
https://bugzilla.mozilla.org/show_bug.cgi?id=710334
P1&P2 Bugs <br>
https://bugzilla.mozilla.org/buglist.cgi?priority=P1&priority=P2&field0-0-0=blocked&classification=Server%20Software&query_format=advanced&bug_status=UNCONFIRMED&bug_status=NEW&bug_status=ASSIGNED&bug_status=REOPENED&type0-0-0=equals&value0-0-0=710334&product=Web%20Apps&component=Soup
==== AppSync ====
Tracking Bug<br>
https://bugzilla.mozilla.org/show_bug.cgi?id=710342
P1&P2 Bugs <br>
https://bugzilla.mozilla.org/buglist.cgi?priority=P1&priority=P2&field0-0-0=blocked&classification=Server%20Software&query_format=advanced&bug_status=UNCONFIRMED&bug_status=NEW&bug_status=ASSIGNED&bug_status=REOPENED&type0-0-0=equals&value0-0-0=710342&product=Web%20Apps&component=AppSync
== Architecture  ==
[[Image:Webappspurchaseflow.png|200px200px]]


Legend
We need help from our community to guarantee that the Open Web Apps platform will be excellent. With your help, you can gain a lot of experience working in a real-life release process of an important platform to capture bugs, run tests, write tests, and many more. If you are interested, then take a look at our [[Apps/QA/Community Tasks|community tasks]] and see if there is anything you would like to help with. If you have any questions, or if you want to sign up to help, please come find us on [http://chat.mibbit.com/?server=irc.mozilla.org&channel=qa IRC] or email [mailto:jsmith@mozilla.com Jason Smith].
#Client possibly initiates a browserID session
##Client goes to the marketplace, and a browserid login is presented
#Client goes to the marketplace
#Client initiates an install off an app
##Navigator.mozApps.install
#App is installed, user opens app
#Twitter app is launched
#Twitter app verifies the receipt that was presented.
#Apps Sync occurs ad-hoc manner, still unsure as to the schedule.  


<br>
== Important Links ==


The basics behind open webapps architecture is to allow for HTML5 apps to flourish. To do that a few things infrastructure pieces need to be in place.  
* [https://intranet.mozilla.org/images/1/19/Open-web-apps-v7-FINAL.pdf Open Web Apps User Study]
# Firefox needs to support navigator.mozApps
* [[Apps/QA/MochiTest | MochiTests]]
# HTML5 App Managmement in case no OWA Extension is installed.
* [[Apps/QA/Top Apps Analysis Strategy | Top Apps Analysis Strategy]]
# Store needs to support both the issuing of payment receipts as well as the verification of receipt information
* [[Apps/QA/Meetings|Past Meeting Notes]]
# Apps Need to be able to run from the desktop or in browser.
# The navigator.mozApps is the javascript object that will manage installing / removing apps
# Iframes are used to manage the communication channel between the Application Repo and the Dashboard
# Application Sync is managed through a separate API.


== References ==
== Outdated References ==


* [[Apps/Architecture]]
* [[Apps/QA/OWA_Extension|Past OWA Extension Documentation]]
* [[Apps/QA/Native Install Android|Past Native Install Android Documentation]]
* [[Apps/QA/Quarterly Goals|Past Apps QA Quarterly Goals]]
* [[Apps/QA/Bug Workflow|Past Bug Workflow]]
* [[Apps/Architecture|Architecture]]
* [[Apps/QA/Test Infrastructure | Test Infrastructure]]

Latest revision as of 16:28, 12 May 2012

Overview

Welcome to the Web Apps QA team! We focus on testing the Open Web Apps platform that allows HTML 5 applications to run on any device. We also focus our testing on the marketplace to allow consumers to get apps they desire and seller to sell their apps. Interested in helping us test this platform? Then, see the community section on how to get started helping us out.

Team

Kilimanjaro QA Lead: Stephen Donner
QA MozApps API: David Clarke
QA Desktop Automation Framework: David Burns
QA Mobile for WebRT & AITC: Aaron Train
QA Marketplace: Krupa Raj
QA Desktop for WebRT & AITC: Jason Smith
QA AITC Server: James Bonacci

Components

Component Tracking Bug P1 and P2 Bugs
MozApps API Tracking N/A
Marketplace Tracker Bug List
Apps in the Cloud N/A N/A
Web Apps Integration into Firefox Tracker Bug List
Desktop Runtime Tracker Bug List
Dashboard Tracker Bug List

Community

We need help from our community to guarantee that the Open Web Apps platform will be excellent. With your help, you can gain a lot of experience working in a real-life release process of an important platform to capture bugs, run tests, write tests, and many more. If you are interested, then take a look at our community tasks and see if there is anything you would like to help with. If you have any questions, or if you want to sign up to help, please come find us on IRC or email Jason Smith.

Important Links

Outdated References

Retrieved from "https://wiki.mozilla.org/index.php?title=Apps/QA&oldid=430174"