Apps/QA: Difference between revisions

From MozillaWiki
Jump to navigation Jump to search
No edit summary
Line 22: Line 22:
  | [mailto:jsmith@mozilla.com Jason Smith]
  | [mailto:jsmith@mozilla.com Jason Smith]
|}
|}
== Meeting Notes ==
*https://mozqa.etherpad.mozilla.org/mozappsqa-111111
*https://mozqa.etherpad.mozilla.org/mozappsqa-111811
*https://mozqa.etherpad.mozilla.org/mozappsqa-112311
*https://mozqa.etherpad.mozilla.org/mozappsqa-120111
*https://mozqa.etherpad.mozilla.org/mozappsqa-120911
*https://mozqa.etherpad.mozilla.org/mozappsqa-121611
=== Deprecated ===
https://mozqa.sync.in/apps-qa-2011


== Meetings ==
== Meetings ==
Line 40: Line 30:
   # Vidyo Room: WarpCore
   # Vidyo Room: WarpCore


The Open WebApps QA  meeting is being held each monday morning. For notes of previous meetings please check the references below:
The Open Web Apps QA  meeting is being held each Monday at 1:30pm. For notes of previous meetings please check the references below:
 
* [[Apps/QA/Meetings/110920|2011-09-20]]
* [[Apps/QA/Meetings/110926|2011-09-26]]
* [[Apps/QA/Meetings/111003|2011-10-03]]
* [[Apps/QA/Meetings/111024|2011-10-24]]
* [[Apps/QA/Meetings/111031|2011-10-31]]
* [[Apps/QA/Meetings/110711|2011-11-07]]
* [[Apps/QA/Meetings/111411|2011-11-14]]
* https://mozqa.etherpad.mozilla.org/mozappsqa-111111
* https://mozqa.etherpad.mozilla.org/mozappsqa-111811
* https://mozqa.etherpad.mozilla.org/mozappsqa-112311
* https://mozqa.etherpad.mozilla.org/mozappsqa-120111
* https://mozqa.etherpad.mozilla.org/mozappsqa-120911
* https://mozqa.etherpad.mozilla.org/mozappsqa-121611


* 2011
=== Deprecated ===
** [[Apps/QA/Meetings/110920|2011-09-20]]
https://mozqa.sync.in/apps-qa-2011
** [[Apps/QA/Meetings/110926|2011-09-26]]
** [[Apps/QA/Meetings/111003|2011-10-03]]
** [[Apps/QA/Meetings/111024|2011-10-24]]
** [[Apps/QA/Meetings/111031|2011-10-31]]
** [[Apps/QA/Meetings/110711|2011-11-07]]
** [[Apps/QA/Meetings/111411|2011-11-14]]


== Q4/11  ==
== Q4/11  ==

Revision as of 19:58, 27 January 2012

Overview

Purpose of this page is to provide a level of communication / information flow across the different QA Teams to allow for the testing of the HTML5 Web Store. The purpose of this page is not to explain QA team structure, provide status or provide a background into HTML5 web apps in general.

QA Lead David Clarke
QA Automation: Henrik Skupin
QA Mobile: Aaron Train, James Bonacci
QA MarketPlace: Zac Campbell, Krupa Raj, Marlena Compton
QA OWA Extension: Jason Smith

Meetings

Dial in

 # 650-903-0800 or 650-215-1282 x92 Conf# 315 (US/INTL)
 # 1-800-707-2533 (pin 369) Conf# 315 (US)
 # irc.mozilla.org #qa for backchannel
 # Vidyo Room: WarpCore

The Open Web Apps QA meeting is being held each Monday at 1:30pm. For notes of previous meetings please check the references below:

Deprecated

https://mozqa.sync.in/apps-qa-2011

Q4/11

Project Lead QA Status QA Q4 Plan
MarketPlace OWA Krupa Raj on track / blocked / at risk
QA/Marketplace
Native Install Android Aaron Train In Progress Native Install Android
OWA Extension Mohamed Dabbagh on track / blocked / at risk
QA/Extension
HTML5 Shim David Clarke on track / blocked / at risk
QA/Quarterly_Plan


The plan for Q4 is to deliver an app infrastructure capable of supporting 10's of thousands of users. We aim to do this by executing on the following concepts.

  1. Test Reuse across the different software delivery platforms. Meaning unit tests should run across firefox+extension, ie (9/10), chrome, firefox.
  2. Market Place testing will be purely selenium based, and will execute test cases across Android Devices as well as the desktop.
  3. Android Native Application will most likely be a manual effort, but we will work towards devising a strategy that makes sense as time permits.
  4. Load Testing. The relevant pieces of the platform that need to be tested are the following: WebApps Web Service, Receipt Verification, App Sync Service. * There is a need to verify browserid can handle the load.
  5. Mozmill Automation across desktop. This is an easy win for reliability, but still requires a fair amount of work to get a set of tests written / shared API's etc.

Sprint 1.

  1. Need experts in writing mozmill tests, so we can focus on other parts of the infrastructure
  2. Need to have clear goals from the QA Leads as how we intend to execute on the company strategy.

Android Testing: On Hold until software delivery.

  1. Exploration into load testing.
    1. Investigate tool set required for the driving / reporting of load within our test infrastructure.
    2. Any ability to cache images

Q3/11

Goal for Q3 is to release a 1.0 version of the HTML5 Web Apps Store. There are a few different products that will be shipping simultaneously, but there will be some that can be tested separately.

Project Lead Developer Spec Reviewed When can we begin testing? Test Strategy
MarketPlace OWA Wil Clouser No 09/??/2011 MarketPlace
Native Install Android Anant Narayanan No End of October 2011 Native Install Android
Dashboards Dan Walkowski Yes 9/??/2011 Dashboards
OWA Extension Anant, Shane, (Mike Hanson) No 09/??/2011 OWA Extension
WebAPI's Ian Bicking / Mike Hanson No Continuous Change / Integration OWA WebAPI

Community

  1. What is cool about WebApps ?
 This is the latest and greatest web technologies on the market.  
 The development team is delivering a mind blowing experience, and we are hoping to do the same in QA 
  1. How do I get involved ?
 Well join up in irc #openwebapps, or #automation.  
 Contact myself dclarke@mozilla.com
  1. Where do we need help ?
 Everywhere.  :) 
 Manual Testing, Automation (mobile, desktop), Javascript
  1. Technologies we are running with ?
 Javascript, HTML5, Mozmill, Selenium, Jstestnet, Doctestjs.  
 If you are looking to help out, improve your skills. 
 Feel free to contact and we will get you dialed into the project.


Bugs

Webapps Bug Flow.png

Relevant Bugzilla Queries / Tracking Bugs

Dashboard

Tracking Bug
https://bugzilla.mozilla.org/show_bug.cgi?id=710315

https://bugzilla.mozilla.org/buglist.cgi?priority=P1&priority=P2&field0-0-0=blocked&classification=Server%20Software&query_format=advanced&bug_status=UNCONFIRMED&bug_status=NEW&bug_status=ASSIGNED&bug_status=REOPENED&type0-0-0=equals&value0-0-0=710315&product=Web%20Apps&component=Dashboard

Marketplace

Tracking Bug
https://bugzilla.mozilla.org/show_bug.cgi?id=710074

P1 & P2 Bugs:
https://bugzilla.mozilla.org/buglist.cgi?priority=P1&priority=P2&field0-0-0=blocked&classification=Server%20Software&query_format=advanced&bug_status=UNCONFIRMED&bug_status=NEW&bug_status=ASSIGNED&bug_status=REOPENED&type0-0-0=equals&value0-0-0=710074&product=addons.mozilla.org

Extension

Tracking Bug
https://bugzilla.mozilla.org/show_bug.cgi?id=710337

P1 & P2 Bug
https://bugzilla.mozilla.org/buglist.cgi?priority=P1&priority=P2&field0-0-0=blocked&classification=Server%20Software&query_format=advanced&bug_status=UNCONFIRMED&bug_status=NEW&bug_status=ASSIGNED&bug_status=REOPENED&type0-0-0=equals&value0-0-0=710337&product=Web%20Apps&component=Extension

Soup

Tracking Bug
https://bugzilla.mozilla.org/show_bug.cgi?id=710334

P1&P2 Bugs
https://bugzilla.mozilla.org/buglist.cgi?priority=P1&priority=P2&field0-0-0=blocked&classification=Server%20Software&query_format=advanced&bug_status=UNCONFIRMED&bug_status=NEW&bug_status=ASSIGNED&bug_status=REOPENED&type0-0-0=equals&value0-0-0=710334&product=Web%20Apps&component=Soup

AppSync

Tracking Bug
https://bugzilla.mozilla.org/show_bug.cgi?id=710342

P1&P2 Bugs
https://bugzilla.mozilla.org/buglist.cgi?priority=P1&priority=P2&field0-0-0=blocked&classification=Server%20Software&query_format=advanced&bug_status=UNCONFIRMED&bug_status=NEW&bug_status=ASSIGNED&bug_status=REOPENED&type0-0-0=equals&value0-0-0=710342&product=Web%20Apps&component=AppSync

Important Links