Apps/QA/Native Install Android: Difference between revisions

From MozillaWiki
< Apps‎ | QA
Jump to navigation Jump to search
 
(18 intermediate revisions by one other user not shown)
Line 10: Line 10:
|- valign="top"
|- valign="top"
| '''Lead Developer:'''  
| '''Lead Developer:'''  
| [mailto:anant@mozilla.com Anant Narayanan]
| [mailto:hkirschner@mozilla.com Harald Kirschner]
|}
|}


Line 16: Line 16:
Here is a quick start guide to get you to install a signed copy of the latest version for install in Android of the native open web apps application:
Here is a quick start guide to get you to install a signed copy of the latest version for install in Android of the native open web apps application:


Github Repository: [https://github.com/anantn/soup https://github.com/anantn/soup]
Github Repository: [https://github.com/mozilla/soup https://github.com/mozilla/soup]


Build instructions
Build instructions
# Clone the [https://github.com/anantn/soup Git repository]
# Clone the [https://github.com/mozilla/soup Git repository]
# Download the [http://developer.android.com/sdk/index.html Android SDK]
# Download the [http://developer.android.com/sdk/index.html Android SDK]
# Import the project into [http://www.eclipse.org/ Eclipse]
# Import the project into [http://www.eclipse.org/ Eclipse]
Line 28: Line 28:


Join us on [http://chat.mibbit.com/?server=irc.mozilla.org&channel=%23openwebapps #openwebapps] and [http://chat.mibbit.com/?server=irc.mozilla.org&channel=%23QA #QA]
Join us on [http://chat.mibbit.com/?server=irc.mozilla.org&channel=%23openwebapps #openwebapps] and [http://chat.mibbit.com/?server=irc.mozilla.org&channel=%23QA #QA]
Prebuilt Android Package Binaries
* [http://people.mozilla.org/~dclarke/openwebapps/Soup/latest/Soup.apk Tap here to download]


== Introduction ==  
== Introduction ==  
Line 43: Line 46:
* Installed Open Web Applications
* Installed Open Web Applications
** When one invokes an open web application, it invokes in a chrome-less window providing the appearance of a traditional Android application
** When one invokes an open web application, it invokes in a chrome-less window providing the appearance of a traditional Android application
* Support for purchasable applications
** Ability to cycle through and purchase applications through PayPal transactions
* BrowserID sign-on
** Single point BrowserID sign-in providing transition from dashboard to market


== Risks ==
== Risks ==
Line 51: Line 58:
* Deliverance of PayPal integration to support the handling of paid applications
* Deliverance of PayPal integration to support the handling of paid applications
* BrowserID integration
* BrowserID integration
* AppSync integration and utilization
* Cross-platform compliance to iOS using a PhoneGap solution
* Cross-platform compliance to iOS using a PhoneGap solution


Line 59: Line 67:
The testing process involves:
The testing process involves:


# Tester should install (if builds are hosted) or compile latest code from [https://github.com/anantn/soup this Github repository]
# Tester should install (if builds are hosted) or compile latest code from [https://github.com/mozilla/soup this Github repository]; alongside [https://bugzilla.mozilla.org/ Bugzilla].
# Tester will verify any bugs that have been resolved with the associated build
# Tester will verify any bugs that have been resolved with the associated build
# (Tester will run automation tests to make sure no regressions have occurred)
# (''Tester will run automation tests to make sure no regressions have occurred'')
# Tester will run using manual test cases and exploratory testing as well
# Tester will run using manual test cases and exploratory testing as well
# Teser will file new bugs as necessary
# Teser will file new bugs as necessary
Line 67: Line 75:


'''NOTE''': A new product will be created on [https://litmus.mozilla.org/ Litmus], and test-run will be created on [https://litmus.mozilla.org/ Litmus] in order to run the manual suite of tests.
'''NOTE''': A new product will be created on [https://litmus.mozilla.org/ Litmus], and test-run will be created on [https://litmus.mozilla.org/ Litmus] in order to run the manual suite of tests.
'''Soup for Android'''


{| cellspacing="1" cellpadding="1" border="1"
{| cellspacing="1" cellpadding="1" border="1"
Line 74: Line 84:
|-
|-
| colspan="3" | Native installation and management capabilities  
| colspan="3" | Native installation and management capabilities  
| colspan="2" | ETA End of Oct
| colspan="2" | Q4 2011
|-
|-
| colspan="3" |  
| colspan="3" | Implement device permissions
| colspan="2" | <br>
| colspan="2" | TBD
|-
|-
| colspan="3" |  
|}
| colspan="2" | <br>
<br>
'''Soup base code on WebKit'''
 
{| cellspacing="1" cellpadding="1" border="1"
|-
| align="center" colspan="3" | '''Major Milestones''' / '''Stories'''<br>
| colspan="2" | '''Date'''<br>
|-
| colspan="3" | Implements navigator.mozApps
| colspan="2" | Done
|-
| colspan="3" | Talks to AppSync service
| colspan="2" | Q4 2011
|-
| colspan="3" | Integrates with BrowserID
| colspan="2" | Q4 2011
|-
| colspan="3" | Provide simple "about:apps" app list
| colspan="2" | Q4 2011
|-
| colspan="3" | Packaged as a PhoneGap app
| colspan="2" | Q4 2011
|-
| colspan="3" | Solves pre-auth problem
| colspan="2" | Q4 2011
|-
|-
| colspan="3" |
| colspan="2" | <br>
|}
|}
<br>
<br>
'''Test Cases'''
'''Test Cases'''
Line 94: Line 127:
== Release Criteria  ==
== Release Criteria  ==


''' Developer Preview '''
{| cellspacing="1" cellpadding="1" border="1" style="width: 1000px; height: 45px;"
{| cellspacing="1" cellpadding="1" border="1" style="width: 1000px; height: 45px;"
|-
|-
Line 108: Line 142:
| Ability to purchase free and paid Open Web Applications through using PayPal
| Ability to purchase free and paid Open Web Applications through using PayPal
|-
|-
| width="50" | P2
| width="50" | P1
| Ability to navigate the Open Web Applications store on live site
| Ability to navigate the Open Web Applications store on live site
|-
|-
| width="50" | P3
| width="50" | P1
| (Future) BrowserID login to utilize Mozilla Sync API's to sync Open Web Applications
| BrowserID login to utilize Mozilla Sync API's to sync Open Web Applications
|}
 
<br />
''' Post Developer Preview - Q1 2012 '''
{| cellspacing="1" cellpadding="1" border="1" style="width: 1000px; height: 45px;"
|-
| width="50" | '''Priority'''<br>
| align="center" | '''&nbsp;Release Invariant'''<br>
|-
|}
|}


Line 118: Line 161:
=== Manual Testing ===
=== Manual Testing ===
'''What do we test'''
'''What do we test'''
* [https://docs.google.com/spreadsheet/ccc?key=0AhE7m4JB2j6tdFlrTVlLYVZ3bVhHYm95T0JzWVdYYlE&hl=en_US#gid=5 Test Cases Document]
'''What we do not test'''
'''What we do not test'''
* Fennec front-end integration with Navigator.MozApps JavaScript Open Web Apps API interactions (i.e., installing, managing, uninstalling and granting permissions to web-apps)
* Fennec front-end integration with Navigator.MozApps JavaScript Open Web Apps API interactions (i.e., installing, managing, uninstalling and granting permissions to web-apps)
Line 126: Line 170:
== Release Management ==
== Release Management ==
=== Entry Criteria ===
=== Entry Criteria ===
# Builds & staging are available for testing with the features to be QA'ed
# QA has all the details including specs and scope of details to be verified
# QA has all the details including specs and scope of details to be verified
=== Exit Criteria ===
=== Exit Criteria ===
# All the features targeted for Phase I have been QA'ed
# All the features targeted for Phase I have been QA'ed
Line 147: Line 193:


== Bug Tracking ==
== Bug Tracking ==
=== Bugzilla ===
'''Bugzilla Queries'''
* [https://bugzilla.mozilla.org/buglist.cgi?list_id=1704343&classification=Other&query_format=advanced&component=Soup&product=Web%20Apps All Bugs]
* [https://bugzilla.mozilla.org/buglist.cgi?list_id=1704348&resolution=FIXED&classification=Other&query_format=advanced&bug_status=RESOLVED&component=Soup&product=Web%20Apps All RESOLVED FIXED Bugs]
* [https://bugzilla.mozilla.org/buglist.cgi?list_id=1704348&resolution=FIXED&classification=Other&query_format=advanced&bug_status=VERIFIED&component=Soup&product=Web%20Apps All VERIFIED FIXED bugs]
=== Github Repostory ===  
=== Github Repostory ===  
==== Issues ====
==== Issues ====
Line 152: Line 203:
* [https://github.com/anantn/soup/issues/2 Supply a drawable resource and label for org.mozilla.labs.WEBAPP intent]
* [https://github.com/anantn/soup/issues/2 Supply a drawable resource and label for org.mozilla.labs.WEBAPP intent]


== Tasks ==
== Tasks ==


The following is the current list of tasks being worked on. Please feel free to take any task that is not already claimed or if you would like to help, please contact the person under the 'Assigned' column.
The following is the current list of tasks being worked on. Please feel free to take any task that is not already claimed or if you would like to help, please contact the person under the 'Assigned' column.  


{| cellspacing="1" cellpadding="1" border="1"
{| cellspacing="1" cellpadding="1" border="1"
Line 164: Line 215:
! width="100" scope="col" | Priority
! width="100" scope="col" | Priority
|-
|-
| Determine specifications/requirements for the application and Open Web Apps to use as reference for manual test cases
| Determine specifications/requirements for the application and Open Web Apps to use as reference for manual test cases  
| In Progress
| All the available documentation that is being used to track the progress the of the extension and to aid in creating test cases can be found below under Documents/Links.
| AaronMT
| P1
|-
| Create manual test cases for the application
| In Progress
| In Progress
| All the available documentation that is being used to track the progress the of the extension and to aid in creating test cases can be found below under Documents/Links.
| Manual test cases will be [https://docs.google.com/spreadsheet/ccc?key=0AhE7m4JB2j6tdFlrTVlLYVZ3bVhHYm95T0JzWVdYYlE&hl=en_US#gid=0 tracked here], and questions will be [https://docs.google.com/spreadsheet/ccc?key=0AhE7m4JB2j6tdHc4Rk1kY1FUQVdMM3FDdURjVmMyWVE&hl=en_US tracked here]
| AaronMT
| AaronMT
| P1
| P2
|-
|Start testing the native Android application
|Blocked
|Akin to the OWA extension, there is currently not much that is ready to be tested. Eyeing repository awaiting further commits. Have approached Anant, to request a schedule or timeline but none was provided.
|AaronMT
|P1
|-
|}
|}


Line 176: Line 240:


*[https://developer.mozilla.org/en/Apps/Apps_JavaScript_API Apps JavaScript API - MDN]
*[https://developer.mozilla.org/en/Apps/Apps_JavaScript_API Apps JavaScript API - MDN]
*[https://docs.google.com/spreadsheet/ccc?key=0AiZoGR-iOAlUdHVQemJDVjBQSXdvc01QN1BiYm43QlE#gid=0 Tier 1 Mobile App Gecko vs Webkit]
*[http://people.mozilla.com/~atrain/webapps/tier1-screenshots/ Tier 1 Phone Gecko vs Webkit Screenshots]
*[https://intranet.mozilla.org/File:Mobile-app-user-flows-DML-1128am.pdf Mobile Application User Flow (Design document)]
*[https://intranet.mozilla.org/File:Mobile-app-user-flows-DML-1128am.pdf Mobile Application User Flow (Design document)]


Line 184: Line 250:
*[https://wiki.mozilla.org/Apps/Overview Apps Overview - Main]
*[https://wiki.mozilla.org/Apps/Overview Apps Overview - Main]
*[https://docs.google.com/spreadsheet/ccc?key=0AhE7m4JB2j6tdHc4Rk1kY1FUQVdMM3FDdURjVmMyWVE&hl=en_US#gid=0 Android (PhoneGap) and Apps Questions]
*[https://docs.google.com/spreadsheet/ccc?key=0AhE7m4JB2j6tdHc4Rk1kY1FUQVdMM3FDdURjVmMyWVE&hl=en_US#gid=0 Android (PhoneGap) and Apps Questions]
Testing Related
*[https://apps-preview-dev.allizom.org/en-US/firefox/users/login Apps Preview Dev]

Latest revision as of 08:12, 8 March 2012

Android Native Install (Soup)
QA Lead: Aaron Train
Lead Developer: Harald Kirschner

Quick Start Guide

Here is a quick start guide to get you to install a signed copy of the latest version for install in Android of the native open web apps application:

Github Repository: https://github.com/mozilla/soup

Build instructions

  1. Clone the Git repository
  2. Download the Android SDK
  3. Import the project into Eclipse
  4. Configure the project properties to target Android API Level 8 (Android 2.2 (Froyo))
  5. Build and Run

Compile and build 'Soup' from the Android project (targeting Android API Level 8). Enable 'Install form Unknown Sources' on your Android device under Application Settings. Once installed, you may find the application in the Android application launcher.

Join us on #openwebapps and #QA

Prebuilt Android Package Binaries

Introduction

This quarter we will see emerge the essential Mozilla application store marketplace and native Android open web application management application. The application will be built using PhoneGap utilizing cross-platform languages such as HTML/CSS and JavaScript, and using APIs provided by Apps JavaScript API and addons.mozilla.org to provide a list of installable applications. In essence, upon completion of a transaction (wether it be installing a free or paid open web application), the result of the install action is to download and install an open web application to the users Android home screen. Invoking an open web application will launch its associated web site in a WebKit runtime.

Mobile Technologies

Native Android Application

  • Support for installable applications
    • The Android application understands what a web application is, and helps one manage ones list of applications
      • Application metadata storage
      • Installation query/management API
  • Support for permission requests
    • When an application is installed, it can request a number of permissions at once
  • Installed Open Web Applications
    • When one invokes an open web application, it invokes in a chrome-less window providing the appearance of a traditional Android application
  • Support for purchasable applications
    • Ability to cycle through and purchase applications through PayPal transactions
  • BrowserID sign-on
    • Single point BrowserID sign-in providing transition from dashboard to market

Risks

With such an assemblage of utility as described from the requirements, there are multiple negative risks:

  • Deliverance of dependancy of deployed market with curated applications
  • Deliverance of PayPal integration to support the handling of paid applications
  • BrowserID integration
  • AppSync integration and utilization
  • Cross-platform compliance to iOS using a PhoneGap solution

Milestones

Testing of the native Android application must focus on a variety of modules that comprise the specified requirements including native installation capabilities and launching of associated open web applications in a chromeless window. In essence, we should extract all requirements and specifications from the application to create manual regression test cases. Exploratory methods and smoke-tests should also cover a more advanced set of test cases. A proper sandboxed environment should be used for testing.

The testing process involves:

  1. Tester should install (if builds are hosted) or compile latest code from this Github repository; alongside Bugzilla.
  2. Tester will verify any bugs that have been resolved with the associated build
  3. (Tester will run automation tests to make sure no regressions have occurred)
  4. Tester will run using manual test cases and exploratory testing as well
  5. Teser will file new bugs as necessary
  6. Tester will create new test cases as necessary and make sure the current test cases are up to date

NOTE: A new product will be created on Litmus, and test-run will be created on Litmus in order to run the manual suite of tests.

Soup for Android

Major Milestones / Stories
 Date
Native installation and management capabilities Q4 2011
Implement device permissions TBD


Soup base code on WebKit

Major Milestones / Stories
 Date
Implements navigator.mozApps Done
Talks to AppSync service Q4 2011
Integrates with BrowserID Q4 2011
Provide simple "about:apps" app list Q4 2011
Packaged as a PhoneGap app Q4 2011
Solves pre-auth problem Q4 2011


Test Cases

A set of test cases are being created that focus on manual testing strategies. The main functionality document being used to aid in the creation fo the test cases can be found here. The document is split up into worksheets relating to a function/area to test. Questions regarding this document should refer to Aaron (irc:AaronMT).

There are quite a few questions that should be answered in order to have a good understanding of the requirements and full capabilities are of the Android application. Answering these questions is crucial in having a solid set of manual test cases. The list of questions is being tracked here. Please feel free to update the document and add any other questions or answer some of the questions there already.

Release Criteria

Developer Preview

Priority
  Release Invariant
P1 Installation and management capabilities for Open Web Applications
P1 Successful launch of associated Open Web Application into WebKit (Chromeless) window
P1 Ability to purchase free and paid Open Web Applications through using PayPal
P1 Ability to navigate the Open Web Applications store on live site
P1 BrowserID login to utilize Mozilla Sync API's to sync Open Web Applications


Post Developer Preview - Q1 2012

Priority
  Release Invariant

Test Plan

Manual Testing

What do we test

What we do not test

  • Fennec front-end integration with Navigator.MozApps JavaScript Open Web Apps API interactions (i.e., installing, managing, uninstalling and granting permissions to web-apps)

Automation

Currently there is no automation in the testing of the native Android application. Efforts are involved in investing Robotium as a candiate for utility and test creation.

Release Management

Entry Criteria

  1. Builds & staging are available for testing with the features to be QA'ed
  2. QA has all the details including specs and scope of details to be verified

Exit Criteria

  1. All the features targeted for Phase I have been QA'ed
  2. All P1's, P2's, Blocker and Critical bugs have been verified by QA or have been marked [QA-] as not needing verification
  3. QA has apprised stakeholders on IRC or through E-Mail of the testing performed, and the outstanding bug list
  4. Stakeholders from QA, Dev and Product have met to discuss pre-release readiness of the release
  5. All stakeholders have signed off on the release
  6. QA runs sanity tests after push to Android market

Test Cases

Mobile App User Integration Flow

  • Native Android application on Android Market
  • Buying Etherpal (Free Application)
  • First-time BrowserID user
  • Native Android application on Android Market
  • Buying Evernote (after having bought a free application)
  • Returning BrowserID user
  • First-time PayPal user

Bug Tracking

Bugzilla

Bugzilla Queries

Github Repostory

Issues

Tasks

The following is the current list of tasks being worked on. Please feel free to take any task that is not already claimed or if you would like to help, please contact the person under the 'Assigned' column.

Task Description
 Status
 Comments/Notes
 Assigned
 Priority
Determine specifications/requirements for the application and Open Web Apps to use as reference for manual test cases In Progress All the available documentation that is being used to track the progress the of the extension and to aid in creating test cases can be found below under Documents/Links. AaronMT P1
Create manual test cases for the application In Progress Manual test cases will be tracked here, and questions will be tracked here AaronMT P2
Start testing the native Android application Blocked Akin to the OWA extension, there is currently not much that is ready to be tested. Eyeing repository awaiting further commits. Have approached Anant, to request a schedule or timeline but none was provided. AaronMT P1

Documents / Links

Documentation

Links

Testing Related

Retrieved from "https://wiki.mozilla.org/index.php?title=Apps/QA/Native_Install_Android&oldid=405265"