QA/WebVR: Difference between revisions

From MozillaWiki
< QA
Jump to navigation Jump to search
Line 116: Line 116:
     "summary": "webvr",
     "summary": "webvr",
     "status":["CLOSED"],
     "status":["CLOSED"],
    "changed":"<2m",
     "include_fields": "id, summary, product, component, status, resolution"
     "include_fields": "id, summary, product, component, status, resolution"
   }
   }

Revision as of 22:50, 22 April 2016

Overview

Purpose

Ownership

Developer contacts: Kearwood Kip Gilbert
QA: Naoki Hirata (:nhirata_), Cornel Ionce (:cornel_ionce)

Testing Summary

Introduction

This is a hybrid test plan of ACC and traditional test plan in regards to the WebVR API

Scope of testing

In Scope

The current testing scope is to ensure that the WebVR API:

  1. does not have regressions in performance or latency
  2. is stable
  3. is reliable ( visibility )

Requirements for testing

Environments

Testing will be performed on following OSes (x64 infrastructures):

  • Windows 10

Hardware

The minimum system requirements for Windows OS are:

  • Graphics
    • GTX 970 equivalent or greater
    • AMD 290 equivalent or greater
    • Quadro k600 or newer
  • CPU
    • Intel i5-4590 equivalent or greater
    • AMD FX 8320 or greater
  • 8GB+ RAM
  • Compatible HDMI 1.3 video output
  • 2x USB 3.0 ports
  • Windows 7 SP1 or newer, plus the DirectX platform update

Devices

  • Oculus Development Kit 2 with positional tracker
    • Note: soon to change to CV1
  • Samsung Internet for Gear VR
    • Note: currently not daily smoked. need to talk to team.

Software

Setup

Oculus

Software setup

Test Strategy

Test Objectives

The test objective is to test the WebVR APIs for stability, visibility and performance.

Test Types

  • Smoke test : this is to hunt for any major regressions that could prevent further testing.
  • Unit Tests : ?
  • Manual Tests: Integration / End to End Tests
    • Manual Test cases : Must hit target testing that can't be automated
    • Session Based testing : Use of Testing outline to perform test cases
  • Automated Tests : Automating as much as possible for integration/end to end tests
  • Performance : Need some way to automated / Dashboard
  • Security : need security team review
  • Usability/Accessibility : ?
  • Metrics/Telemetry : ?

Testing Tools

References

Meta: Bug 1218482 - Enable WebVR By Default on all platforms

Test cases

Test suites

Full Test Suite

Bugs Work

Tracking bug:

Full Query
ID Summary Product Component Status Resolution
1229464 [webvr] Meta bug to track testability of WebVR Core WebVR NEW
1229478 [webvr] Implement Reftests for WebVR Core WebVR NEW
1229479 [webvr] Implement Mochitests for WebVR Core WebVR NEW
1236730 [webvr] Implement WEBGL_shared_resources Core Graphics: CanvasWebGL NEW
1237489 [webvr] Add basic MOZ_texture_from_element to enable creating a texture from an arbitrary element Core Graphics: CanvasWebGL NEW
1258504 [webvr] Implement VR Compositor to submit WebVR frames to HMD drivers Core WebVR NEW
1260561 [webvr] Implement Oculus Remote controller inputs Core WebVR NEW
1272458 [meta][webvr] Make Firefox installable and launchable from platforms. Core WebVR NEW
1276711 [webvr] Implement Direct Mode Rendering for OSVR on Windows Core WebVR NEW
1276712 [webvr] [meta] Enable OSVR VR Support Core WebVR NEW
1276715 [webvr] Enable OSVR VR Support by default on Windows Core WebVR NEW
1287929 [webvr] Need to present content to replace "Please wait" spinner before requestPresent() and during WebVR link traversal Core WebVR NEW
1291824 [webvr] [meta] Implement 2D Backwards Compatibility for VR Browsing Core Graphics NEW
1291827 [meta] [webvr] Implement VR Shell Core WebVR NEW
1296388 [webvr] Enable Firefox to be launchable from Oculus Home Core WebVR NEW
1296390 [webvr] Enable Firefox to be launchable from SteamVR Core WebVR NEW
1299870 [webvr] Implement `about:webvr` Core WebVR NEW
1299966 [webvr] Implement Extended Mode Rendering for OSVR on macOS Core WebVR NEW
1299968 [webvr] Implement Extended Mode Rendering for OSVR on Windows Core WebVR NEW
1299973 [webvr] Enable OSVR VR support by default on macOS Core WebVR NEW
1306434 [webvr] Implement the `navigator.vrEnabled` and `allowvr` iframe attributes Core WebVR NEW
1306507 [webvr] Implement Mochitest: VRDisplay.isPresenting must not spill information between JS contexts Core WebVR NEW
1310672 [webvr] Implement Direct-Mode Rendering for OSVR on Mac Core WebVR NEW
1311797 [webvr] Implement Mochitest: `vrdisplayactivate` event should trigger only when no content is presenting Core WebVR NEW
1311830 [webvr] Expose Oculus Guardian bounds through VRStageParameters Core WebVR NEW
1323327 [webvr] [meta] Implement Cross-Browser WebVR conformance suite and tools Core WebVR NEW
1339842 [webvr] WebVR and WebGL should force to discrete GPU Core WebVR NEW
1343356 [webvr] WebVR 1.1 Smoke Test Core WebVR NEW
1352418 [meta] Firefox Preferences UI for WebVR features Firefox Settings UI NEW
1352519 Make some IPC calls used by WebVR high priority Core WebVR NEW
1353486 [meta] Track Firefox WebVR quality in the OpenWebGames Test Suite Core WebVR NEW
1353487 Adapt a WebVR demo for use within the Emunittest Harness Core WebVR NEW
1368513 Implement WebVR reftest for verifying getFrameData Core WebVR NEW
1374400 Enable WebVR by default on Linux Core WebVR NEW
1405207 Enable WebVR Reftests and Mochitests for Release Channel on macOS Core WebVR NEW
1411058 Ensure that WebVR content runs on the most optimal display adapter Core WebVR NEW
1433006 Oculus Rift DK2 doesn't work with WebVR apps on the Firefox v58.0 and later. Core WebVR NEW
1444807 Requesting "create new filter" permission for sdelapuente@mozilla.com in Google Analytics property `UA-77033033-6` (WebVR Assets Unity 3D Assetstore package) Websites Web Analytics NEW
1453743 WebVR will not present in the Oculus Rift Core WebVR NEW
1524929 Disable WebVR web-platform tests on Win 7 Core WebVR NEW
1555185 [meta] Convert and re-enable WebVR reftests and mochitests Core WebVR NEW
1605788 VR controllers vibrate a bit when re-entering WebVR pages Core WebVR NEW
1620345 Convert from WebVR to WebXR coordinate in internal Core WebVR NEW
1636311 Remove WebVR Implementation Core WebVR NEW
1171764 [meta/webvr] Allow Iframe to be used as "portal" into another 3d world/view Core WebVR UNCONFIRMED
1363717 WebVR VRDisplay.requestAnimationFrame causes postMessage queue stall Core WebVR UNCONFIRMED
1435339 [webvr] vrdisplay.requestPresent does not render if source not in the DOM Core WebVR UNCONFIRMED
1462436 WebVR bad performance on Mac Core WebVR UNCONFIRMED
1527566 Just detecting WebVR causes constant ~13% CPU usage even when doing nothing else... Core WebVR UNCONFIRMED
1573880 Windows Mixed Controller not listed on navigator.getGamepad in WebVR Core WebVR UNCONFIRMED


No results.

No results.

Archive

Retrieved from "https://wiki.mozilla.org/index.php?title=QA/WebVR&oldid=1129022"