QA/Fennec/DevTools Remote Debugging

From MozillaWiki
< QA‎ | Fennec
Jump to: navigation, search

Overview

Purpose

The purpose of this wiki is to serve as a general test plan for verifying that DevTools Remote Debugging is supported in Fennec.

Ownership

Developer contact:

Julian Descottes

QA contacts:

Andrei Bodea

Hani Yacoub

Overall Status

[In Progress] : Nightly 67 in 3/07/2019

Testing Summary

Scope of testing

The testing will be focus on the results of DevTools Remote Debugging with various devices. USB connection: making sure we can connect to devices, that the basic debugging experience is there and the workflow works. Connecting to network devices: be able to connect to Firefox 66, 67, 68 (there’ll be backward compatibility messages for other versions) In theory you can try to connect to anything, we don’t plan to prevent it but it might not work

Environments

Testing will be performed on following devices:

  • Phones
    • [ Sony Xperia Z3 Android 5.1.1]
  • Tablet

Specifications

Test page:

We should test to check the results of DevTools Remote Debugging with various devices.

Acceptance Criteria

All Test cases have passed and all P1 bugs are fixed.

Testing details

Test Cases

  • [link [Fx 67] DevTools Remote Debugging

Testing days

Date: 02-02-2019

  • Created Test Plan
  • Started working on TC's

Date: 08-03-2019

  • First testing roud
  • Functional and exploratory testing on Nightly 67.0a1 (2019-03-08)
  • Devices:

Date: 11-03-2019

  • First test report is sent
  • Please note that this email stands as a test report from “DevTools Remote Debugging” feature on Nightly 67. It is not a formal sign off, as the feature isn't going to ride the Fx67 train and the plan is to ship in Firefox 68. The implementation of this feature is not completed and currently does not require a pre-Beta sign-off.

Bug Work

Full Query
ID Priority Summary Status Resolution Assigned to Whiteboard
1462211 -- [meta] Remote debugging NG Milestone 1 RESOLVED FIXED
1463604 -- [meta] Remote debugging NG Milestone 0 NEW
1494541 -- [meta] Remote debugging NG Milestone 2 NEW
1494542 -- [meta] Remote debugging NG Milestone 3 RESOLVED INVALID
1496659 -- [meta] Remote debugging NG Milestone 3+ NEW
1501934 -- Disable or hide "Refresh devices" button if usb devices are not enabled RESOLVED DUPLICATE
1505795 -- [remote-dbg-next] Update the range of supported versions to accommodate for Fennec rollout RESOLVED DUPLICATE
1506661 -- [remote-dbg-next] Support Manifest URL link for addon targets with Remote Runtimes RESOLVED DUPLICATE
1509348 -- Fix animations in collapsible sections RESOLVED DUPLICATE
1510947 -- [remote-dbg-next] [meta] Accessibility for new about:debugging NEW
1512308 -- [remote-dbg-next] Runtime page header: add device information RESOLVED DUPLICATE
1512441 -- [remote-dbg-next] Unregister Service worker from new about:debugging RESOLVED DUPLICATE
1516344 -- [meta] unify all the different button styles for in-content pages of Firefox NEW
1517676 -- [remote-dbg-next] Even if close the Firefox connected via network location, status of the item on sidebar does not update RESOLVED DUPLICATE
1527240 -- [remote-dbg-next] Polish runtime header actions RESOLVED DUPLICATE
1536733 -- [remote-dbg-next] [meta] Backward compatibility issues between Firefox 68 and 67 NEW
1537772 -- [remote-dbg-next] Change wording in UI from `runtime` to `browser` NEW
1537782 -- [remote-dbg-next] Add hint to sidebar > connect device NEW
1537785 -- [remote-dbg-next] Add an onboarding message for first time users of the new about:debugging NEW
1537992 -- Consistent naming for profiler button and window NEW
1538084 -- DevTools ADB Extension forces itself to be allowed in private windows (won't let you disallow it) NEW

21 Total; 11 Open (52.38%); 10 Resolved (47.62%); 0 Verified (0%);


Signoff

Criteria

  • All test cases should be executed
  • All blockers, criticals must be fixed and verified or have an agreed-upon timeline for being fixed

Results

Nightly testing

  • There were no blockers found while testing this feature.
  • All bugs are fixed and verified

Beta testing NA