QA/Fennec/NetworkIDAndroid

From MozillaWiki
< QA‎ | Fennec
Jump to: navigation, search
Last updated: 2019/10/31

Overview

Purpose

The purpose of this wiki is to serve as a general test plan for verifying that the Network ID section from about:networking displays the correct information and is updated accordingly when interchanging wireless networks like: Wi-Fi, mobile data, but also when using a virtual private network. The Network ID information needs to be updated accordingly, based on whichever method of navigation the user wants, from the default one to a different one.

Ownership

Developer contact: Nhi Nguyen Michal Novotny

QA: Diana Rus

Overall Status

[LANDED]

  • Fennec 71 in 21-09-2019

Testing Summary

Scope of testing

The testing will focus on verifying that the about:networking contains the Network ID section and the information from "Network ID" is correctly updated based on the used networks.

Environments

Testing will be performed on the following Android devices:

  • Phone:
- Google Pixel XL (Android Q)
- Google Pixel 3a XL (Android 9)
- Samsung Galaxy S9 (Android 8.0.0)
- Sony Xperia Z5 Gold (Android 7.0)
- OnePlus 3 (6.0.1)
  • Tablet:
- Google Pixel C (Android 8.0.0)

Specifications

User stories

Acceptance Criteria

  • All [ Test cases] have passed.

Testing details

Test Cases

Testing days

Date: 2019-08-14

  • Created Test Plan and test cases

Date: 2019-08-23

  • Set test cases in testrail

Date: 2019-09-24

  • Functional and exploratory testing on Nightly 71
  • Devices:

Date: 2019-09-26

Date: 2019-09-27

Date: 2019-10-21

  • Functional and exploratory testing on Fenix/Firefox Preview Nightly - Version 71.0a1-20191018095340
  • Devices:

Date: 2019-10-30

Date: 2019-10-31

    *New issues found: 2

Bug Work

  • Meta bug for android: bug 1561944 - Implement nsINetworkLinkService.networkID for Android

No results.

0 Total; 0 Open (0%); 0 Resolved (0%); 0 Verified (0%);


  • bug 1561005 - Network ID testing on all supported OS for Skyline

No results.

0 Total; 0 Open (0%); 0 Resolved (0%); 0 Verified (0%);


Full Query
ID Priority Summary Status Resolution Assigned to Whiteboard
1561273 P2 network ID: ipv4NetworkId/scanArp returns gateway IP instead of its MAC RESOLVED FIXED Michal Novotny [:michal] [necko-triaged]
1561944 P1 Implement nsINetworkLinkService.networkID for Android RESOLVED FIXED Michal Novotny [:michal] [necko-triaged][secure-proxy][skyline]
1568898 P1 network ID: calculate network ID in nsNetworkLinkService::IPConfigChanged RESOLVED FIXED Kershaw Chang [:kershaw] [necko-triaged][secure-proxy][skyline]
1569310 P1 add telemetry for when we can't get a network ID RESOLVED FIXED [necko-triaged]
1570660 P2 Add network ID to about:networking RESOLVED FIXED Michal Novotny [:michal] [necko-triaged]
1579424 P1 network ID: detect on MacOS when VPN overrides default gateway RESOLVED FIXED Junior [inactive] [necko-triaged]
1581539 P3 network ID: use operator name on Android for network ID calculation NEW [necko-triaged]
1585920 P1 network ID: fix VPN detection on Linux for non ethernet devices RESOLVED FIXED Michal Novotny [:michal] [necko-triaged]
1586731 P1 network ID: drop routes/addresses when link/address is removed by the kernel VERIFIED FIXED Michal Novotny [:michal] [necko-triaged]
1586774 P3 network ID: split NetlinkService::CalculateIDForFamily() into multiple methods RESOLVED FIXED Sonakshi Saxena [necko-triaged]
1586782 P3 network ID: get rid of NL_DEBUG_LOG in NetlinkService RESOLVED FIXED Michal Novotny [:michal] [necko-triaged]
1588556 P3 We should use SCNetworkReachabilityCreateWithName to check network reachability RESOLVED WONTFIX Kershaw Chang [:kershaw] [necko-triaged]
1589417 P3 We should only use default interface's IPv6 address to hash network id NEW [necko-triaged]
1589446 P1 Add network id change event (Windows) RESOLVED FIXED Valentin Gosu [:valentin] (he/him) [necko-triaged]
1589447 P2 Add network id change event (linux) RESOLVED FIXED Michal Novotny [:michal] [necko-triaged]
1589448 P2 Add network id change event (MacOS) RESOLVED FIXED Kershaw Chang [:kershaw] [necko-triaged]
1589461 P2 Add network id change event (Android) RESOLVED FIXED Michal Novotny [:michal] [necko-triaged]
1590250 P1 network ID: different ID is detected after re-enabling mobile data VERIFIED FIXED Michal Novotny [:michal] [necko-triaged]
1596419 P3 Network change event can be hidden by coalescing period on Linux/Android RESOLVED FIXED Michal Novotny [:michal] [necko-triaged]
1598430 P2 Investigate why NETWORK_ID_ONLINE is absent in ~10% of cases on MacOS RESOLVED FIXED Valentin Gosu [:valentin] (he/him) [necko-triaged]
1598431 P3 Investigate why NETWORK_ID_ONLINE is absent in ~7% of cases on Linux NEW [necko-triaged]
1600811 P1 network ID: use hardcoded IP for route checking in nsNetworkLinkService on MacOS RESOLVED FIXED Michal Novotny [:michal] [necko-triaged]
1637947 P2 network ID: link status isn't updated in NetlinkService::OnAddrMessage() RESOLVED FIXED Michal Novotny [:michal] [necko-triaged]
1663136 P3 The generated DoH ping is missing a networkID value NEW [necko-triaged]
1793498 P3 Active network link is not updated when not connected to the internet when using a VPN NEW Kershaw Chang [:kershaw] [necko-triaged]
1798505 P3 nsINetworkConnectivityService should not have a race condition when determining network connectivity NEW [necko-triaged]
1817756 P2 Consider adding a seed to the network ID RESOLVED FIXED Pier Angelo Vendrame [necko-triaged]

27 Total; 6 Open (22.22%); 19 Resolved (70.37%); 2 Verified (7.41%);


Tracking bugs

  • bugs to track the feature
  • bug 1561005 - Network ID testing on all supported OS for Skyline
  • bug 1567627 - [meta] Network ID
  • bug 1561944 - Implement nsINetworkLinkService.networkID for Android

Bugzilla query error

error, http-bad-status, Array


Signoff

Criteria

  • All [ Test cases] have passed.

Results

Nightly testing

    • There were no blockers found while testing this feature.
    • One issue
Retrieved from "https://wiki.mozilla.org/index.php?title=QA/Fennec/NetworkIDAndroid&oldid=1219723"