QA/Comparing local device vs server clocks in order to determine if collection has new data available

From MozillaWiki
< QA
Jump to: navigation, search

Overview

Purpose

The purpose of this wiki is to serve as a general test plan for verifying that changing local time and syncing Server content will not lead to faulty syncing behavior

Ownership

Developer contact: :Grisha

QA: Mihai Ninu

Overall Status

[LANDED] Nightly 57:

[LANDED] Beta 57:

Testing Summary

Scope of testing

The testing will be focus on

  • verifying that in different Sync scenarios, the local device time does not influence the Sync content received/uplifted from/to the server

Environments

Testing will be performed on following platforms:

  • Android
    • 5.x
    • 6.x
    • 7.x
    • 8.x

User stories

Acceptance Criteria

  • The feature works as expected.

Testing details

Test Cases

Testing days

Date:2017-09-06

  • Exploratory Testing performed on following:
    • Samsung Galaxy S6 EDGE - Android 7.0 . Build: Nightly 57.0a1 (2017-09-05)
  • Created Test Plan

=Date:2017-09-11

  • Exploratory Testing performed on following:
    • Samsung Galaxy S6 EDGE - Android 7.0 . Build: Nightly 57.0a1 (2017-09-08)

=Date:2017-09-15

  • Created test-cases Testrail
  • Ran testrail suite
    • Samsung Galaxy S6 EDGE - Android 7.0 . Build: Nightly 57.0a1 (2017-09-14)

=Date:2017-09-27

  • Ran testrail suite Testrail
    • Samsung Galaxy Tab S3 - Android 7.0 . Build: Beta 57.0b3

Tracking bugs

  • Bugs to track the feature

ex:

Full Query
ID Summary Priority Status
1373897 Miscounting "successfully uploaded GUIDs" by a huge margin P2 RESOLVED
1392505 Comparing local device vs server clocks in order to determine if collection has new data available P1 RESOLVED

2 Total; 0 Open (0%); 2 Resolved (100%); 0 Verified (0%);


Signoff

Criteria

  • All test cases should be executed
  • All blockers, critical issues must be fixed and verified or have an agreed-upon timeline for being fixed


Results

Nightly testing

  • Feature looks stable and the server content being downloaded is not affected by the local time on the device


Beta testing

  • Feature looks stable and the server content being downloaded is not affected by the local time on the device