WebDriver/Meetings/2018-07-23

Agenda

• Recent spike in intermittent bug 1414495
  • Probably not related to the original problem
  • Two changes in Marionette in this timeframe, and Aryx and ato verified that neither caused the spike:
    • https://bugzilla.mozilla.org/show_bug.cgi?id=1447977
    • https://bugzilla.mozilla.org/show_bug.cgi?id=1452490
• Work week
• Change https://wpt.fyi to run only/also Firefox Nightly? (whimboo)
  • Currently wdspec improvements/fixes take up to 12 weeks before they are visible in the dashboard
  • Testers using geckodriver might be more interested in the last official release or even beta
  • I would like to see the results of the latest implementation status

Minutes

Intermittent spike

whimboo

Marionette calls execute_script to initialize the mochitest extension via SpecialPowers

Initialization may fail, and sadly no JavaScript error gets thrown

Maybe related to failing to catch an error, I have seen this in the past for Promise handling

Given that the mochitest extension doesn't initialize, the harness hangs forever

Would have expected sheriffs to ping other people

Should probably be easy to reproduce with a one-click loaner given that it reproduces on Linux

Running Firefox Nightly on wpt.fyi

ato

File a bug on the github repo to ask why we run it for release only.

Those results should be for browser implementation work.

Also test results won't change for the cycle of a release while we run tests a couple of times a week.

geckodriver on macOS

ato

ted has been wroking on making macos builds of geckodriver work.

Status updates

• ato
  • Disabled new evaluate.isCyclic (in 1475264) to test if it made any impact on recent spike in intermittents
  • Added support for setWindowRect capability (1470659)
    • Parametrized some New Session tests so that tests for individual capabilities can be ignored
  • Improved ./mach bootstrap to explain what a mozconfig is (1476263)
  • Added marionette.log.truncate to disable truncation of log entries (1476305)
  • Fixed broken links in the geckodriver README (1477300)
  • Requested redirect for Marionette MDN wiki page (1477468)
  • Made geckodriver not emit info-level messages before session creation (1477474)
  • Dropped a needless sessionId test in geckodriver (1477476)
  • Dropped legacy Marionette capabilities duplication from geckodriver (1477475)

• whimboo
  • [wdspec] Refactored user prompt tests for parametrization of dialog type (Bug 1470098)
  • [marionette] Added support for unhandledPromptBehavior capability (Bug 1264259)
  • [marionette] Detect XML parsing error during startup and shutdown Firefox with fatal log entry (bug 1472136)
  • [marionette] Only run tests on Android for integration branches and try (bug 1469534)
  • [marionette + wptrunner] Force to only connect through local IPv4 addresses (bug 1473262)

(Spoken status updates in bold.)

PTO/travel (🏖)