QA/e10s + A11y Test Plan

From MozillaWiki
Jump to: navigation, search

Overview

Purpose

Quality assurance plan to ensure accessibility features with e10s enabled using Windows and Linux operating system are ready for public release.

Note: Despite this wiki page title, this test plan is for accessibility + e10s in general, not just touchscreen support.

Quality Criteria

Risk area Requirement Status
Screen readers There should be no significant difference in using screen readers than on non-e10s In-Progress
Touch screens Touch enabled devices, including soft keyboards, should function as well as in non-e10s (confirm a11y isn't activated for touch screen users) In-Progress
IME clients Common IME clients should function as well as in non-e10s TBD
Remote Desktop clients Browser stability issues while access the browser through RDP In-Progress
Popular sites (ie, gmail, twitter, facebook, and the other Google apps No significant regression in site correctness, stability or performance with e10s and a11y compared to a11y on non-e10s In-Progress
ARIA markup There should be no significant difference in a11y exposed interfaces for e10s vs non-e10s In-Progress
General performance Overall performance of Firefox with a11y on e10s should not be notably worse than with a11y on non-e10s In-Progress

Testing summary

Scope of Testing

In Scope

The scope of our testing is the A11y+e10s accessibility and functionality and performance of the most popular sites and most commonly used 3rd party tools.

  • Integration: Verify the integration with the current browser functionalities and UI;
  • Functionality: Basic and advanced functionality to be verified according to the existing requirements;
  • Usability: Intuitive and how users interact with the feature;
  • Performance: Reference, where applicable, observed and collected performance data.

Out of Scope

We will not be testing with less popular 3rd party tools or on obscure web sites.

Requirements for testing

Environments

Testing will be performed on following OSes:

  • Windows 10 (x64)
  • Linux - Ubuntu 16.04 (x64)

Quality Assurance Strategy

Test Items

Screen Readers

Client Free/Licensed Demo Available? Demo Expiration Purchased Copy? Owner/Location
NVDA (Win) (top priority) free n/a n/a Yes
Window-Eyes (Win) licensed link[1] 60 days No
JAWS (Win) version 18.0.4321 or higher licensed - Yes (Windows) SV Las Vegas (Grover)
Dolphin (Win) licensed No

[1] requires filling in a contact information form

Criteria Description Metric non-e10s value e10s value Criteria Met? QA Owner
Manual testing Test cases passed # (passed -TBD) out of # (total test cases run -TBD) # (passed -TBD) out of # (total test cases run -TBD) TBD (Date status updated) SoftVision

56 to 57 Update Changes

In cases where JAWS is configured to run at startup, the presence of a running instance of JAWS (version numbers lower than 18.0.4321) will disable 56 -> 57 updates. We should test to confirm this behavior is working.

Incompatibility Prompting

In a situation where JAWS (version numbers lower than 18.0.4321) is run with Firefox 57, the browser should prompt the user informing them they need to update their screen reading software, or switch to Firefox Extended Release. We should confirm this behavior is working.


Touch Screens

Because a11y should no longer be triggered by touch screen devices, only the first metric below should block release of a11y+e10s.

Criteria Description Metric non-e10s value e10s value Criteria Met? QA Owner
Manual testing A11y enabled? (should be false) true or false true or false TBD (Date status updated) SoftVision
Manual testing TestRail Test cases passed or Google Docs # (passed -TBD) out of 26 test cases run # (passed -TBD) out of 26 test cases run TBD (Date status updated) SoftVision

IME Clients

These are very difficult to test if one is not familiar with the language under test. Until we have a better longer term test ownership solution, we'll have to rely on community feedback and bug reports.

Language Primary IME 3rd party
Japanese Win: MS-IME, macOS: Apple Japanese IME Google Japanese Input, ATOK (not free)
Simplified Chinese Pinyin ABC
Traditional Chinese Changjie
Korean Win: MS-IME, macOS: Apple Korean IME
Criteria Description Metric non-e10s value e10s value Criteria Met? QA Owner
Manual testing Community input and bug reports # of bug reports # of bug reports TBD (Date status updated) Community

Popular Sites

Criteria Description Metric non-e10s value e10s value Criteria Met? QA Owner
Manual testing Test cases passed # (passed -TBD) out of # (total test cases run -TBD) # (passed -TBD) out of # (total test cases run -TBD) TBD (Date status updated) SoftVision

ARIA Markup

Criteria Description Metric non-e10s value e10s value Criteria Met? QA Owner
Manual testing using existing tools/suites Test cases passed # (passed -TBD) out of # 44 test cases run # (passed -TBD) out of # 44 test cases run TBD (Date status updated) SoftVision

General Performance

Acceptable regression ranges, if any, need to be determined.

Criteria Description Metric non-e10s value e10s value Criteria Met? QA Owner
CPU usage (observed) Peak/average % CPU  %peak/%average  %peak/%average TBD (Date status updated) SoftVision
Memory usage (observed) Peak/Average % memory  %peak/%average  %peak/%average TBD (Date status updated) SoftVision
Telemetry - overall crash rate with a11y enabled crashes per 1000 use hours # crashes # crashes a/b experiment on beta TBD tracy
Talos - a11yr summary Page load times 490.6ms (Win 7) 531.6ms (Win 7) FAIL - 8.36% regression on Win 7 (20170115) tracy

Builds

TBD

Test Execution Schedule

The following table identifies the anticipated testing period available for test execution.

Project phase Start Date End Date
Start project December 2016 -
Study documentation/specs received from developers TBD -
QA - Test plan creation 12/13/2016 -
QA - Test cases/Env preparation 12/12/2016 -
QA - Nightly Testing February/March 2017 -
QA - Aurora Testing N/A
QA - Beta Testing Oct 16th 2017 Oct 27th 2017
Release Date Nov 14th -

Testing Tools

Detail the tools to be used for testing, for example see the following table:

Process Tool
Test plan creation Mozilla wiki
Test case creation TestRail
Test case execution TestRail
Bugs management Bugzilla/GitHub (mainly)

Status

Overview

  • Track the dates and build number where feature was released to Nightly
  • Track the dates and build number where feature was merged to Aurora
  • Track the dates and build number where feature was merged to Release/Beta

References

Testcases

Available on TestRail and Google Doc format TestRail Google Docs

To Be filed:

  • live regions test case (bug 1322532)
  • Browser hang up when Open View Source (IME related, bug 1318900)

Overview

  • Summary of testing scenarios

Test Areas

Test Areas Covered Details
Private Window Yes
Multi-Process Enabled Yes
Multi-process Disabled Yes
Theme (high contrast) No
UI
Mouse-only operation Yes
Keyboard-only operation Yes
Display (HiDPI) No
Interraction (scroll, zoom) Yes
Usable with a screen reader Yes e.g. with NVDA
Usability and/or discoverability testing Yes Is this feature user friendly
Help/Support
Help/support interface required No Make sure link to support/help page exist and is easy reachable.
Support documents planned(written) Yes Make sure support documents are written and are correct.
Install/Upgrade
Feature upgrades/downgrades data as expected No
Does sync work across upgrades No
Requires install testing Yes Requires NVDA Installation
Affects first-run or onboarding No
Does this affect partner builds? Partner build testing No
Enterprise Raise up the topic to developers to see if they are expecting to work different on ESR builds
Enterprise administration No
Network proxies/autoconfig No
ESR behavior changes No
Locked preferences No
Data Monitoring
Temporary or permanent telemetry monitoring No Testing was not conducted by SV QA Eng team.
Telemetry correctness testing No Testing was not conducted by SV QA Eng team.
Server integration testing No Testing was not conducted by SV QA Eng team.
Offline and server failure testing No
Load testing No Testing was not conducted by SV QA Eng team.
Add-ons If add-ons are available for testing feature, or is current feature will affect some add-ons, then API testing should be done for the add-on.
Addon API required? No
Comprehensive API testing No
Permissions No
Testing with existing/popular addons Yes Ensure no performance/stability regressions
Security
3rd-party security review No
Privilege escalation testing No
Fuzzing No
Web Compatibility depends on the feature
Testing against target sites Yes
Survey of many sites for compatibility Yes
Interoperability depends on the feature
Common protocol/data format with other software: specification available. Interop testing with other common clients or servers. Yes NVDA should cover most of this. Other common clients are closed-source, expensive, and do not offer trial versions.
Coordinated testing/interop across the Firefoxes: Desktop, Android, iOS No
Interaction of this feature with other browser features Yes

Test suite

Bug Work

  • Bugzilla Meta Bugs
  • aes+ tracking list
Full Query
ID Priority Component Assigned to Summary Status Target milestone
764757 -- Disability Access APIs NVDA announces incorrect number of items when display:inline-block; is used RESOLVED ---
1073767 P3 Disability Access APIs Jaws screenreader does not read selected text RESOLVED ---
1121182 -- Disability Access APIs teach the other methods in nsMaiInterfaceText.cpp to use proxies RESOLVED ---
1129215 -- Disability Access [e10s] Magnify Window Does Not Follow element and/or text insert point of content area RESOLVED ---
1154169 P3 Disability Access APIs ASSERTION: Wrong in offset: 'Error', file a:\mozilla\mc-e\src\accessible\generic\HyperTextAccessible.cpp, line 1105 NEW ---
1189277 P2 Disability Access APIs Trevor Saunders (:tbsaunde) Crash in IPCError-browser | (msgtype=0x580009,name=PDocAccessible::Msg_BindChildDoc) Processing error: message was deserialized RESOLVED ---
1197181 P2 Disability Access APIs Trevor Saunders (:tbsaunde) crash in mozilla::a11y::DocAccessibleParent::RecvHideEvent(unsigned __int64 const&) RESOLVED mozilla54
1198383 -- Disability Access [e10s] figure out what the crash rates are for a11y users on Nightly RESOLVED ---
1198765 P2 Graphics: Layers Nicolas Silva [:nical] e10s crash in mozilla::ipc::FatalError | mozilla::layers::PLayerTransactionParent::Read with a11y active RESOLVED ---
1206711 -- Disability Access APIs Yura Zenevich [:yzen] Make Window Emulation work in e10s RESOLVED ---
1227124 -- Disability Access APIs [E10] AtkTable interface broken/not-implemented(?) in Nightly RESOLVED ---
1240893 -- Disability Access APIs Trevor Saunders (:tbsaunde) crash in PLDHashTable::Remove | mozilla::a11y::AccessibleWrap::Shutdown RESOLVED mozilla53
1261107 -- Disability Access APIs Aaron Klotz [:aklotz] Add ability to marshal a COM object and transfer its serialized proxy across IPDL RESOLVED mozilla50
1261299 P1 Widget: Cocoa Jimmy Wang (:jimicy) - works on e10s stuff [e10s] Mac OS X Services is not available for e10s tab content RESOLVED mozilla51
1263224 -- Disability Access APIs Aaron Klotz [:aklotz] Hand off a11y requests from RPC thread to main thread RESOLVED mozilla50
1268151 -- IPC Aaron Klotz [:aklotz] Circular includes in IPDL headers leading to odd behavior RESOLVED mozilla50
1268544 -- Disability Access APIs Aaron Klotz [:aklotz] Refactor a11y IPC to allow for remoting COM objects RESOLVED mozilla51
1269369 -- Disability Access APIs Yura Zenevich [:yzen] [e10s] DOMNodeId accessible proxy is not implemented on Windows. RESOLVED mozilla53
1270916 P2 Disability Access APIs Trevor Saunders (:tbsaunde) Crash in IPCError-browser | (msgtype=0x2C0004,name=PBrowser::Msg_PDocAccessibleConstructor) Processing error: message was deseri RESOLVED ---
1272146 -- Disability Access APIs Aaron Klotz [:aklotz] Thunk for IAccessible property accesses that pass non-self child IDs RESOLVED mozilla51
1272268 P1 Widget: Win32 Rendering problem in Nightly with touch screen VERIFIED mozilla52
1272712 -- Disability Access APIs Trevor Saunders (:tbsaunde) [e10s] Updating aria role on body does not take effect when e10s is enabled. RESOLVED mozilla50
1273635 -- Disability Access APIs Aaron Klotz [:aklotz] Mitigate potential a11y deadlocks due to COM calls originating from chrome process RESOLVED mozilla51
1275731 -- Disability Access APIs Aaron Klotz [:aklotz] Add ia2marshal.dll to installer RESOLVED mozilla50
1277075 -- Disability Access APIs Aaron Klotz [:aklotz] Disable COM's catch-all exception handler RESOLVED mozilla50
1293555 -- Disability Access APIs Crash in IPCError-browser | (msgtype=0x2E0004,name=PBrowser::Msg_PDocAccessibleConstructor) Processing error: message was deseri RESOLVED ---
1296571 -- Disability Access APIs 223.05% a11yr (windows8-64) regression on push d84b4dd26a403675c8059e5d073ebc65d5fc07eb (Thu Aug 18 2016) RESOLVED ---
1297131 -- Disability Access APIs [e10s][a11y] Crash in IPCError-browser | (msgtype=0x5C000A,name=PDocAccessible::Msg_BindChildDoc) Processing error: message was deserialized, RESOLVED ---
1297437 -- Disability Access APIs [e10s][a11y] page load is extremely slow and gets unresponsive since 22-Aug-2016 Nightly51.0a1 RESOLVED ---
1297549 -- Disability Access APIs Aaron Klotz [:aklotz] Arrow keys will not read the page with a11y and e10s RESOLVED mozilla52
1303060 -- Disability Access APIs Aaron Klotz [:aklotz] Implement COM handler to reduce RPC round-trips RESOLVED mozilla55
1305124 -- General Start running mochitest-a11y with e10s enabled in automation RESOLVED ---
1309236 -- Disability Access APIs Aaron Klotz [:aklotz] Crash in mozilla::a11y::DocAccessibleParent::RecvMsaaID RESOLVED mozilla52
1309271 -- Disability Access APIs Jim Mathies [:jimm] Accessibility issues when moving focus from chrome elements to content elements RESOLVED mozilla55
1310056 -- Disability Access APIs Aaron Klotz [:aklotz] Implement compatibility hack for RPC_E_CANTCALLOUT_ININPUTSYNCCALL RESOLVED mozilla55
1311748 -- IPC Aaron Klotz [:aklotz] Crash in mozilla::mscom::MainThreadHandoff::OnWalkInterface RESOLVED mozilla52
1311834 -- IPC Aaron Klotz [:aklotz] MSCOM MainThreadInvoker: Spin the background thread while waiting for main thread RESOLVED mozilla52
1311969 -- Untriaged Aaron Klotz [:aklotz] Crash in nzbrcom.dll@0x20a76 RESOLVED Firefox 52
1312046 -- Disability Access APIs Aaron Klotz [:aklotz] Crash in GetProxiedAccessibleInSubtree VERIFIED mozilla52
1312064 -- Disability Access APIs Crash in mozalloc_abort | NS_DebugBreak | mozilla::ipc::FatalError | mozilla::a11y::PDocAccessibleChild::SendCOMProxy RESOLVED ---
1312816 -- Marionette Yura Zenevich [:yzen] Marionette instantiates a11y in content but not chrome RESOLVED mozilla52
1314016 -- Disability Access APIs Aaron Klotz [:aklotz] Crash in mozilla::dom::TabParent::RecvPDocAccessibleConstructor RESOLVED mozilla52
1314310 -- Disability Access APIs Crash in GetProxiedAccessibleInSubtree , Crash when reload(F5) on certain site RESOLVED ---
1314707 -- Disability Access APIs Aaron Klotz [:aklotz] Eliminate SendCOMProxy from PDocAccessible protocol RESOLVED mozilla53
1316109 -- Disability Access APIs Aaron Klotz [:aklotz] ia2_api_all.idl is missing a typelib entry for IAccessible2_3 RESOLVED mozilla52
1316118 -- Disability Access APIs Aaron Klotz [:aklotz] ia2_api_all.idl is missing the definitions for IAccessible2_3 RESOLVED mozilla52
1318900 -- XPCOM [e10s a11y] Browser hang up when Open View Source if accessibility is activated on Win10 RESOLVED ---
1319309 -- Disability Access APIs Crash in mozalloc_abort | NS_DebugBreak | mozilla::ipc::FatalError | mozilla::ipc::IProtocol::HandleFatalError | mozilla::ipc::IProtocol::FatalError | mozilla::a11y::PDocAccessibleChild::SendCOMProxy RESOLVED ---
1319640 -- Disability Access APIs Aaron Klotz [:aklotz] [e10s a11y] Remote retrieval of native accessibles for windowed plugins RESOLVED mozilla53
1321622 -- Disability Access APIs Aaron Klotz [:aklotz] DocAccessibleParent::Unbind does not call ProxyAccessible::SetChildDoc(nullptr) RESOLVED mozilla53
1322532 -- Disability Access APIs Aaron Klotz [:aklotz] [e10s a11y] Live regions broken on Windows RESOLVED mozilla55
1324863 -- Disability Access APIs Trevor Saunders (:tbsaunde) Crash in mozilla::a11y::DocAccessibleParent::RemoveChildDoc RESOLVED mozilla54
1325244 -- Disability Access APIs Trevor Saunders (:tbsaunde) Crash in mozilla::a11y::DocAccessibleChild::ConstructChildDocInParentProcess RESOLVED ---
1325258 -- Disability Access APIs Trevor Saunders (:tbsaunde) Crash in IPCError-browser | PBrowserParent::RecvPDocAccessibleConstructor RESOLVED mozilla53
1325676 -- Widget: Win32 Aaron Klotz [:aklotz] Prevent touchscreens on Windows 8.x from instantiating accessibility VERIFIED mozilla53
1325834 -- Disability Access APIs Aaron Klotz [:aklotz] Crash in mozalloc_abort | NS_DebugBreak | mozilla::ipc::FatalError | mozilla::a11y::PDocAccessibleChild::OnMessageReceived RESOLVED mozilla55
1326084 -- Disability Access APIs David Parks (dparks) [:handyman] IPC - Use After Free in a11y::DocAccessibleParent::RemoveChildDoc() VERIFIED mozilla54
1328996 -- General David Parks (dparks) [:handyman] Add support to the DLL Interceptor for RIP-relative displacements RESOLVED mozilla54
1329616 P1 Widget: Win32 Aaron Klotz [:aklotz] Massive increase of focus loss and Unknown Accessibles problems with E10S turned off starting in 2016-12-16 Nightly RESOLVED mozilla53
1329816 -- Disability Access APIs Aaron Klotz [:aklotz] Crash in mozilla::ipc::FatalError | mozilla::ipc::IProtocol::HandleFatalError | mozilla::ipc::IProtocol::FatalError | mozilla::dom::PBrowserParent::OnMessageReceived RESOLVED ---
1330460 P1 Widget: Win32 David Parks (dparks) [:handyman] Prevent touchscreens on Windows 8.x from instantiating accessibility (64-bit builds) RESOLVED mozilla54
1330484 -- Disability Access APIs David Parks (dparks) [:handyman] crash near NULL [mozilla::a11y::NotificationController::WillRefresh] RESOLVED mozilla55
1331286 -- Disability Access APIs Trevor Saunders (:tbsaunde) Crash in mozilla::a11y::DocAccessibleWrap::GetNativeWindow RESOLVED mozilla53
1332444 -- Disability Access APIs Yura Zenevich [:yzen] ensure that AccessibleWrap::GetRemoteIAccessibleFor is never called for a proxy accessible wrap. RESOLVED mozilla54
1332690 -- Disability Access APIs David Parks (dparks) [:handyman] Crash in IPCError-browser | PDocAccessibleParent::AddChildDoc binding to nonexistant proxy! RESOLVED mozilla55
1334058 -- Disability Access APIs Trevor Saunders (:tbsaunde) Crash in IPCError-browser | PDocAccessibleParent::RecvShowEvent unknown parent accessible RESOLVED mozilla54
1334673 -- Disability Access APIs Trevor Saunders (:tbsaunde) Crash in IPCError-browser | PDocAccessibleParent::RecvShowEvent invalid index RESOLVED mozilla54
1334966 -- Disability Access APIs Trevor Saunders (:tbsaunde) Crash in mozilla::dom::TabParent::GetTopLevelDocAccessible VERIFIED mozilla54
1336093 -- Disability Access APIs Trevor Saunders (:tbsaunde) Crash in mozilla::a11y::ProxyAccessibleBase<T>::Shutdown RESOLVED mozilla54
1336770 -- Disability Access APIs Trevor Saunders (:tbsaunde) Crash in nsTArray_Impl<T>::IndexOf<T> | mozilla::a11y::ProxyAccessibleBase<T>::ClearChildDoc RESOLVED mozilla54
1336971 P2 Disability Access APIs Aaron Klotz [:aklotz] Crash in InvalidArrayIndex_CRASH | nsTArray_Impl<T>::operator[] | mozilla::a11y::AccessibleWrap::GetRemoteIAccessibleFor RESOLVED mozilla58
1337047 -- Disability Access APIs Yura Zenevich [:yzen] Crash in mozilla::a11y::DocAccessibleWrap::GetNativeWindow RESOLVED mozilla54
1337370 -- Disability Access APIs Yura Zenevich [:yzen] Add test coverage for startup crash issue exposed by patch in bug 1326084 RESOLVED ---
1337401 -- Disability Access APIs Yura Zenevich [:yzen] Enable e10s bc accessibility tests on Windows. RESOLVED ---
1337935 -- Disability Access APIs 64-bit a11y clients cannot see content accessibles from 32-bit firefox RESOLVED ---
1337983 -- Disability Access APIs Trevor Saunders (:tbsaunde) Intermittent accessible/tests/browser/e10s/browser_treeupdate_visibility.js | application crashed [@ mozilla::a11y::DocAccessibleParent::SetCOMProxy(RefPtr<IAccessible> const &)] RESOLVED mozilla54
1339128 -- Disability Access APIs Trevor Saunders (:tbsaunde) reference parent proxy by id RESOLVED mozilla54
1339168 -- Disability Access APIs David Parks (dparks) [:handyman] Crash in mozilla::a11y::DocAccessibleParent::RemoveChildDoc RESOLVED mozilla55
1339947 -- IPC Aaron Klotz [:aklotz] ArrayData lookups in mscom registration code need to take inheritance into account RESOLVED mozilla54
1339951 -- IPC Aaron Klotz [:aklotz] Improvements to mscom weak references RESOLVED mozilla54
1340579 -- Disability Access APIs Trevor Saunders (:tbsaunde) Crash in PLDHashTable::Search | mozilla::a11y::DocAccessibleParent::GetAccessible RESOLVED mozilla54
1340903 -- Disability Access APIs Trevor Saunders (:tbsaunde) Crash in IPCError-browser | PDocAccessibleParent::AddChildDoc binding to proxy that can't be a outerDoc! RESOLVED ---
1341731 -- Disability Access APIs Trevor Saunders (:tbsaunde) Crash in mozilla::dom::TabParent::RecvPDocAccessibleConstructor RESOLVED mozilla54
1341788 -- Disability Access APIs Crash in mozilla::a11y::DocAccessibleParent::ParentDoc RESOLVED ---
1342243 P1 Disability Access APIs Firefox hangs when navigating through aria-autocomplete list with a screenreader RESOLVED ---
1342245 -- Disability Access APIs Jim Mathies [:jimm] accessibility.force_disabled=-1 (force enabled) should work on Windows RESOLVED mozilla55
1345552 -- Disability Access APIs Aaron Klotz [:aklotz] Disable Windows a11y+e10s in 54 RESOLVED ---
1346518 -- Disability Access APIs alexander :surkov (:asurkov) Crash in mozilla::a11y::Accessible::RemoveChild RESOLVED mozilla55
1346910 -- Disability Access APIs Aaron Klotz [:aklotz] mscom::Interceptor is not correctly wrapping output of IServiceProvider::QueryService RESOLVED mozilla55
1346967 -- Disability Access APIs Aaron Klotz [:aklotz] Fix processing of ISimpleDOM IDL RESOLVED mozilla55
1348045 P3 Disability Access APIs Exception thrown at 0x7634A882 (KernelBase.dll) in firefox.exe: 0x800706BA: The RPC server is unavailable. RESOLVED ---
1348069 -- Disability Access APIs Aaron Klotz [:aklotz] Robustness against third-party tampering with MSAA registry settings RESOLVED mozilla55
1353094 -- Disability Access APIs David Parks (dparks) [:handyman] Accessibility causes asserts/crashes on att.com on Windows RESOLVED mozilla55
1353554 P3 Disability Access APIs Form field does not allow entry and JAWS screenreader reads varying statements when keys are pressed RESOLVED ---
1353818 P3 Disability Access APIs Slider does not function with JAWS screenreader RESOLVED ---
1354077 -- Disability Access APIs Aaron Klotz [:aklotz] a11y crashes due to null COM proxy on top-level PDocAccessible RESOLVED mozilla56
1355968 -- Installer Aaron Klotz [:aklotz] AccessibleHandler.dll needs to be registered by updater RESOLVED Firefox 55
1357547 -- Disability Access APIs Browser menubar menu announcement issues w/e10s RESOLVED ---
1358276 -- Disability Access APIs Aaron Klotz [:aklotz] a11y+e10s broken on Windows 10 creators update RESOLVED mozilla55
1359129 -- Disability Access APIs David Parks (dparks) [:handyman] Crash in IPCError-browser | PDocAccessibleParent::AddChildDoc binding to nonexistant proxy! RESOLVED mozilla55
1359970 -- Disability Access APIs Focus issue with accessibility and the menu bar under e10s? RESOLVED ---
1360122 -- Disability Access APIs alexander :surkov (:asurkov) Crash in mozilla::a11y::DocAccessible::ContentRemoved RESOLVED ---
1361879 -- Disability Access APIs Aaron Klotz [:aklotz] sdnAccessible tearoff breaks COM object identity RESOLVED mozilla55
1363221 -- Disability Access APIs Aaron Klotz [:aklotz] Enable a11y COM handler in nightly RESOLVED mozilla56
1364544 -- Disability Access APIs Aaron Klotz [:aklotz] Proxied CARET_MOVED and FOCUS events need to update the system caret before firing their WinEvent RESOLVED mozilla55
1365015 -- CIDuty Windows test machines need AccessibleHandler.dll registered in the system registry RESOLVED ---
1365073 -- Disability Access APIs Aaron Klotz [:aklotz] Obsolete unique id generated by sdnAccessible::get_nodeInfo RESOLVED mozilla55
1365655 P3 Disability Access APIs [meta] e10s+a11y perf NEW ---
1366264 P1 Disability Access APIs David Parks (dparks) [:handyman] Crash in IPCError-browser | PDocAccessibleParent::RecvShowEvent failed to add children RESOLVED ---
1366374 -- Disability Access APIs Eitan Isaacson (Leave thru 12/23) [:eeejay] Fail gracefully when a11y COM handler is not registered RESOLVED mozilla56
1368571 -- Disability Access APIs Aaron Klotz [:aklotz] Marshal proxies from chrome process to remote clients sans handler RESOLVED mozilla55
1371454 -- Disability Access APIs Jim Mathies [:jimm] NVDA crashes when tabbing through bugzilla forms RESOLVED ---
1374643 -- Disability Access APIs Aaron Klotz [:aklotz] Crash in mozilla::a11y::HandlerProvider::MarshalAs RESOLVED mozilla56
1374792 -- Disability Access APIs Aaron Klotz [:aklotz] Crash in @0x0 | mozilla::mscom::Interceptor::ThreadSafeQueryInterface RESOLVED mozilla56
1374984 -- Disability Access APIs Crash in <T>::operator() | mozilla::detail::RunnableFunction<T>::Run RESOLVED ---
1375429 -- Disability Access APIs Aaron Klotz [:aklotz] [e10s] Regression: No focus events fired on menu items in pull down menus off the main menu bar RESOLVED mozilla56
1375918 -- Disability Access APIs Re-check touchscreen / a11y severance code for Windows 10 Creators Update RESOLVED ---
1376754 P1 Disability Access APIs Eitan Isaacson (Leave thru 12/23) [:eeejay] Intermittent crash in IPCError-browser | PDocAccessibleParent::AddChildDoc binding to nonexistant proxy! RESOLVED mozilla57
1378141 -- Disability Access APIs Aaron Klotz [:aklotz] a11y crashes | PBrowserParent::RecvPDocAccessibleConstructor Constructing a top-level PDocAccessible with null COM RESOLVED mozilla56
1378382 -- Disability Access APIs Crash in mozilla::mscom::AsyncInvoker<T>::AsyncInvoker<T> RESOLVED ---
1379951 P3 Disability Access APIs a11y stack overflows at sandbox level 3 REOPENED mozilla56
1380214 -- Disability Access APIs Aaron Klotz [:aklotz] Crash in IPCError-browser | PBrowserParent::RecvPDocAccessibleConstructor Constructing a top-level PDocAccessible with null COM RESOLVED mozilla56
1380471 -- Disability Access APIs Aaron Klotz [:aklotz] Window emulation needs to SetProp inside WM_CREATE RESOLVED mozilla56
1381943 -- Disability Access APIs Crash in @0x0 | mozilla::mscom::Interceptor::ThreadSafeQueryInterface RESOLVED ---
1382820 P3 Telemetry Jim Mathies [:jimm] Convert a11y_consumers and a11y_instantiated_flag to opt-out RESOLVED mozilla55
1383131 P2 Disability Access APIs Aaron Klotz [:aklotz] compatiblity.cpp assertion on Windows 7 RESOLVED mozilla58
1383501 P1 Disability Access APIs Jim Mathies [:jimm] PBrowserParent::RecvPDocAccessibleConstructor Constructing a top-level PDocAccessible with null COM RESOLVED mozilla58
1384328 P1 Disability Access APIs Aaron Klotz [:aklotz] IAccessible2::get_relations is expensive RESOLVED mozilla56
1384528 P1 Datasets: Main Summary Blake Imsland [:robotblake] Add accessibility probes (A11Y_CONSUMERS, A11Y_INSTANTIATED_FLAG) to main_summary RESOLVED ---
1384560 -- Disability Access APIs Jim Mathies [:jimm] Annotate crash reports with accessibility client information RESOLVED mozilla57
1384567 -- Preferences Jim Mathies [:jimm] Add a privacy preference for accessibility VERIFIED Firefox 57
1384672 -- Disability Access APIs Eitan Isaacson (Leave thru 12/23) [:eeejay] Add Windows a11y client information to about:support RESOLVED mozilla57
1385991 P1 Disability Access APIs Jim Mathies [:jimm] Detect and block older versions of JAWS that are not e10s compatible VERIFIED mozilla57
1386486 P2 Disability Access APIs Crash in RefPtr<T>::~RefPtr<T> | mozilla::mscom::Interceptor::GetInterceptorForIID RESOLVED ---
1387038 P1 Disability Access APIs NVDA produces errors in the rich text editor of Gmail RESOLVED ---
1387507 P1 Disability Access APIs Jim Mathies [:jimm] Remove a11y e10s app runner disabling code in 57 RESOLVED mozilla57
1388409 P2 Disability Access APIs Long jank issues with JAWS and Nightly on text heavy pages RESOLVED ---
1388866 -- General Peter Bengtsson [:peterbe] Make meta values AccessibilityInProcClient and AccessibilityClient available for faceting/search RESOLVED ---
1390652 -- Disability Access APIs Aaron Klotz [:aklotz] Level 3 sandbox breaks IAccessible::get_accParent on top-level documents RESOLVED mozilla57
1391733 -- Disability Access APIs David Bolter [:davidb] (NeedInfo me for attention) Update telemetry to provide information about e10s incompatible jaws usage RESOLVED mozilla57
1392753 P1 Knowledge Base Content Create SUMO article to help with and explain Accessibility features/services. RESOLVED 2017Q3
1393600 P1 Disability Access APIs Aaron Klotz [:aklotz] Handler <--> Proxy Interface Mismatch RESOLVED mozilla58
1393987 -- Disability Access APIs Jim Mathies [:jimm] Add in-process client information to Accessibility Instantiator support info RESOLVED mozilla57
1394659 P3 Disability Access APIs Full UIA traversals during AT DLL virtual buffer traversals NEW ---
1395059 P1 Disability Access APIs [e10s] Fetching table cell other than first with table interfaces returns broken object RESOLVED ---
1395104 P2 Disability Access APIs Crash in NS_CycleCollectorSuspect3 when uploading a video with a screenreader active RESOLVED ---
1395536 P2 Disability Access APIs Firefox is running slow with NVDA and Youtube RESOLVED ---
1395840 -- Disability Access APIs Aaron Klotz [:aklotz] Major breakage with NVDA's virtual buffers in second Thursday's Nightly VERIFIED mozilla57
1396039 P3 Disability Access APIs get_accChild hangs somewhat frequently NEW ---
1398027 P1 Disability Access APIs JAWS and Firefox with E10S on become unusable after 2-3 minutes of use RESOLVED ---
1398509 -- Disability Access APIs NVDA reports 'unknown' tabbing through content elements RESOLVED ---
1399557 P1 Disability Access APIs Aaron Klotz [:aklotz] Crash in mozilla::a11y::DocAccessible::DoInitialUpdate RESOLVED mozilla58
1400434 P3 Disability Access APIs JAWS Screenreader does not read selected text from a hide/show region NEW ---
1401392 -- Disability Access APIs Aaron Klotz [:aklotz] Windows content processes require fully-fledged application accessibles RESOLVED mozilla57
1401561 P1 Disability Access APIs Jim Mathies [:jimm] Make sure the JAWS prompt doesn't trigger in non-e10s VERIFIED mozilla58
1402376 -- Application Update Robert Strong [slack rstrong] (Robert they/them - use needinfo to contact me) Add JAWS client information to update url VERIFIED mozilla58
1403687 -- Disability Access APIs Aaron Klotz [:aklotz] Don't use sync text change for events being replayed from DocAccessibleChild deferred event queue RESOLVED mozilla58
1406822 P1 Disability Access APIs Aaron Klotz [:aklotz] Fetching table cell accessibles by coords causes table breakage with handler enabled RESOLVED mozilla58
1406827 P3 IPC: MSCOM Aaron Klotz [:aklotz] Firefox debug build on Windows crashes immediately when a11y is enabled with "Assertion failure: mshlflags & MSHLFLAGS_TABLESTRONG, at /ipc/mscom/PassthruProxy.cpp:133" RESOLVED mozilla59
1408113 P2 Knowledge Base Content Update accessibility client table in current SUMO article with newer string tokens RESOLVED ---
1409538 -- IPC: MSCOM Aaron Klotz [:aklotz] Add duration to MSCOM log RESOLVED mozilla58
1409541 -- Disability Access APIs Aaron Klotz [:aklotz] ArrayData fixes VERIFIED mozilla58
1409545 -- IPC: MSCOM Aaron Klotz [:aklotz] Interceptor should resolve IUnknown outparams to expected interface when possible RESOLVED mozilla58
1409916 -- Disability Access APIs James Teh [:Jamie] [e10s a11y] Eliminate pointless cross-proc call for IA2_2::attribute RESOLVED mozilla58
1410159 -- Disability Access APIs Aaron Klotz [:aklotz] Add more methods to HandlerProvider::GetEffectiveOutParamIid RESOLVED mozilla58
1411391 -- IPC: MSCOM Aaron Klotz [:aklotz] InterceptorLog is missing overhead time spent wrapping interface outparams RESOLVED mozilla58
1411439 -- IPC: MSCOM Aaron Klotz [:aklotz] Pass interceptor to IHandlerProvider RESOLVED mozilla58
1411453 P2 Disability Access APIs James Teh [:Jamie] Nasty freeze after typing characters into Bugzilla Splinter comment RESOLVED ---
1411685 P2 Disability Access APIs James Teh [:Jamie] Crash in <T>::operator() | mozilla::detail::RunnableFunction<T>::Run RESOLVED mozilla61
1412088 -- IPC: MSCOM MainThreadHandoff call to Interceptor::GetInterceptorFromIID should be smarter RESOLVED ---
1412103 -- Disability Access APIs Aaron Klotz [:aklotz] Make sure the handler cache supports VT_BSTR for accRole RESOLVED mozilla58
1412635 P1 Disability Access APIs Aaron Klotz [:aklotz] Crash in MessageBuilder::WriteElement RESOLVED mozilla58
1413009 -- IPC: MSCOM Aaron Klotz [:aklotz] Configure parent main thread message filter to only accept one logical thread at a time RESOLVED ---
1413599 P1 Disability Access APIs Jim Mathies [:jimm] Update our current "switch to ESR" prompt version check to include JAWS versions 19 and lower RESOLVED mozilla58
1414074 P3 Disability Access APIs Check interceptor behaviour with IAccessible2_3::selectionRanges NEW ---
1414421 -- IPC: MSCOM Aaron Klotz [:aklotz] Change MSCOM diagnostic asserts to fire only on Nightly RESOLVED mozilla59
1418448 -- Disability Access APIs James Teh [:Jamie] Clean up BSTRs for DynamicIA2Data RESOLVED mozilla59
1419886 -- Disability Access APIs Aaron Klotz [:aklotz] Find a way to determine UIA client instantiator RESOLVED mozilla59
1422176 P3 Disability Access APIs NVDA doesn't switch to browse mode with alt+upArrow in expanded select (AKA accParent incorrect on e10s select dropdowns) RESOLVED ---
1422201 -- Disability Access APIs James Teh [:Jamie] NVDA takes on the dev tools document as the content of certain tabs RESOLVED mozilla59
1422394 -- mozglue Aaron Klotz [:aklotz] Add a mechanism to safely report DLL load events RESOLVED mozilla59

181 Total; 7 Open (3.87%); 163 Resolved (90.06%); 11 Verified (6.08%);


Full Query
ID Priority Component Assigned to Summary Status Target milestone
1189277 P2 Disability Access APIs Trevor Saunders (:tbsaunde) Crash in IPCError-browser | (msgtype=0x580009,name=PDocAccessible::Msg_BindChildDoc) Processing error: message was deserialized RESOLVED ---
1206711 -- Disability Access APIs Yura Zenevich [:yzen] Make Window Emulation work in e10s RESOLVED ---
1261107 -- Disability Access APIs Aaron Klotz [:aklotz] Add ability to marshal a COM object and transfer its serialized proxy across IPDL RESOLVED mozilla50
1263224 -- Disability Access APIs Aaron Klotz [:aklotz] Hand off a11y requests from RPC thread to main thread RESOLVED mozilla50
1268151 -- IPC Aaron Klotz [:aklotz] Circular includes in IPDL headers leading to odd behavior RESOLVED mozilla50
1268544 -- Disability Access APIs Aaron Klotz [:aklotz] Refactor a11y IPC to allow for remoting COM objects RESOLVED mozilla51
1269369 -- Disability Access APIs Yura Zenevich [:yzen] [e10s] DOMNodeId accessible proxy is not implemented on Windows. RESOLVED mozilla53
1270916 P2 Disability Access APIs Trevor Saunders (:tbsaunde) Crash in IPCError-browser | (msgtype=0x2C0004,name=PBrowser::Msg_PDocAccessibleConstructor) Processing error: message was deseri RESOLVED ---
1272146 -- Disability Access APIs Aaron Klotz [:aklotz] Thunk for IAccessible property accesses that pass non-self child IDs RESOLVED mozilla51
1273635 -- Disability Access APIs Aaron Klotz [:aklotz] Mitigate potential a11y deadlocks due to COM calls originating from chrome process RESOLVED mozilla51
1275731 -- Disability Access APIs Aaron Klotz [:aklotz] Add ia2marshal.dll to installer RESOLVED mozilla50
1277075 -- Disability Access APIs Aaron Klotz [:aklotz] Disable COM's catch-all exception handler RESOLVED mozilla50
1296571 -- Disability Access APIs 223.05% a11yr (windows8-64) regression on push d84b4dd26a403675c8059e5d073ebc65d5fc07eb (Thu Aug 18 2016) RESOLVED ---
1297549 -- Disability Access APIs Aaron Klotz [:aklotz] Arrow keys will not read the page with a11y and e10s RESOLVED mozilla52
1303060 -- Disability Access APIs Aaron Klotz [:aklotz] Implement COM handler to reduce RPC round-trips RESOLVED mozilla55
1309236 -- Disability Access APIs Aaron Klotz [:aklotz] Crash in mozilla::a11y::DocAccessibleParent::RecvMsaaID RESOLVED mozilla52
1309271 -- Disability Access APIs Jim Mathies [:jimm] Accessibility issues when moving focus from chrome elements to content elements RESOLVED mozilla55
1310056 -- Disability Access APIs Aaron Klotz [:aklotz] Implement compatibility hack for RPC_E_CANTCALLOUT_ININPUTSYNCCALL RESOLVED mozilla55
1311834 -- IPC Aaron Klotz [:aklotz] MSCOM MainThreadInvoker: Spin the background thread while waiting for main thread RESOLVED mozilla52
1312046 -- Disability Access APIs Aaron Klotz [:aklotz] Crash in GetProxiedAccessibleInSubtree VERIFIED mozilla52
1312064 -- Disability Access APIs Crash in mozalloc_abort | NS_DebugBreak | mozilla::ipc::FatalError | mozilla::a11y::PDocAccessibleChild::SendCOMProxy RESOLVED ---
1314707 -- Disability Access APIs Aaron Klotz [:aklotz] Eliminate SendCOMProxy from PDocAccessible protocol RESOLVED mozilla53
1316109 -- Disability Access APIs Aaron Klotz [:aklotz] ia2_api_all.idl is missing a typelib entry for IAccessible2_3 RESOLVED mozilla52
1321622 -- Disability Access APIs Aaron Klotz [:aklotz] DocAccessibleParent::Unbind does not call ProxyAccessible::SetChildDoc(nullptr) RESOLVED mozilla53
1322532 -- Disability Access APIs Aaron Klotz [:aklotz] [e10s a11y] Live regions broken on Windows RESOLVED mozilla55
1336971 P2 Disability Access APIs Aaron Klotz [:aklotz] Crash in InvalidArrayIndex_CRASH | nsTArray_Impl<T>::operator[] | mozilla::a11y::AccessibleWrap::GetRemoteIAccessibleFor RESOLVED mozilla58
1337935 -- Disability Access APIs 64-bit a11y clients cannot see content accessibles from 32-bit firefox RESOLVED ---
1339947 -- IPC Aaron Klotz [:aklotz] ArrayData lookups in mscom registration code need to take inheritance into account RESOLVED mozilla54
1342243 P1 Disability Access APIs Firefox hangs when navigating through aria-autocomplete list with a screenreader RESOLVED ---
1354077 -- Disability Access APIs Aaron Klotz [:aklotz] a11y crashes due to null COM proxy on top-level PDocAccessible RESOLVED mozilla56
1374643 -- Disability Access APIs Aaron Klotz [:aklotz] Crash in mozilla::a11y::HandlerProvider::MarshalAs RESOLVED mozilla56
1387038 P1 Disability Access APIs NVDA produces errors in the rich text editor of Gmail RESOLVED ---
1395059 P1 Disability Access APIs [e10s] Fetching table cell other than first with table interfaces returns broken object RESOLVED ---
1400434 P3 Disability Access APIs JAWS Screenreader does not read selected text from a hide/show region NEW ---
1406822 P1 Disability Access APIs Aaron Klotz [:aklotz] Fetching table cell accessibles by coords causes table breakage with handler enabled RESOLVED mozilla58

35 Total; 1 Open (2.86%); 33 Resolved (94.29%); 1 Verified (2.86%);


Full Query
ID Priority Component Assigned to Summary Status Target milestone
1006185 -- Keyboard Navigation Jaws Screen reader for Windows not able to read about text RESOLVED ---
1073767 P3 Disability Access APIs Jaws screenreader does not read selected text RESOLVED ---
1310056 -- Disability Access APIs Aaron Klotz [:aklotz] Implement compatibility hack for RPC_E_CANTCALLOUT_ININPUTSYNCCALL RESOLVED mozilla55
1344962 -- Disability Access APIs Repeated crashes in mozglue.dll on twitter.com RESOLVED ---
1345623 -- Disability Access APIs Aaron Klotz [:aklotz] Exception thrown at 0x746CA832 (KernelBase.dll) in firefox.exe: 0x80020008: Bad variable type. RESOLVED ---
1345632 -- Disability Access APIs Firefox crashes on Windows with a11y + e10s when using JAWS RESOLVED ---
1347631 -- Disability Access APIs Unhandled exception at 0x689FA928 (FsDomNodeFirefox.dll) in firefox.exe: 0xC000041D: An unhandled exception was encountered during a user callback. RESOLVED ---
1348043 -- Disability Access APIs Exception thrown at 0x7634A882 (KernelBase.dll) in firefox.exe: 0x8001010D: An outgoing call cannot be made since the application is dispatching an input-synchronous call. RESOLVED ---
1350075 -- Disability Access APIs JAWS screenreader does not read tooltips on the page RESOLVED ---
1351854 P3 Disability Access APIs Entering a password with JAWS screenreader reads the characters being entered out loud RESOLVED ---
1351899 -- Disability Access APIs [e10s] Browser crashes when tab panel/accordian with ARIA CSS Selectors opens with JAWS Screenreader RESOLVED ---
1353554 P3 Disability Access APIs Form field does not allow entry and JAWS screenreader reads varying statements when keys are pressed RESOLVED ---
1353818 P3 Disability Access APIs Slider does not function with JAWS screenreader RESOLVED ---
1354238 P3 Disability Access APIs Firefox hangs when radiogroup buttons are selected with JAWS Screenreader RESOLVED ---
1354333 -- Disability Access APIs Aaron Klotz [:aklotz] ISimpleDOMNode::get_localInterface needs to be remote-friendly RESOLVED mozilla55
1361230 -- Disability Access APIs Aaron Klotz [:aklotz] Problems with Windows Hooks when JAWS is running RESOLVED ---
1363881 -- Disability Access APIs JAWS Screenreader does not read output when navigated with arrow keys RESOLVED ---
1364544 -- Disability Access APIs Aaron Klotz [:aklotz] Proxied CARET_MOVED and FOCUS events need to update the system caret before firing their WinEvent RESOLVED mozilla55
1369183 P2 Disability Access APIs NVDA/JAWS Screenreader does not read output from combobox when e10s is enabled RESOLVED ---
1369215 -- Disability Access APIs Firefox Nightly hangs when JAWS Screenreader and e10s is active RESOLVED ---
1379296 -- Disability Access APIs JAWS does not read tab panel titles when e10s is enabled RESOLVED ---
1379297 P3 Disability Access APIs JAWS does not read checkbox button selections when e10s is enabled NEW ---
1380471 -- Disability Access APIs Aaron Klotz [:aklotz] Window emulation needs to SetProp inside WM_CREATE RESOLVED mozilla56
1383260 -- Disability Access APIs Aaron Klotz [:aklotz] Handler unmarshaling is failing during ObjectFromLResult RESOLVED mozilla56
1388363 -- Disability Access APIs Jaws can't see form inputs in content RESOLVED ---
1388409 P2 Disability Access APIs Long jank issues with JAWS and Nightly on text heavy pages RESOLVED ---
1398027 P1 Disability Access APIs JAWS and Firefox with E10S on become unusable after 2-3 minutes of use RESOLVED ---
1401392 -- Disability Access APIs Aaron Klotz [:aklotz] Windows content processes require fully-fledged application accessibles RESOLVED mozilla57
1410407 -- IPC: MSCOM Crash in mozilla::mscom::MainThreadHandoff::OnWalkInterface RESOLVED ---
1411188 P3 Disability Access APIs The Accessibility instantiator does not display the installation folder of JAWS or NVDA RESOLVED ---

30 Total; 1 Open (3.33%); 29 Resolved (96.67%); 0 Verified (0%);


Sign off

Criteria

Check list

  • All Criteria under each section of Quality Assurance Strategy should be green.
  • All test cases should be executed
  • All blockers, criticals must be fixed and verified or have an agreed-upon timeline for being fixed (as determined by engineering/RelMan/QA)

Results

Aurora testing

  • TBD on TestRail

Merge to Aurora Sign-off
List of OSes that will be covered by testing

  • Link for the tests run - TBD
    • Full Test suite - TBD

Checklist

Exit Criteria Status Notes/Details
Testing Prerequisites (specs, use cases)
Testing Infrastructure setup No
Test Plan Creation [IN PROGRESS]
Test Cases Creation [IN PROGRESS]
Full Functional Tests Execution
Smoke Tests Execution
Automation Coverage
Performance Testing [IN PROGRESS]
All Defects Logged
Critical/Blockers Fixed and Verified
Daily Status Report (email/etherpad statuses/ gdoc with results)
Metrics/Telemetry N/A
QA Signoff - Nightly Release Email to be sent
QA Aurora - Full Testing
QA Signoff - Aurora Release Email to be sent
QA Beta - Full Testing
QA Signoff - Beta Release Email to be sent

Ownership

Product contact:
Erin Lancaster (IRC: elan)

User Experience contact:
Not applicable

Engineering contact:
Aaron Klotz (IRC: aklotz) (Windows)
Trevor Saunders (IRC: tbsaunde) (Linux)

QA contact:
Marco Zehe (IRC: MarcoZ)
Tracy Walker (IRC: tracy)

QA:
PM for QA team - Rares Bologa (IRC: RaresB)
QA Lead - Grover Wimberly IV (IRC: Grover-QA)
QA - Kanchan Kumari (IRC: Kanchan_QA)
QA - Justin Williams (IRC: JW_SoftvisionQA)
QA - Stefan Georgiev (IRC: StefanG_QA)
QA - Abe Masresha (IRC: Abe_LV)

Revision History

This section describes the modifications that have been made to this wiki page. A new row has been completed each time the content of this document is updated (small corrections for typographical errors do not need to be recorded). The description of the modification contains the differences from the prior version, in terms of what sections were updated and to what extent.

Date Version Author Description
12/13/2016 1.0 Grover Wimberly IV Created first draft
12/13/2016 1.1 Kanchan Kumari Added some more info
01/10/2017 1.2 Tracy Walker Make Risk/Requirements/Status prominent
01/11/2017 1.3 Grover Wimberly IV Added details of test suite, test cases, and updated status of project
02/21/2017 1.4 Grover Wimberly IV Updated bugs, testing features, and updated status of project