Accessibility/ARIA1.0TestSuiteFailures

From MozillaWiki
Jump to: navigation, search

Here's a list of ARIA 1.0 tests failed on Firefox we were reported about. We use three statuses to designate the progress on a test failure:

  • green - test doesn't fail anymore, the fix was landed;
  • yellow - we agree we have a bug, it will be fixed it in reasonable time;
  • unknown - we have concerns about expected behavior, the issue is under discussion;
  • red - we think expected results are incorrect, no plans for a fix;
  • none - the issue hasn't been investigated yet.
Test No Code snippet Description Comment

69 link here

<div role="tree" aria-owns="treeitem1"></div>
<div role="treeitem" id="treeitem1" aria-owns="group1">Level 1 Item</div>
<div role="group" id="group1" aria-owns="test"></div>
<div role="treeitem" id="test">Level 2 Item</div>

2nd tree item should have level 2

Dupes: 71, ARIA group is lined to items by aria-owns.

Target: ??
Refer to: bug 499917
Status: yellow

85 link here


EVENT_OBJECT_SELECTION then EVENT_OBJECT_STATECHANGE on newly focused item, but arrange events so state change does not occur on focused item, to avoid extra selection change announcements

Dupes: 86, ARIA grid

Target: ??
Refer to: ??
Status: unknown

98 link here

<div id="test" role="main"
     aria-hidden="false">
  Placeholder content
</div>

Not mapped. The accessible object has no state or property associated with aria-hidden="false". Firefox exposes 'hidden:false' object attribute.

Dupe: 140 (identical but having no role="main")

Target: Firefox 21
Refer to: bug 838407
Status: green

99 link here

<div id="test" role="main"
     aria-invalid="grammar">
  Placeholder content
</div>

Set IA2_STATE_INVALID_ENTRY, AND Expose "grammar" as a text attribute. Firefox doesn't expose the text attribute.

Same issue: 101 (aria-invalid="spelling")

Target: Firefox 21
Refer to: bug 445510
Status: green

109 link here

<div id="test" role="main"
     aria-owns="obj1">
  Placeholder content
</div>
<div id="obj1">obj1</div>

ATK: The accessibility tree is NOT modified. Accessible "obj1" has a RELATION_NODE_CHILD_OF pointing to accessible "test", "test" has a RELATION_NODE_PARENT_OF pointing to accessible "obj1". Firefox doesn't expose the node_parent_of relation.

Target: Firefox 22
Refer to: bug 527461
Status: green

182 link here

<div id="test" role="grid"
     aria-readonly="false">
  Placeholder content
</div>

Grid should have editable state.

Same issue: 184 (aria-readonly on gridcell), 268 (aria-readonly on columnheader)

Target: Firefox 21
Refer to: bug 835121

Target (268 failure): Firefox 23
Refer to: bug 857936
Status: green

189 link here

<div id="test" role="gridcell"
     aria-selected="undefined">
  Placeholder content
</div>

Accessible has ROLE_SYSTEM_CELL, AND aria-selected is not mapped. Firefox exposes selectable state.

Dupe: 216 (role row)

Comment: Not selectable items of a grid control is not practically useful to keep it as default behavior. As opposite to this statement Rich says that a grid control is rather managed by focus than selection so having cells/rows/ not selectable by default is ok. I think Firefox could do either way. Note, it's totally ok with AT to keep rows and cells both selectable (example: Mozilla XUL tree).

Status: unknown

209 link here

<div role="listbox">
  <div id="test" role="option"
       aria-selected="undefined">
    Placeholder content
  </div>
</div>

Firefox exposes selectable state while it shouldn't

Similars: 209 (role option)

Comment: In Firefox 3.6 we fixed opposite bug to the required behavior to stay consistent with aria-checked implementation.
Not selectable list is the same as not checkable checkbox - it's not useful in the wild to make this behavior default. Note, there's issue 574 (aka role option should have required aria-selected state) to fix the ARIA spec.

Status: red

233 link here

<div id="test" role="tablist" aria-level="1">
  <div id="obj1" role="tab">obj1</div>
  <div role="tablist" aria-level="2">
    <div id="obj2" role="tab">obj2</div>
  </div>
</div> 

IAccessible2::groupPostion should expose level

Comment: IAccessible2 groupPosition isn't applied to things like headings which have level only. Tablist may be considered as the same thing.

Status: unknown

273 link here

<div id="test" role="columnheader"
     aria-selected="undefined">
  Placeholder content
</div>

Firefox exposes selectable state while it shouldn't.

Dupe: 394 (role rowheader)

Target: Firefox 25
Refer to bug 888247
Status: green

347 link here

<div role="menu">
  <div id="test" role="menuitemradio"
       aria-selected="true">
    Placeholder content
  </div>
  <div id="obj1" role="menuitemradio">obj1</div>
  <div id="obj2" role="menuitemradio">obj2</div>
</div>

div@id="test" should expose selectable/selected states.

Comment: Technically selectable/selected states are not useful for menu items because it dupes focusable/focused states. In practice Firefox exposes selectable/selected states on XUL menu items however it doesn't fire selection change events what is inconsistent. IE doesn't expose selectable/selected states on menus. Note, ARIA doesn't require selectable states on menuitem and menuitemcheckbox roles which makes the requirement not consistent.
Refer to: bug 864627

Status: red

366 link here

<div role="radiogroup">
  <div id="test" role="radio"
       aria-selected="true">
    Placeholder content
  </div>
  <div id="obj1" role="radio">obj1</div>
</div>

div@id="test" should expose selectable/selected states.

Comment: radios never exposed selectable/selected states, I don't see why ARIA radios would make an exception.

Status: red

521 link here

<table role="presentation">
  <tr>
    <td aria-hidden="true">Test me</td>
  </tr>
</table>

aria-hidden is a global attribute and should nullify the presentational role on the <td>.

Dupes: 512 (aria-atomic), 513 (aria-busy), 514 (aria-controls), 515 (aria-describedby), 516 (aria-disabled), 517 (aria-dropeffect), 518 (aria-flowto), 519 (aria-grabbed), 520 (aria-haspopup), 522 (aria-invalid), 523 (aria-label), 524 (aria-labelledby), 525 (aria-live), 526 (aria-owns), 527 (aria-relevant).

Target: Firefox 19.
Refer to: bug 809751.
Status: green.

530 link here

<ul role="presentation">
  <li id="test" aria-checked="true" aria-expanded="true">
    vegetables
  </li>
</ul>
Do not map the list item with aria-checked and aria-expanded attributes to the accessibility API. Target: Firefox 20

Refer to: bug 804461.
Status: green.

585 link here

<div id="test" role="menuitemradio" aria-checked="mixed">
  Radio menu item with aria-checked='mixed'
</div>

Value is represented in accessibility API in the same manner as the value of "false".

Dupes: 586 (role="radio", same as 363)
344 (role="menuitemradio", same as 585)

Comment: mixed value on radios don't make any sense since radios don't support tristate. The "false" value is not a fallback value on radios. That means the browser *must* introduce a special check for the case that doesn't have *practical* usage on the web.
Status: red.

617,
660
link here

<INPUT type="checkbox" id="test">
that is referenced by a 
<label for="test">foo<input value="bar">baz</label>.
<style type="text/css">
  label:before { content: "foo"; }
  label:after { content: "baz"; }
</style>
<label for="test" title="bar"><input id="test"
                                     type="password"
                                     name="test"
                                     title="bar"></label>

Firefox is missing a space delimiter in the name computation. Firefox gives 'foo barbaz'. Accessible name should be "foo bar baz".

Dupes (text leafs): 618 (input@type="text"), 619 (input@type="password"), 620 (input@type="radio"), 621 (input@type="file").

Same issue (CSS generated text): 659 (input@type="text"), 661 (input@type="checkbox"), 662 (input@type="radio").

Target: Firefox 21
Refer to: bug 823927
Status: green

627 link here

<input type="checkbox" id="test" />
<label for="test">Flash the screen 
  <span role="menu">
    <span role="menuitem" aria-selected="true">1</span>
    <span role="menuitem" hidden>2</span>
    <span role="menuitem" hidden>3</span>
  </span>
  times.
</label>

Accessible name should be "Flash the screen 1 times". Firefox leaves out the selected menu item in the name computation.

Dupes: 628 (input@type="text"), 629 (input@type="password"), 630 (input@type="radio"), 631 (input@type="file").

Comment: Firefox menus don't expose selected item as value. So it's not included into the name.
Status: red

632 link here

<input type="checkbox" id="test" />
<label for="test">Flash the screen 
  <div role="combobox">
    <div role="textbox"></div>
    <ul role="listbox">
      <li role="option" aria-selected="true">1</li>
      <li role="option">2</li>
      <li role="option">3</li>
    </ul>
  </div>
  times.
</label>

Accessible name should be "Flash the screen* 1 times". Firefox leaves out the selected option in the name computation.

Dupes: 633 (input@type="text"), 634 (input@type="password"), 635 (input@type="radio"), 636 (input@type="file").

Target: Firefox 21
Related to:

  • bug 819273 - ARIA combobox should expose accessible value (Firefox 20)
  • bug 835666 - ARIA combobox value is not a part of name computation (Firefox 21)

Status: green

637 link here

<input type="checkbox" id="test" />
<label for="test">
  foo 
  <input role="slider" type="range"
         value="5" min="1" max="10"
         aria-valuenow="5" aria-valuemin="1"
         aria-valuemax="10">
   baz
</label>

Accessible name should be "foo 5 baz".

Dupes:
638 (input@type="file"), 639 (input@type="password"), 640 (input@type="radio"), 641 (input@type="text").

Same problem (spinbutton having aria-valuetext or aria-valuenow): 549 (aria-valuetext), 550 (aria-valuenow).

Same problem (contains <input role="spinbutton"> having @value and @aria-valuenow):
642 (input@type="checkbox"), 643 (input@type="file"), 644 (input@type="password"), 645 (input@type="radio"), 646 (input@type="text").

Target: Firefox 19
Refer to: bug 812041
Status: green

652 link here

<input type="image" src="test.png"
       id="test" title="foo" />

Accessible name should be "foo" (from @title). Firefox exposes "Submit Query".

Comment: We had a bug bug 771141 which was wontfixed. In Firefox "Submit Query" is a visible text of the button which is used as accessible name (@title is used as accessible description). Also see a11y HTML spec bug.
Status: red

663 link here

<style type="text/css">
  label:before { content: "foo"; }
  label:after { content: "baz"; }
</style>
<label for="test" title="bar"><input id="test"
                                     type="file"
                                     name="test"
                                     title="bar"></label>

Accessible name is "foo bar baz".. Firefox exposes a name containing "Browse" from "Browse" button.

Comment: File input control is a button and label controls. Title attribute from file input element is propagated to these controls. Sine the button has a visual label ("Browse") then label is preferred over title attribute.

Status: red

752 link here

<input type="image" src="foo.jpg" id="test" title="crazy"/>

Accessible name is equal to the value of the title attribute, which is "crazy". Firefox exposes @src attribute value instead.

Target: Firefox 21
Refer to: bug 786163
Status: green

769 link here

<div role="list">
  <div role="listitem">Item 1
    <div role="group">
      <div role="listitem">Item 1A</div>
      <div role="listitem">Item 1B</div>
    </div>
  </div>
  <div role="listitem">Item 2
    <div role="group">
      <div role="listitem">Item 2A</div>
      <div role="listitem">Item 2B</div>          
    </div>
  </div>
</div>

Level should be calculated properly for nested listitems.

Target: Firefox 24
Refer to: bug 864224
Status: green

787 link here

<div id="test" aria-live="polite" aria-atomic="false">content</div>

atomic:false and container-atomic:false object attributes shouldn't be exposed

Target: Firefox 24
Refer to: bug 884648
Status: green