Accessibility/ARIA1.0TestSuiteFailures

Here's a list of ARIA 1.0 tests failed on Firefox we were reported about. We use three statuses to designate the progress on a test failure:

• green - test doesn't fail anymore, the fix was landed;
• yellow - we agree we have a bug, it will be fixed it in reasonable time;
• unknown - we have concerns about expected behavior, the issue is under discussion;
• red - we think expected results are incorrect, no plans for a fix;
• none - the issue hasn't been investigated yet.

Test No	Code snippet	Description	Comment
69 link here	<div role="tree" aria-owns="treeitem1"></div> <div role="treeitem" id="treeitem1" aria-owns="group1">Level 1 Item</div> <div role="group" id="group1" aria-owns="test"></div> <div role="treeitem" id="test">Level 2 Item</div>	2nd tree item should have level 2 Dupes: 71, ARIA group is lined to items by aria-owns.	Target: ?? Refer to: bug 499917 Status: yellow
85 link here		EVENT_OBJECT_SELECTION then EVENT_OBJECT_STATECHANGE on newly focused item, but arrange events so state change does not occur on focused item, to avoid extra selection change announcements Dupes: 86, ARIA grid	Target: ?? Refer to: ?? Status: unknown
98 link here	<div id="test" role="main" aria-hidden="false"> Placeholder content </div>	Not mapped. The accessible object has no state or property associated with aria-hidden="false". Firefox exposes 'hidden:false' object attribute. Dupe: 140 (identical but having no role="main")	Target: Firefox 21 Refer to: bug 838407 Status: green
99 link here	<div id="test" role="main" aria-invalid="grammar"> Placeholder content </div>	Set IA2_STATE_INVALID_ENTRY, AND Expose "grammar" as a text attribute. Firefox doesn't expose the text attribute. Same issue: 101 (aria-invalid="spelling")	Target: Firefox 21 Refer to: bug 445510 Status: green
109 link here	<div id="test" role="main" aria-owns="obj1"> Placeholder content </div> <div id="obj1">obj1</div>	ATK: The accessibility tree is NOT modified. Accessible "obj1" has a RELATION_NODE_CHILD_OF pointing to accessible "test", "test" has a RELATION_NODE_PARENT_OF pointing to accessible "obj1". Firefox doesn't expose the node_parent_of relation.	Target: Firefox 22 Refer to: bug 527461 Status: green
182 link here	<div id="test" role="grid" aria-readonly="false"> Placeholder content </div>	Grid should have editable state. Same issue: 184 (aria-readonly on gridcell), 268 (aria-readonly on columnheader)	Target: Firefox 21 Refer to: bug 835121 Target (268 failure): Firefox 23 Refer to: bug 857936 Status: green
189 link here	<div id="test" role="gridcell" aria-selected="undefined"> Placeholder content </div>	Accessible has ROLE_SYSTEM_CELL, AND aria-selected is not mapped. Firefox exposes selectable state. Dupe: 216 (role row)	Comment: Not selectable items of a grid control is not practically useful to keep it as default behavior. As opposite to this statement Rich says that a grid control is rather managed by focus than selection so having cells/rows/ not selectable by default is ok. I think Firefox could do either way. Note, it's totally ok with AT to keep rows and cells both selectable (example: Mozilla XUL tree). Status: unknown
209 link here	<div role="listbox"> <div id="test" role="option" aria-selected="undefined"> Placeholder content </div> </div>	Firefox exposes selectable state while it shouldn't Similars: 209 (role option)	Comment: In Firefox 3.6 we fixed opposite bug to the required behavior to stay consistent with aria-checked implementation. Not selectable list is the same as not checkable checkbox - it's not useful in the wild to make this behavior default. Note, there's issue 574 (aka role option should have required aria-selected state) to fix the ARIA spec. Status: red
233 link here	<div id="test" role="tablist" aria-level="1"> <div id="obj1" role="tab">obj1</div> <div role="tablist" aria-level="2"> <div id="obj2" role="tab">obj2</div> </div> </div>	IAccessible2::groupPostion should expose level	Comment: IAccessible2 groupPosition isn't applied to things like headings which have level only. Tablist may be considered as the same thing. Status: unknown
273 link here	<div id="test" role="columnheader" aria-selected="undefined"> Placeholder content </div>	Firefox exposes selectable state while it shouldn't. Dupe: 394 (role rowheader)	Target: Firefox 25 Refer to bug 888247 Status: green
347 link here	<div role="menu"> <div id="test" role="menuitemradio" aria-selected="true"> Placeholder content </div> <div id="obj1" role="menuitemradio">obj1</div> <div id="obj2" role="menuitemradio">obj2</div> </div>	div@id="test" should expose selectable/selected states.	Comment: Technically selectable/selected states are not useful for menu items because it dupes focusable/focused states. In practice Firefox exposes selectable/selected states on XUL menu items however it doesn't fire selection change events what is inconsistent. IE doesn't expose selectable/selected states on menus. Note, ARIA doesn't require selectable states on menuitem and menuitemcheckbox roles which makes the requirement not consistent. Refer to: bug 864627 Status: red
366 link here	<div role="radiogroup"> <div id="test" role="radio" aria-selected="true"> Placeholder content </div> <div id="obj1" role="radio">obj1</div> </div>	div@id="test" should expose selectable/selected states.	Comment: radios never exposed selectable/selected states, I don't see why ARIA radios would make an exception. Status: red
521 link here	<table role="presentation"> <tr> <td aria-hidden="true">Test me</td> </tr> </table>	aria-hidden is a global attribute and should nullify the presentational role on the <td>. Dupes: 512 (aria-atomic), 513 (aria-busy), 514 (aria-controls), 515 (aria-describedby), 516 (aria-disabled), 517 (aria-dropeffect), 518 (aria-flowto), 519 (aria-grabbed), 520 (aria-haspopup), 522 (aria-invalid), 523 (aria-label), 524 (aria-labelledby), 525 (aria-live), 526 (aria-owns), 527 (aria-relevant).	Target: Firefox 19. Refer to: bug 809751. Status: green.
530 link here	<ul role="presentation"> <li id="test" aria-checked="true" aria-expanded="true"> vegetables </li> </ul>	Do not map the list item with aria-checked and aria-expanded attributes to the accessibility API.	Target: Firefox 20 Refer to: bug 804461. Status: green.
585 link here	<div id="test" role="menuitemradio" aria-checked="mixed"> Radio menu item with aria-checked='mixed' </div>	Value is represented in accessibility API in the same manner as the value of "false". Dupes: 586 (role="radio", same as 363) 344 (role="menuitemradio", same as 585)	Comment: mixed value on radios don't make any sense since radios don't support tristate. The "false" value is not a fallback value on radios. That means the browser *must* introduce a special check for the case that doesn't have *practical* usage on the web. Status: red.
617, 660 link here	<INPUT type="checkbox" id="test"> that is referenced by a <label for="test">foo<input value="bar">baz</label>. <style type="text/css"> label:before { content: "foo"; } label:after { content: "baz"; } </style> <label for="test" title="bar"><input id="test" type="password" name="test" title="bar"></label>	Firefox is missing a space delimiter in the name computation. Firefox gives 'foo barbaz'. Accessible name should be "foo bar baz". Dupes (text leafs): 618 (input@type="text"), 619 (input@type="password"), 620 (input@type="radio"), 621 (input@type="file"). Same issue (CSS generated text): 659 (input@type="text"), 661 (input@type="checkbox"), 662 (input@type="radio").	Target: Firefox 21 Refer to: bug 823927 Status: green
627 link here	<input type="checkbox" id="test" /> <label for="test">Flash the screen <span role="menu"> <span role="menuitem" aria-selected="true">1</span> <span role="menuitem" hidden>2</span> <span role="menuitem" hidden>3</span> </span> times. </label>	Accessible name should be "Flash the screen 1 times". Firefox leaves out the selected menu item in the name computation. Dupes: 628 (input@type="text"), 629 (input@type="password"), 630 (input@type="radio"), 631 (input@type="file").	Comment: Firefox menus don't expose selected item as value. So it's not included into the name. Status: red
632 link here	<input type="checkbox" id="test" /> <label for="test">Flash the screen <div role="combobox"> <div role="textbox"></div> <ul role="listbox"> <li role="option" aria-selected="true">1</li> <li role="option">2</li> <li role="option">3</li> </ul> </div> times. </label>	Accessible name should be "Flash the screen* 1 times". Firefox leaves out the selected option in the name computation. Dupes: 633 (input@type="text"), 634 (input@type="password"), 635 (input@type="radio"), 636 (input@type="file").	Target: Firefox 21 Related to: bug 819273 - ARIA combobox should expose accessible value (Firefox 20) bug 835666 - ARIA combobox value is not a part of name computation (Firefox 21) Status: green
637 link here	<input type="checkbox" id="test" /> <label for="test"> foo <input role="slider" type="range" value="5" min="1" max="10" aria-valuenow="5" aria-valuemin="1" aria-valuemax="10"> baz </label>	Accessible name should be "foo 5 baz". Dupes: 638 (input@type="file"), 639 (input@type="password"), 640 (input@type="radio"), 641 (input@type="text"). Same problem (spinbutton having aria-valuetext or aria-valuenow): 549 (aria-valuetext), 550 (aria-valuenow). Same problem (contains <input role="spinbutton"> having @value and @aria-valuenow): 642 (input@type="checkbox"), 643 (input@type="file"), 644 (input@type="password"), 645 (input@type="radio"), 646 (input@type="text").	Target: Firefox 19 Refer to: bug 812041 Status: green
652 link here	<input type="image" src="test.png" id="test" title="foo" />	Accessible name should be "foo" (from @title). Firefox exposes "Submit Query".	Comment: We had a bug bug 771141 which was wontfixed. In Firefox "Submit Query" is a visible text of the button which is used as accessible name (@title is used as accessible description). Also see a11y HTML spec bug. Status: red
663 link here	<style type="text/css"> label:before { content: "foo"; } label:after { content: "baz"; } </style> <label for="test" title="bar"><input id="test" type="file" name="test" title="bar"></label>	Accessible name is "foo bar baz".. Firefox exposes a name containing "Browse" from "Browse" button.	Comment: File input control is a button and label controls. Title attribute from file input element is propagated to these controls. Sine the button has a visual label ("Browse") then label is preferred over title attribute. Status: red
752 link here	<input type="image" src="foo.jpg" id="test" title="crazy"/>	Accessible name is equal to the value of the title attribute, which is "crazy". Firefox exposes @src attribute value instead.	Target: Firefox 21 Refer to: bug 786163 Status: green
769 link here	<div role="list"> <div role="listitem">Item 1 <div role="group"> <div role="listitem">Item 1A</div> <div role="listitem">Item 1B</div> </div> </div> <div role="listitem">Item 2 <div role="group"> <div role="listitem">Item 2A</div> <div role="listitem">Item 2B</div> </div> </div> </div>	Level should be calculated properly for nested listitems.	Target: Firefox 24 Refer to: bug 864224 Status: green
787 link here	<div id="test" aria-live="polite" aria-atomic="false">content</div>	atomic:false and container-atomic:false object attributes shouldn't be exposed	Target: Firefox 24 Refer to: bug 884648 Status: green