View source for Accessibility/ARIA1.0TestSuiteFailures

Here's a list of ARIA 1.0 tests failed on Firefox we were reported about. We use three statuses to designate the progress on a test failure:
<ul>
<li><span style="background-color: limeGreen; padding: 1px 6px;">green</span> - test doesn't fail anymore, the fix was landed;
<li><span style="background-color: Cornsilk; padding: 1px 6px;">yellow</span> - we agree we have a bug, we will fix it in reasonable time;
<li><span style="background-color: Azure; padding: 1px 6px;">unknown</span> - we didn't investigate the issue yet;
<li><span style="background-color: LightCoral; padding: 1px 6px;">red</span> - we have concerns about expected behavior.
</ul>

<table border="1" width="100%">
<tr>
<th>Test No</th>
<th>Code snippet</th>
<th>Description</th>
<th>Comment</th>
</tr>

<tr>
<td id="98">
[https://dvcs.w3.org/hg/pfwg/raw-file/tip/ARIA/1.0/tests/test-files/roles-properties-global/roles-properties-global-main-aria-hidden-false.html 98]
<span style="background-color: Azure; font-size: xx-small;">[[#98|link here]]</span>
</td>
<td>
<pre>
<div id="test" role="main"
     aria-hidden="false">
  Placeholder content
</div>
</pre>
</td>
<td>
Not mapped.  The accessible object has no state or property associated with aria-hidden="false". Firefox exposes 'hidden:false' object attribute.<br><br>
Dupe: [https://dvcs.w3.org/hg/pfwg/raw-file/tip/ARIA/1.0/tests/test-files/properties-global-norole/properties-global-norole-aria-hidden-false.html 140] (identical but having no role="main")<br>
</td>
<td>
Target: Firefox 21<br>
Refer to: <s>[https://bugzilla.mozilla.org/show_bug.cgi?id=838407 bug 838407]</s><br>
Status: <span style="background-color: limeGreen; padding: 1px 6px;">green</span>
</td>
</tr>

<tr>
<td id="99">
[https://dvcs.w3.org/hg/pfwg/raw-file/tip/ARIA/1.0/tests/test-files/roles-properties-global/roles-properties-global-main-aria-invalid-grammar.html 99]
<span style="background-color: Azure; font-size: xx-small;">[[#99|link here]]</span>
</td>
<td>
<pre>
<div id="test" role="main"
     aria-invalid="grammar">
  Placeholder content
</div>
</pre>
</td>
<td>
Set IA2_STATE_INVALID_ENTRY, AND
Expose "grammar" as a text attribute. Firefox doesn't expose the text attribute.<br><br>
Same issue: [https://dvcs.w3.org/hg/pfwg/raw-file/tip/ARIA/1.0/tests/test-files/roles-properties-global/roles-properties-global-main-aria-invalid-spelling.html 101] (aria-invalid="spelling")<br>
</td>
<td>
Target: Firefox 21<br>
Refer to: <s>[https://bugzilla.mozilla.org/show_bug.cgi?id=445510 bug 445510]</s><br>
Status: <span style="background-color: limeGreen; padding: 1px 6px;">green</span>
</td>
</tr>

<tr>
<td id="109">
[https://dvcs.w3.org/hg/pfwg/raw-file/tip/ARIA/1.0/tests/test-files/roles-properties-global/roles-properties-global-main-aria-owns-obj1.html 109]
<span style="background-color: Azure; font-size: xx-small;">[[#109|link here]]</span>
</td>
<td>
<pre>
<div id="test" role="main"
     aria-owns="obj1">
  Placeholder content
</div>
<div id="obj1">obj1</div>
</pre>
</td>
<td>
ATK: The accessibility tree is NOT modified.
Accessible "obj1" has a RELATION_NODE_CHILD_OF pointing to accessible "test", "test" has a RELATION_NODE_PARENT_OF pointing to accessible "obj1". Firefox doesn't expose the node_parent_of relation.<br><br>
</td>
<td>
Target: Firefox 21??<br>
Refer to: [https://bugzilla.mozilla.org/show_bug.cgi?id=527461 bug 527461]<br>
Status: <span style="background-color: Cornsilk; padding: 1px 6px;">yellow</span>
</td>
</tr>

<tr>
<td id="182">
[https://dvcs.w3.org/hg/pfwg/raw-file/tip/ARIA/1.0/tests/test-files/roles-properties-supported/roles-properties-supported-grid-aria-readonly-false.html 182]
<span style="background-color: Azure; font-size: xx-small;">[[#182|link here]]</span>
</td>
<td>
<pre>
<div id="test" role="grid"
     aria-readonly="false">
  Placeholder content
</div>
</pre>
</td>
<td>
Grid should have editable state.<br><br>
Same issue: [https://dvcs.w3.org/hg/pfwg/raw-file/tip/ARIA/1.0/tests/test-files/roles-properties-supported/roles-properties-supported-gridcell-aria-readonly-false.html 184] (aria-readonly on gridcell)<br>
</td>
<td>
Target: Firefox 21<br>
Refer to: <s>[https://bugzilla.mozilla.org/show_bug.cgi?id=835121 bug 835121]</s><br>
Status: <span style="background-color: limeGreen; padding: 1px 6px;">green</span>
</td>
</tr>

<tr>
<td id="189">
[https://dvcs.w3.org/hg/pfwg/raw-file/tip/ARIA/1.0/tests/test-files/roles-properties-supported/roles-properties-supported-gridcell-aria-selected-undefined.html 189]
<span style="background-color: Azure; font-size: xx-small;">[[#189|link here]]</span>
</td>
<td>
<pre>
<div id="test" role="gridcell"
     aria-selected="undefined">
  Placeholder content
</div>
</pre>
</td>
<td>
Accessible has ROLE_SYSTEM_CELL, AND aria-selected is [http://www.w3.org/TR/wai-aria/states_and_properties#aria-selected not mapped]. Firefox exposes selectable state.<br><br>
Dupe: [https://dvcs.w3.org/hg/pfwg/raw-file/tip/ARIA/1.0/tests/test-files/roles-properties-supported/roles-properties-supported-row-aria-selected-undefined.html 216] (role row)<br>
</td>
<td>
Comment: In Firefox 3.6 we fixed [https://bugzilla.mozilla.org/show_bug.cgi?id=501086 opposite bug] to the required behavior to stay consistent with aria-checked implementation. Needs discussion.<br>
Status: <span style="background-color: Azure; padding: 1px 6px;">unknown</span>
</td>
</tr>

<tr>
<td id="521">
[https://dvcs.w3.org/hg/pfwg/file/c9aa483b06ca/ARIA/1.0/tests/test-files/presentation-role/521.html 521]
<span style="background-color: Azure; font-size: xx-small;">[[#521|link here]]</span>
</td>
<td>
<pre>
<table role="presentation">
  <tr>
    <td aria-hidden="true">Test me</td>
  </tr>
</table>
</pre>
</td>
<td>
aria-hidden is a global attribute and should nullify the presentational role on the &lt;td&gt;.<br><br>
Dupes: 
[https://dvcs.w3.org/hg/pfwg/file/c9aa483b06ca/ARIA/1.0/tests/test-files/presentation-role/512.html 512] (aria-atomic),
[https://dvcs.w3.org/hg/pfwg/file/c9aa483b06ca/ARIA/1.0/tests/test-files/presentation-role/513.html 513] (aria-busy),
[https://dvcs.w3.org/hg/pfwg/file/c9aa483b06ca/ARIA/1.0/tests/test-files/presentation-role/514.html 514] (aria-controls),
[https://dvcs.w3.org/hg/pfwg/file/c9aa483b06ca/ARIA/1.0/tests/test-files/presentation-role/515.html 515] (aria-describedby),
[https://dvcs.w3.org/hg/pfwg/file/c9aa483b06ca/ARIA/1.0/tests/test-files/presentation-role/516.html 516] (aria-disabled),
[https://dvcs.w3.org/hg/pfwg/file/c9aa483b06ca/ARIA/1.0/tests/test-files/presentation-role/517.html 517] (aria-dropeffect),
[https://dvcs.w3.org/hg/pfwg/file/c9aa483b06ca/ARIA/1.0/tests/test-files/presentation-role/518.html 518] (aria-flowto),
[https://dvcs.w3.org/hg/pfwg/file/c9aa483b06ca/ARIA/1.0/tests/test-files/presentation-role/519.html 519] (aria-grabbed),
[https://dvcs.w3.org/hg/pfwg/file/c9aa483b06ca/ARIA/1.0/tests/test-files/presentation-role/520.html 520] (aria-haspopup),
[https://dvcs.w3.org/hg/pfwg/file/c9aa483b06ca/ARIA/1.0/tests/test-files/presentation-role/522.html 522] (aria-invalid),
[https://dvcs.w3.org/hg/pfwg/file/c9aa483b06ca/ARIA/1.0/tests/test-files/presentation-role/523.html 523] (aria-label),
[https://dvcs.w3.org/hg/pfwg/file/c9aa483b06ca/ARIA/1.0/tests/test-files/presentation-role/524.html 524] (aria-labelledby),
[https://dvcs.w3.org/hg/pfwg/file/c9aa483b06ca/ARIA/1.0/tests/test-files/presentation-role/525.html 525] (aria-live),
[https://dvcs.w3.org/hg/pfwg/file/c9aa483b06ca/ARIA/1.0/tests/test-files/presentation-role/526.html 526] (aria-owns),
[https://dvcs.w3.org/hg/pfwg/file/c9aa483b06ca/ARIA/1.0/tests/test-files/presentation-role/527.html 527] (aria-relevant).
</td>
<td>
Target: Firefox 19.<br>
Refer to: <s>[https://bugzilla.mozilla.org/show_bug.cgi?id=809751 bug 809751]</s>.<br>
Status: <span style="background-color: limeGreen; padding: 1px 6px;">green</span>.
</td>
</tr>


<tr>
<td id="530">
[https://dvcs.w3.org/hg/pfwg/raw-file/tip/ARIA/1.0/tests/test-files/presentation-role/530.html 530]
<span style="background-color: Azure; font-size: xx-small;">[[#530|link here]]</span>
</td>
<td>
<pre>
<ul role="presentation">
  <li id="test" aria-checked="true" aria-expanded="true">
    vegetables
  </li>
</ul>
</pre>
</td>
<td>Do not map the list item with aria-checked and aria-expanded attributes to the accessibility API.</td>
<td>Target: Firefox 20<br>
Refer to: <s>[https://bugzilla.mozilla.org/show_bug.cgi?id=804461 bug 804461]</s>.<br>
Status: <span style="background-color: limeGreen; padding: 1px 6px;">green</span>.
</td>
</tr>

<tr>
<td id="585">
[https://dvcs.w3.org/hg/pfwg/raw-file/tip/ARIA/1.0/tests/test-files/name-computation-input/585.html 585]
<span style="background-color: Azure; font-size: xx-small;">[[#585|link here]]</span>
</td>
<td>
<pre>
<div id="test" role="menuitemradio" aria-checked="mixed">
  Radio menu item with aria-checked='mixed'
</div>
</pre>
</td>
<td>
Value is represented in accessibility API in the same manner as the value of "false".<br><br>
Dupes: 
[https://dvcs.w3.org/hg/pfwg/file/c9aa483b06ca/ARIA/1.0/tests/test-files/presentation-role/586.html 586] (role="radio").
</td>
<td>
Comment: mixed value on radios don't make any sense since radios don't support tristate. The "false" value is not a fallback value on radios. That means the browser *must* introduce a special check for the case that doesn't have *practical* usage on the web.<br>
Status: <span style="background-color: LightCoral; padding: 1px 6px;">red</span>.
</td>
</tr>

<tr>
<td id="617">
[https://dvcs.w3.org/hg/pfwg/raw-file/tip/ARIA/1.0/tests/test-files/name-computation-input/617.html 617],<br>
[https://dvcs.w3.org/hg/pfwg/raw-file/tip/ARIA/1.0/tests/test-files/name-computation-input/660.html 660]<br>
<span style="background-color: Azure; font-size: xx-small;">[[#617|link here]]</span>
</td>
<td>
<pre>
<INPUT type="checkbox" id="test">
that is referenced by a 
<label for="test">foo<input value="bar">baz</label>.
</pre>
<pre>
<style type="text/css">
  label:before { content: "foo"; }
  label:after { content: "baz"; }
</style>
<label for="test" title="bar"><input id="test"
                                     type="password"
                                     name="test"
                                     title="bar"></label>
</pre>
</td>
<td>
Firefox is missing a space delimiter in the name computation. Firefox gives 'foo barbaz'. Accessible name should be "foo bar baz".<br><br>
Dupes (text leafs): 
[https://dvcs.w3.org/hg/pfwg/raw-file/tip/ARIA/1.0/tests/test-files/name-computation-input/618.html 618] (input@type="text"),
[https://dvcs.w3.org/hg/pfwg/raw-file/tip/ARIA/1.0/tests/test-files/name-computation-input/619.html 619] (input@type="password"),
[https://dvcs.w3.org/hg/pfwg/raw-file/tip/ARIA/1.0/tests/test-files/name-computation-input/620.html 620] (input@type="radio"),
[https://dvcs.w3.org/hg/pfwg/raw-file/tip/ARIA/1.0/tests/test-files/name-computation-input/621.html 621] (input@type="file").<br><br>
Same issue (CSS generated text):
[https://dvcs.w3.org/hg/pfwg/raw-file/tip/ARIA/1.0/tests/test-files/name-computation-input/659.html 659] (input@type="text"),
[https://dvcs.w3.org/hg/pfwg/raw-file/tip/ARIA/1.0/tests/test-files/name-computation-input/661.html 661] (input@type="checkbox"),
[https://dvcs.w3.org/hg/pfwg/raw-file/tip/ARIA/1.0/tests/test-files/name-computation-input/662.html 662] (input@type="radio").
</td>
<td>
Target: Firefox 21<br>
Refer to: <s>[https://bugzilla.mozilla.org/show_bug.cgi?id=823927 bug 823927]</s><br>
Status: <span style="background-color: limeGreen; padding: 1px 6px;">green</span>
</td>
</tr>

<tr>
<td id="627">
[https://dvcs.w3.org/hg/pfwg/raw-file/tip/ARIA/1.0/tests/test-files/accessible-name-input/checkbox-label-embedded-menu.html 627]
<span style="background-color: Azure; font-size: xx-small;">[[#627|link here]]</span>
</td>
<td>
<pre>
<input type="checkbox" id="test" />
<label for="test">Flash the screen 
  <span role="menu">
    <span role="menuitem" aria-selected="true">1</span>
    <span role="menuitem" hidden>2</span>
    <span role="menuitem" hidden>3</span>
  </span>
  times.
</label>
</pre>
</td>
<td>
Accessible name should be "Flash the screen 1 times".  Firefox leaves out the selected menu item in the name computation.<br><br>
Dupes:
[https://dvcs.w3.org/hg/pfwg/raw-file/tip/ARIA/1.0/tests/test-files/name-computation-input/628.html 628] (input@type="text"),
[https://dvcs.w3.org/hg/pfwg/raw-file/tip/ARIA/1.0/tests/test-files/name-computation-input/629.html 629] (input@type="password"),
[https://dvcs.w3.org/hg/pfwg/raw-file/tip/ARIA/1.0/tests/test-files/name-computation-input/630.html 630] (input@type="radio"),
[https://dvcs.w3.org/hg/pfwg/raw-file/tip/ARIA/1.0/tests/test-files/name-computation-input/631.html 631] (input@type="file").<br><br>
</td>
<td>
Comment: Firefox menus don't expose selected item as value. So it's not included into the name.<br>
Status: <span style="background-color: LightCoral; padding: 1px 6px;">red</span>
</td>
</tr>

<tr>
<td id="632">
[https://dvcs.w3.org/hg/pfwg/raw-file/tip/ARIA/1.0/tests/test-files/accessible-name-input/checkbox-label-embedded-combobox.html 632]
<span style="background-color: Azure; font-size: xx-small;">[[#632|link here]]</span>
</td>
<td>
<pre>
<input type="checkbox" id="test" />
<label for="test">Flash the screen 
  <div role="combobox">
    <div role="textbox"></div>
    <ul role="listbox">
      <li role="option" aria-selected="true">1</li>
      <li role="option">2</li>
      <li role="option">3</li>
    </ul>
  </div>
  times.
</label>
</pre>
</td>
<td>
Accessible name should be "Flash the screen* 1 times".  Firefox leaves out the selected option in the name computation.<br><br>
Dupes:
[https://dvcs.w3.org/hg/pfwg/raw-file/tip/ARIA/1.0/tests/test-files/accessible-name-input/text-label-embedded-combobox.html 633] (input@type="text"),
[https://dvcs.w3.org/hg/pfwg/raw-file/tip/ARIA/1.0/tests/test-files/accessible-name-input/passowrd-label-embedded-combobox.html 634] (input@type="password"),
[https://dvcs.w3.org/hg/pfwg/raw-file/tip/ARIA/1.0/tests/test-files/accessible-name-input/radio-label-embedded-combobox.html 635] (input@type="radio"),
[https://dvcs.w3.org/hg/pfwg/raw-file/tip/ARIA/1.0/tests/test-files/accessible-name-input/file-label-embedded-combobox.html 636] (input@type="file").<br>
</td>
<td>
Target: Firefox 21<br>
Related to: 
<ul>
<li><s>[https://bugzilla.mozilla.org/show_bug.cgi?id=819273 bug 819273]</s> - ARIA combobox should expose accessible value (Firefox 20)
<li><s>[https://bugzilla.mozilla.org/show_bug.cgi?id=835666 bug 835666]</s> - ARIA combobox value is not a part of name computation (Firefox 21)
</ul>
Status: <span style="background-color: limeGreen; padding: 1px 6px;">green</span>
</td>
</tr>

<tr>
<td id="637">
[https://dvcs.w3.org/hg/pfwg/raw-file/tip/ARIA/1.0/tests/test-files/accessible-name-input/checkbox-label-embedded-slider.html 637]
<span style="background-color: Azure; font-size: xx-small;">[[#637|link here]]</span>
</td>
<td>
<pre>
<input type="checkbox" id="test" />
<label for="test">
  foo 
  <input role="slider" type="range"
         value="5" min="1" max="10"
         aria-valuenow="5" aria-valuemin="1"
         aria-valuemax="10">
   baz
</label>
</pre>
</td>
<td>
Accessible name should be "foo 5 baz".<br><br>

Dupes:<br>
[https://dvcs.w3.org/hg/pfwg/raw-file/tip/ARIA/1.0/tests/test-files/accessible-name-input/file-label-embedded-slider.html 638] (input@type="file"),
[https://dvcs.w3.org/hg/pfwg/raw-file/tip/ARIA/1.0/tests/test-files/accessible-name-input/password-label-embedded-slider.html 639] (input@type="password"),
[https://dvcs.w3.org/hg/pfwg/raw-file/tip/ARIA/1.0/tests/test-files/accessible-name-input/radio-label-embedded-slider.html 640] (input@type="radio"),
[https://dvcs.w3.org/hg/pfwg/raw-file/tip/ARIA/1.0/tests/test-files/accessible-name-input/text-label-embedded-slider.html 641] (input@type="text").<br><br>
Same problem (spinbutton having aria-valuetext or aria-valuenow): 
[https://dvcs.w3.org/hg/pfwg/raw-file/tip/ARIA/1.0/tests/test-files/name-computation-input/549.html 549] (aria-valuetext),
[https://dvcs.w3.org/hg/pfwg/raw-file/tip/ARIA/1.0/tests/test-files/name-computation-input/550.html 550] (aria-valuenow).<br><br>
Same problem (contains <input role="spinbutton"> having @value and @aria-valuenow):<br>
[https://dvcs.w3.org/hg/pfwg/raw-file/tip/ARIA/1.0/tests/test-files/accessible-name-input/checkbox-label-embedded-spinbutton.html 642] (input@type="checkbox"),
[https://dvcs.w3.org/hg/pfwg/raw-file/tip/ARIA/1.0/tests/test-files/accessible-name-input/file-label-embedded-spinbutton.html 643] (input@type="file"),
[https://dvcs.w3.org/hg/pfwg/raw-file/tip/ARIA/1.0/tests/test-files/accessible-name-input/password-label-embedded-spinbutton.html 644] (input@type="password"),
[https://dvcs.w3.org/hg/pfwg/raw-file/tip/ARIA/1.0/tests/test-files/accessible-name-input/radio-label-embedded-spinbutton.html 645] (input@type="radio"),
[https://dvcs.w3.org/hg/pfwg/raw-file/tip/ARIA/1.0/tests/test-files/accessible-name-input/text-label-embedded-spinbutton.html 646] (input@type="text").

</td>
<td>
Target: Firefox 19<br>
Refer to: <s>[https://bugzilla.mozilla.org/show_bug.cgi?id=812041 bug 812041]</s><br>
Status: <span style="background-color: limeGreen; padding: 1px 6px;">green</span>
</td>
</tr>

<tr>
<td id="652">
[https://dvcs.w3.org/hg/pfwg/raw-file/tip/ARIA/1.0/tests/test-files/accessible-name-input/image-title.html 652]
<span style="background-color: Azure; font-size: xx-small;">[[#652|link here]]</span>
</td>
<td>
<pre>
<input type="image" src="test.png"
       id="test" title="foo" />
</pre>
</td>
<td>
Accessible name should be "foo"  (from @title). Firefox exposes "Submit Query".
</td>
<td>
Comment: We had a bug <s>[https://bugzilla.mozilla.org/show_bug.cgi?id=771141 bug 771141]</s> which was wontfixed. In Firefox "Submit Query" is a visible text of the button which is used as accessible name (@title is used as accessible description). Also see [https://www.w3.org/Bugs/Public/show_bug.cgi?id=20446 a11y HTML spec bug].<br>
Status: <span style="background-color: LightCoral; padding: 1px 6px;">red</span>
</td>
</tr>

<tr>
<td id="663">
[https://dvcs.w3.org/hg/pfwg/raw-file/tip/ARIA/1.0/tests/test-files/name-computation-input/663.html 663]
<span style="background-color: Azure; font-size: xx-small;">[[#663|link here]]</span>
</td>
<td>
<pre>
<style type="text/css">
  label:before { content: "foo"; }
  label:after { content: "baz"; }
</style>
<label for="test" title="bar"><input id="test"
                                     type="file"
                                     name="test"
                                     title="bar"></label>
</pre>
</td>
<td>
Accessible name is "foo bar baz".. Firefox exposes a name containing "Browse" from "Browse" button.<br><br>
</td>
<td>
Comment: We should decide how the file control should be exposed to AT (hierarchy) first of all. Needs investigations.<br>
Status: <span style="background-color: Azure; padding: 1px 6px;">unknown</span>
</td>
</tr>

<tr>
<td id="752">
[https://dvcs.w3.org/hg/pfwg/raw-file/tip/ARIA/1.0/tests/test-files/name-computation-input/752.html 752]
<span style="background-color: Azure; font-size: xx-small;">[[#752|link here]]</span>
</td>
<td>
<pre>
<input type="image" src="foo.jpg" id="test" title="crazy"/>
</pre>
</td>
<td>
Accessible name is equal to the value of the title attribute, which is "crazy". Firefox exposes @src attribute value instead.<br><br>
</td>
<td>
Target: Firefox 21<br>
Refer to: <s>[https://bugzilla.mozilla.org/show_bug.cgi?id=786163 bug 786163]</s><br>
Status: <span style="background-color: limeGreen; padding: 1px 6px;">green</span>
</td>
</tr>
</table>