MozillaWiki - User contributions [en]

Platform/2012-Q3-Goals

2012-07-25T13:42:19Z

TREVOR: /* Accessibility */

=== General Goals ===

=== GFX ===
<onlyinclude>
* {{ok|stop using Java screenshotting in Fennec for Android}}
** we agree that we want to do this, but we have concerns that the pieces will be there, but we'll still be unable to turn off java screenshotting because of performance problems.
** alternative: "implement multi-resolution tiles"
* {{ok|complete asynchronous panning and zooming with OMTC for B2G/gonk}}
* {{ok|Ship OMTC on B2G/gonk for basecamp}}
* {{ok|Be able to use Skia for canvas drawing on non-accelerated Windows computers}}
** gw280 to gather skia software-only performance numbers by Tuesday 3 July to help make a decision
** carryover - do we care at this point, given the below item?
* {{ok|Be able to use Skia for content drawing on Android}}
* {{ok|Remove the non-Azure canvas implementation}}
** Use the Cairo Azure backend everywhere there isn't a more specific backend
* {{ok|OMTC cross-platform refactor}}
** Risky!
** Not back-outable. No OMTC or "New OMTC" only.
** Needed so we can enable OMTC everywhere.
* {{ok|Have a clean, dependable, extensible, all-platform, free-of-adverse-cache-effects driver blacklisting solution.}}
* Other important Q3 work
** WebGL work. bjacob to fill in what this means.
** Enable Azure for content everywhere
** Snappy work
** Other B2G work as required
** Moving other pieces of work off the main thread
** BugKill - ???
** Increase number of regular contributors
</onlyinclude>

=== Layout ===

<onlyinclude>
* {{ok|Readability 2.0}}
* {{ok|Complete Graphite Fonts Project}} ({{bug|631479}})
* {{ok|Invalidation via DisplayList Analysis ({{bug|539356}})}}
* {{ok|CSS Flexbox feature/spec}} ({{bug|666041}})
* {{ok|Add image visibility API ({{bug|689623}})}}
* {{risk|Continue View class removal ({{bug|337801}})}}
* {{ok|CSS}} [[Platform/Features/Vertical_text|Vertical Text]] ({{bug|145503}})
* {{ok|CSS Pagination}} ({{bug|775628}})
* {{ok|CSS Variables}} ({{bug|773296}})
* {{ok|Implement the auto value for the HTML dir attribute ({{bug|548206}})}}
* {{ok|CSS 2.1 Test Suite v.2}}
* {{ok|CSS Spec, Unprefixing & Testing}} ({{bug|775235}})
* {{ok|Conditional Rules feature & spec}} ({{bug|649740}})
* {{ok|Scoped Style Sheets}} ({{bug|508725}})
* {{ok|SVG Text}} ({{bug|655877}})
* {{ok|Off Main Thread Animations}} ({{bug|755084}}, {{bug|706179}})
* {{risk|Layout Azure Conversion}} ({{bug|776197}} - needs staffing)
* {{prev|Support for Complex Scripts on Mobile}}
** Example bugs: {{bug|619521}}, {{bug|619524}}, {{bug|676068}}, {{bug|631159}}
* Specs:
** Web Animations (FPWD)
** CSS3 Text
** CSS4 Selectors
</onlyinclude>

=== Media ===
* {{ok|WebRTC (tracking the W3C and IETF webrtc/rtcweb specs) landed for desktop in mozilla-central. (This includes both PeerConnection and full getUserMedia, but not UI.)}}
* {{ok|Platform decoders running on the Otoro device will playback videos at a similar performance metric to the equivalent android player}}
* {{ok|For a specific list of Android phones (the list will be the "first phase" of Android phones), platform decoders running in Firefox will playback videos at a similar performance metric to the videos playing back in the default browser on the same phone}}
* {{ok|Publish (to one or more of our newsgroups) a plan for supporting the Web Audio API. (We're still hoping to make improvements to the spec.)}}

Mission Note: The media team will support B2G's efforts to ship B2G version 1 above any goals for this quarter.

=== DOM ===
* {{ok|Stop leaks by adding purple buffer support for cycle collected non-nsISupports objects.}}
* {{ok|Speed up cycle collection by representing a DOM tree as a single node in the cycle collector graph.}}
* {{ok|New DOM bindings for a HTML Element.}}

=== WebAPI ===
* {{ok|Implement cookie-jars for cookies, IndexedDB, localStorage, permission manager and appcache ({{bug|756644}})}}
* {{ok|Implement app:// protocol (part of implementing trusted apps, {{bug|756729}})}}
* {{ok|Finalize multiprocess blob support for IndexedDB, DeviceStorage and Message Manager ({{bug|759427}})}}
* {{ok|Implement unified offline storage quota system, putting IndexedDB and localStorage under this quota system ({{bug|767944}})}}
* {{ok|Zip file contents support using blobs ({{bug|772434}})}}
* {{ok|DeviceStorage improvements (expose available (free) size for each device storage, storage[x].removable ({{bug|765498}})}}
* {{ok|FileHandle [[WebAPI/FileHandleAPI#ToDo | improvements]]}}
* {{ok|DeviceStorage onchange notifications ({{bug|763976}})}}
* {{ok|DeviceStorage editable features ({{bug|752724}})}}
* {{ok|String encoding/decoding API ({{bug|764234}})}}

=== JS ===

=== Accessibility ===
* {{ok| Preliminary AccessFu support in B2G.}}
* {{ok| TTS Web API & implementation.}}
* {{ add 2 additional measures of a11y's effect on perf, and show measurable perf increase of atleast 5% on three measures}}

=== Perf ===
* {{prev|{{nbug|736144}}: Async local storage via blocking pageload}}
* {{prev|{{nbug|563742}}: provide js file api (in workers) for all supported platforms.}}
* {{prev|{{nbug|662397}}: Reorder xul.dll on windows to speed up startup}}
* {{prev|{{nbug|662444}}: call exit(0) on shutdown}}
* {{prev|{{nbug|661881}}: Bundle about-telemetry extension to ship with Firefox}}
* {{ok|{{nbug|769241}}: Make libunwind work on ARM}}
* {{prev|Prevent, to a reasonable extent, background tabs from starving the main thread}}
* {{ok|{{nbug|770317}}: Track disk + network by thread on testing infrastructure}}

=== Networking ===

* {{ok|Remove all synchronous disk cache APIs, or at least disable their use on the main thread, on mozilla-central.}}
** Nick Hurley and Michal Novotny will lead this effort.
* {{ok|{{nbug|766973}}: Don't allow synchronous DNS resolution from the main thread.}}
** Josh Aas will lead this effort.
* {{ok|{{nbug|105843}}: Land code to not necessarily delete the cache after unclean shut-down on mozilla-central.}}
** Nick Hurley and Michal Novotny will lead this effort.
* {{ok|Have Stone Ridge reliably reporting basic performance results to graph server for all three top-tier platforms.}}
** Nick Hurley will lead this effort.
* {{ok|{{nbug|768705}}, {{nbug|704447}}, {{nbug|766817}}: Fix some remaining significant WebSockets bugs.}}
** Jason Duell will lead this effort.
* {{ok|{{nbug|702122}}: Land a DASH for WebM implementation in mozilla-central.}}
** Steve Workman will lead this effort.
* {{ok|{{nbug|737470}}: Ship SPDY v3 on by default.}}
** Patrick McManus will lead this effort.
* {{ok|Resolve all networking security bugs that received a designation of sg:moderate or higher more than six weeks ago. This is a permanent goal for the group.}}
** Brian Smith will lead this effort.

=== Plugins ===

=== Mobile ===

=== B2G ===

=== Research ===

Accessibility/People

2011-12-09T19:25:28Z

TREVOR: add myself

Hello! We'd love you to add your name here so be sure to meet us and find out how you can help us move accessibility at internet speed.

= David Bolter =
{|
|rowspan="0"|[[File:Davidb.jpg]]
|-
|IRC:
|davidb
|-
|Bugzilla:
|:davidb (in other words, just type colon davidb and it will resolve)
|-
|Bio:
|Mozilla employee based in Toronto, Canada
|-
|Speaks:
|English, a little French, and even less Korean.
|-
|colspan="2"|Knows:
* Cross-platform accessibility gecko code.
* WAI-ARIA and HTML accessibility specifications and implementation.
* Who does what.
|}

= Trevor Saunders =
|{
|IRC / internets:
|tbsaunde
|-
|bugzilla:
|:TBSAUNDE
|-
|LANGUAGES:
|english, epsilon spanish
|-
|BIO:
|senior at CMU in cs, mozilla contractor / former intern
|knows:
| * cross platform code
|}

Accessibility/SoftFocus

2011-11-17T09:45:41Z

TREVOR:

== Background ==
It is useful to have a focus-like state that is exclusive to accessibility and is independant of the DOM state. From the user's perspective this allows reviewing a document or web application without directly affecting its state, like moving the caret or cycling through focusable elements. This is useful in mobile, for example a user could navigate to a text entry without having it capture input. Only if the user chooses to enter text they would "activate" the text entry which would bring up an on screen keyboard, etc. This feature would also allow easier navigation of content.

'''''Note:''''' From what I gathered from Alex's input in Toronto, he thinks it would be useful to not limit this to a single node at a time, but to allow multiple focal points. It might pay off in the long term as this would be more future proof, and allow other use cases such as multi-region magnifier or interesting features in cognitive disablity ATs. This introduces a layer of complexity (pivots); nonetheles, the usage should not get complicated, we would just always used a pivot index of 0.

== Pivots ==
A pivot (working title) is a focal point. Typically you would only have one pivot that would change depending on where the user is exploring. But you could have multiple pivots each pointing to something else and changing independantly.

== nsIAccessible ==

interface nsIAccessible : nsISupports
{
...
/***
* Take the given pivot's soft focus.
*
* @param pivotIndex The pivot of which to take focus. If the given index is -1 or out
* of range (pivotIndex >= number of pivots), create a new pivot.
* @return The index of the affected pivot.
*/
long takeSoftFocus(in long pivotIndex);
}

=== State ===

An accessible that is soft focused would have a state of <tt>EXT_STATE_SOFT_FOCUSED</tt>.

=== Event ===

When an accessible gets or loses focus, an <tt>EVENT_STATE_CHANGED</tt> is fired.

it seems like it is important for event consumer to know which pivit changed, but I'm not really sure how to comunicate this best.

== nsIAccessibleDocument ==

interface nsIAccessibleDocument : nsISupports
{
...
/***
* The collection of tracked soft focuses. The index in the array matches the pivot's
* index.
*/
readonly attribute nsIArray softFocusPivots;

/***
* Remove soft focus state from accessible on the given pivot. No-op if no
* accessible is focused on that pivot. On a successful call the
* nsIAccessibleDocument.softFocusPivots element at the given pivot index will
* be set to null.
*
* @param pivotIndex The pivot of which to blur focus.
*/
void blurSoftFocus(in PRInt32 pivotIndex);

does a negative index make sense?

}

== nsIAccessibleText ==

In addition to soft focus, an accessible that supports nsIAccessibleText could have a soft text selection that is independant of any actual selection in the document.

interface nsIAccessibleText : nsISupports
{
...
/***
* Set the soft selection to the given range.
*
* @param startOffset Start index of text to soft select.
* @param endOffset End index of text to soft select.
*/
void setSoftSelection (in long startOffset, in long endOffset);

/***
* Clear the soft selection in this accessible.
*/
void clearSoftSelection ();

/***
* Get the soft selection range in this accessible.
*
* @param startOffset [out] Start index of soft selected text.
* @param endOffset [out] End index of soft selected text.
* @return false if no range is selected.
*/
boolean getSoftSelection (out long startOffset, out long endOffset);
}

=== Event ===
When the soft selection changes an <tt>EVENT_SOFT_TEXT_SELECTION_CHANGED</tt> event is fired. This event is only emitted if the accessible already has <tt>EXT_STATE_SOFT_FOCUSED</tt>.

== Example Usage ==

=== Setting Soft Focus ===
An input event handler that changes the soft focus.

function inputEventHandler(event) {
...
let currNode = docAcc.softFocusPivots[0];
if (currNode.nextSibling)
currNode.nextSibling.takeSoftFocus(0);
}

=== Presenting Soft Focus ===
An event listener that highlights the bounds of a soft focus. <tt>drawRect()</tt> is left to your imagination.

function handleEvent(aEvent) {
if (aEvent.type == EVENT_STATE_CHANGED) {
let event = aEvent.QueryInterface(nsIAccessibleStateChangeEvent);
if (event.state == EXT_STATE_SOFT_FOCUSED && event.isExtraState()) {
if (event.isEnabled())
showSoftFocus(aEvent.accessible);
else
hideSoftFocus();
}
} else if (aEvent.type == EVENT_SOFT_TEXT_SELECTION_CHANGED) {
showSoftFocus(aEvent.accessible);
}
}

function showSoftFocus (aAccessible) {
// Only interested in pivot index 0
if (accDoc.softFocusPivots[0] != aAccessible)
return;

let x = {};
let y = {};
let w = {};
let h = {};

try {
let textAcc = aAccessible.QueryInterface(nsIAccessibleText);
let start = {};
let end = {};
if (textAcc.getSoftSelection(start, end)) {
textAcc.getRangeExtents(start.value, end.value, x, y, w, h,
COORDTYPE_SCREEN_RELATIVE);
drawRect(x.value, y.value, w.value, h.value);
return;
}
catch (e) {
}

aAccessible.getBounds(x, y, w, h);
drawRect(x.value, y.value, w.value, h.value);
}

Accessibility/B2G

2011-07-29T07:12:07Z

TREVOR: /* Boot2Gecko Accessibility, AKA B2AW (Boot 2 Accessible Web) */

= Boot2Gecko Accessibility, AKA B2AW (Boot 2 Accessible Web) =

This is a collection of ideas and requirements for the [[B2G]] project from the accessibility standpoint.

== Output via Speech ==

Speech output can be done through either the Android accessibility/TTS framework or

huh, why would we use the android stuff??? its just some java goo around espeak svox pico and whatever other tts's they support now. Since we'll only care about the freely redistributable ones anyway, it seems to make a lot more sense to just directly use the respective libraries api and expose some reasonable abstraction to js through ctypes / xpcom

through writing an engine ourselves in JavaScript. The latter has the advantage that we have it under our control what we include and don't have to rely on possibly closed-sourced parts of the Android infrastructure. The things to consider are:

* Multilingual support. We don't want something that speaks only English.
* Speech quality: We don't want something that sounds like it was built on a Votrax chip in the early 1980s.

== Speech recognition ==

A solution that, like Nuance does it, sends stuff to a server to be recognized, since the speech rec process requires processing power that is not really available on mobile devices today. Speech recognition consumes considerably more CPU power than TTS.

== Navigation ==

First, have Legal check whether we can sort of copy Apple's gesture-based interaction model or if they have patented it. It is a sophisticated gesturing model that allows blind users to do virtually everything without requiring a physical keyboard:

* Touch something: Speak what's under the finger.
* Double tap the last touched item: Activate it if possible (e. g. activate a link, set focus to an input etc.)
* Swipe left and right: Move from item to item. Not just tabbable ones, but everything, so the page can be explored element by element.
* Two finger dial gesture: Set the rotor (see next gesture) to a certain element. Elements can be links, headers, landmarks, form elements, lists, graphics, tables, and others we think are useful. Turn the dialer counterclock wise and the selection moves in the opposite direction.
* Swipe up and down: Move to the previous resp. next element of a given type.
* Two finger swipe up: Read from beginning of page to currently touched element.
* Two finger Swipe down: Read from current location to end of page continuously.
* Three finger swipe down/up: Move to next/previous visible part of page (like what fits on the touchscreen)
* Tap with three fingers: Say which page, of how many, one is on. Gives the user an idea on how long the page actually is.

== Physical Keyboard input ==

This could be tailored to what NVDA is doing: In browse situations, allow to jump to headings, landmarks, links, form fields, graphics, and others. When inside an editable field, type into the field. Make it transparent to users whether they're browsing or filling out a form (the Orca/VoiceOver transparency model).

== Zoom ==

Provide Zoom features.

Accessibility/Planning/Android

2011-06-01T16:39:13Z

TREVOR:

Note there is a recent Google IO [http://www.youtube.com/watch?v=BPXqsPeCneA video] on Android Accessibility.

'''Questions'''

*What is the Google approach for Android browser accessibility? (Talkback vs ChromeVox) (Trev we know its all chromvox now don't we?)
*Are new API planned that would allow non focused elements to send AccessibleEvent or query information about arbitrary Views? (presumably the android fork david mentioned in passing would have these?)

'''Implementation ideas'''

*We can use two different approaches:
**Inject ChromeVox into firefox mobile, which directly uses Android framework TTS to do selfvoicing (Both, Chrome OS and Android native browser does this way)
**Inject FireVox
**Use our own accessibility layer and based on our accesible events fire AccesibilityEvent (so Talkback would speak)

'''Tasks'''

In order to evaluate both options, we need to figure out some stuff:
*Check if we can easily expose Java objects from the main application to our js engine (for TTS calls inside ChromeVox) This fits nicely with the TTS in java script using native apis project, but would be a dependancy of this.
*Check if the interation model of ChromeVox works ok with us (does it speak mostly when something is focused? if so, are we moving focus in the same way as WebKit does, allowing all elements to be focused?) Does it use DOM or other apis that we also provide?
*Explore if we can achieve similar results using our accesible code firing AccesibilityEvent
*Check accessibility of Firefox chrome widgets (dialogs, preferences, etc...) Are these native android widgets or are they ours? If they're ours then it sounds like we'll have to deal with coordinating the firevoxen in two processes (how would this work)?

Accessibility/Intern.Next

2011-05-31T17:58:07Z

TREVOR:

Projects for accessibility engineering interns:

#'''HTML Speech'''. Add text to speech capability for the Firefox platform. The implementation will use whatever text to speech engine is provided by the platform, for example VoiceOver on OSX.
#'''Mobile Accessibility'''. Improve eyes-free browsing on Android. Improve the FireVox Firefox add-on such that it is a favorable alternative to desktop screen readers. Collaborate with the mobile and accessibility teams.
#'''Browser Accessibility Verification Tooling'''. Design and implement DOM API such that browser accessibility capabilities can be tested at runtime. This ground breaking work would allow browser compatibility efforts like quirksmode.org to include accessibility.
#'''Caret Navigation'''. Dive into an under resourced area of the Firefox (gecko) platform code to design solutions to priority issues. The caret codeprovides an indication of the current selection position in the document to accessibility technologies. This is a critical piece ofreading, editing and selecting text on the web page, important to many web apps. Additionally, and importantly, the work will allow screen readers to provide an even better experience with Firefox.

Accessibility/Intern.Next

2011-05-31T17:08:20Z

TREVOR:

Projects for accessibility engineering interns:

#'''HTML Speech'''. Add text to speech capability for the Firefox platform. The implementation will use whatever text to speech engine is provided by the platform, for example VoiceOver on OSX.
#'''Mobile Accessibility'''. Improve eyes-free browsing on Android. Improve the FireVox Firefox add-on such that it is a favorable alternative to desktop screen readers. Collaborate with the mobile and accessibility teams.
#'''Browser Accessibility Verification Tooling'''. Design and implement DOM API such that browser accessibility capabilities can be tested at runtime. This ground breaking work would allow browser compatibility efforts like quirksmode.org to include accessibility.
#'''Caret Navigation'''. Dive into an under resourced area of the Firefox (gecko) platform code to design solutions to priority issues. The caret code is a critical piece of editing and selecting text on the web page, important to many web apps. Additionally, and importantly, the work will allow screen readers to provide an even better experience with Firefox.

Accessibility/NewArchitecture

2011-04-27T12:11:55Z

TREVOR: /* accessible objects */

=Summary=
The page describes proposed Gecko a11y architectural changes.

=Folders=

#build - accessibility service factory
#idl
##ia2 - IAccessible2 interfaces
##msaa - ISimpleDOM interfaces
##xpcom - XPCOM interfaces
#public - exported a11y headers
#src
##base - common files
##generic - generic accessible classes
##html - HTML accessible classes
##xul - XUL accessible classes
##xforms - XForms accessible classes
##atk - ATK implementation (Linux)
##windows - MSAA/IAccessible2/SimpleDOM interfaces implementation (Windows)
##mac - NSAccessibility protocol implementation (OS X)
##others - other platforms
##xpcom - XPCOM interfaces implementation
#tests
##crashtests
##mochitest

='public' folder=
# No excess dependences. All inline methods that requires extra includes are prototyped here and defined in implementation classes.
# Defined inside mozilla::a11y namespace

==accessible objects==
<pre>
/**
* The existing base/nsAccessNode.
*/
class DOMNodeAccessible;
</pre>

<pre>
/**
* The existing base/nsAccessible.
*/
class Accessible : public DOMNodeAccessible {};
</pre>

<pre>
/**
* Existing html/nsHyperTextAccessible.
*/
class HyperTextAccessible : public Accessible {};
</pre>

<pre>
/**
* Existing base/nsDocAccessible.
*/
class DocAccessible : public HyperTextAccessible {};
</pre>

<pre>
/**
* Existing base/nsRootAccessible.
*/
class RootAccessible : public DocAccessible {};
</pre>

<pre>
/**
* Existing base/nsApplicationAccessible.
*/
class AppAccessible : public Accessible {};
</pre>

<pre>
/**
* New interface classes based on nsIAccessibleTable and nsIAccessibleTableCell.
*/
class TableAccessible : public Accessible {
int32 GetIndx(row, col);
void GetPositionFromIndex(index, row, col);
tableCellAccessible* GetTableCellAt(row, col);
void GetExtents(row, col, rowExtent, colExtent);
int getRows()
int getCols()
Accessible* Caption()
// these might be faster if on table cell not the table not sure though
Accessible* array getRowHeadercells(int row)
Accessible* array getColHeadercells(int col )
string Summary()
bool forLayout()
// who uses these?
selectRow(int row)
selectCol(int col)
unselectRow(int row)
unselectCol(int col)
// seems somewhat reduntant with geting header cells, but maybe we need it
string rowDescription(int row)
string colDescription(int col)
// are these useful?
bool isRowSelected(row)
bool isColSelected(col);
GetSelectedCells(array<accessible>& cells);
void GetSelectedRows(array<int>& rows);
void GetSelectedCols(array<int32>& cols);
};
class TableCellAccessible : public HyperTextAccessible {
int GetIndex();
void Getposition(row, col);
void GetExtents(rowExtent, colExtent);
bool isSelected();
TableAccessible* getTable()
};
</pre>

==accessibility service==
<pre>
/**
* Existing nsDocAccManager and nsAccessibilityService
*/
class DocAccessibleMgr {};
class AccService : public DocAccessibleMgr {};
</pre>

=src/generic folder=

[approach shouldn't work because of multiple inheritance from non abstract classes]

is this supposed to be where the implementation of accessible objects goes?

class GenericAccessible : public Accessible; (nsAccessible)

class ApplicationAccessible : public Accessible; (nsApplicationAccessible)

class ARIAGridAccessible (nsARIAGridAccessible)

class DocAccessible : public GenericAccessible, DocAccessible; (nsDocAccessible)

class HyperTextAccessible

=src platforms folders=

Every platform defines AccServiceWrap used for initialization (currently done by nsAccessNodeWrap classes).
<pre>
class AccServiceWrap : public AccService {};
</pre>

==atk==

==windows==

A generic class that used as a bridge to gecko accessible.
<pre>
class NativeObject
{
public:
NativeObject(DOMNodeAccessible* aGeckoAcc) : mGeckoAcc(aGeckoAcc) { }

protected:
DOMNodeAccessible* mGeckoAcc;
};
</pre>

Classes that implement IAccessible2 interfaces.
<pre>
class ia2Accessible : virtual public NativeObject,
public IAccessible
{
public:
// IAccessible
};

hresult
ia2Accessible::IAccessible2Method()
{
Accessible* geckoAcc = mGeckoAcc->AsAccessible();
geckoAcc->AccessibleMethod();
return S_OK;
}

class ia2TableAccessible : virtual public NativeObject,
public IAccessibleTable
{
public:
// IAccessibleTable
// IAccessibleTable2
};

hresult
ia2TableAccessible::IATableMethod()
{
TableAccessible* geckoAcc = mGeckoObj->AsTable();
geckoAcc->TableMethod();
return S_OK;
}
</pre>

Final classes that implements native interfaces for specific Gecko accessible classes.
<pre>
class NativeDOMNodeAccessible : virtual public NativeObject,
public ISimpleDOMNode
public IServiceProvider
{
public:
// IUknown
// IServiceProvider
// ISimpleDOMNode
};

class NativeAccessible : public NativeDOMNodeAccessible,
public IAccessible,
public IEnumVARIANT,
public ia2Accessible
{
// IDispatch
// IAccessible
// IEnumVariant
};

class NativeTableAccessible : public NativeAccessible,
public ia2TableAccessible
{
};

class NativeDocAccessible : public NativeAccessible,
public ISimpleDOMDocument
{
// ISimpleDOMDocument
};
</pre>

Wrappers for Gecko classes that are used to create proper native class.
<pre>
class AccessibleWrap: public Accessible
{
public:
inline NativeObject* AsNativeObject()
{
if (!mNativeObj || !IsDefunct())
mNativeObj = CreateNativeAccessible();
return mNativeObj;
}

protected:
virtual NativeObject* CreateNativeAccessible()
{
return new NativeAccessible(this);
}
};

class HTMLTableAccessibleWrap : public HTMLTableAccessible
{
public:
virtual NativeObject* CreateNativeAccessible()
{
return new NativeTableAccessible(this);
}
};

class DocAccessibleWrap : public DocAccessible
{
public:
virtual NativeObject* CreateNativeAccessible()
{
return new NativeDocAccessible(this);
}
};

</pre>

==mac==
NSAccessibility protocol implementation.

=='xpcom' folder==

Classes are prefixed by 'xp'. Each xp class holds weak pointer to internal accessible object. All xp objects are contained in hash, when xp object is requested for internal object then hash is checked and new one is created if it doesn't have existing object. The xp objects creation is based on checking the supported interface (see Accessible downcasting methods).

===accessible objects===

<pre>
template<class T>
class xpTAccessible : public nsIAccessible,
public nsIHyperLinkAccessible,
public nsISelectableAccessible
{
private:
T* mInternalObj;
};

typedef xpTAccessible<Accessible> xpAccessible;
</pre>

<pre>
template<class T>
class xpTHyperTextAccessible : public xpTAccessible<T>,
public nsIAccessibleText,
public nsIAccessibleEdtiableText,
public nsIAccessibleHypertext
{};

typedef xpTHyperTextAccessible<HyperTextAccessible> xpHyperTextAccessible;
</pre>

<pre>
class xpImageAccessible : public xpTAccessible<ImageAccessible>,
public nsIAccessibleImage
</pre>

<pre>
class xpTableAccessible : public xpTAccessible<TableAccessible>,
public nsIAccessibleTable
{};
class xpTableCellAccessible : public xpTHyperTextAccessible<TableCellAccessible>,
public nsIAccessibleTableCell
{};
</pre>

<pre>
class xpDocumentAccessible : public xpTHyperTextAccessible<DocAccessible>,
public nsIAccessibleDocument
{};
</pre>

<pre>
class xpApplicationAccessible : public xpTAccessible<AppAccessible>,
public nsIApplicationAccessible
{};
</pre>

===accessible relations===

<pre>
class xpRelation : public nsIAccessibleRelation
{};
</pre>

===accessibility service===
<pre>
class xpAccService : public AccServiceWrap,
public nsIAccessibleProvider
{};
</pre>

Accessibility/NewArchitecture

2011-04-21T14:27:23Z

TREVOR:

=Summary=
The page describes proposed Gecko a11y architectural changes.

=Folders=

#build - accessibility service factory
#idl
##ia2 - IAccessible2 interfaces
##msaa - ISimpleDOM interfaces
##xpcom - XPCOM interfaces
#public - exported a11y headers
#src
##base - common files
##generic - generic accessible classes
##html - HTML accessible classes
##xul - XUL accessible classes
##xforms - XForms accessible classes
##atk - ATK implementation (Linux)
##windows - MSAA/IAccessible2/SimpleDOM interfaces implementation (Windows)
##mac - NSAccessibility protocol implementation (OS X)
##others - other platforms
##xpcom - XPCOM interfaces implementation
#tests
##crashtests
##mochitest

='public' folder=
# No excess dependences. All inline methods that requires extra includes are prototyped here and defined in implementation classes.
# Defined inside mozilla::a11y namespace

==accessible objects==
<pre>
/**
* The existing base/nsAccessNode.
*/
class DOMNodeAccessible;
</pre>

<pre>
/**
* The existing base/nsAccessible.
*/
class Accessible : public DOMNodeAccessible {};
</pre>

<pre>
/**
* Existing html/nsHyperTextAccessible.
*/
class HyperTextAccessible : public Accessible {};
</pre>

<pre>
/**
* Existing base/nsDocAccessible.
*/
class DocAccessible : public HyperTextAccessible {};
</pre>

<pre>
/**
* Existing base/nsRootAccessible.
*/
class RootAccessible : public DocAccessible {};
</pre>

<pre>
/**
* Existing base/nsApplicationAccessible.
*/
class AppAccessible : public Accessible {};
</pre>

<pre>
/**
* New interface classes based on nsIAccessibleTable and nsIAccessibleTableCell.
*/
class TableAccessible : public Accessible {
int32 GetIndx(row, col);
void GetPositionFromIndex(index, row, col);
tableCellAccessible* GetTableCellAt(row, col);
void GetExtents(row, col, rowExtent, colExtent);
// are these useful?
bool isRowSelected(row)
bool isColSelected(col);
GetSelectedCells(array<accessible>& cells);
void GetSelectedRows(array<int>& rows);
void GetSelectedCols(array<int32>& cols);
};
class TableCellAccessible : public HyperTextAccessible {
int GetIndex();
void Getposition(row, col);
void GetExtents(rowExtent, colExtent);
bool isSelected();
};
</pre>

==accessibility service==
<pre>
/**
* Existing nsDocAccManager and nsAccessibilityService
*/
class DocAccessibleMgr {};
class AccService : public DocAccessibleMgr {};
</pre>

=src/generic folder=

[approach shouldn't work because of multiple inheritance from non abstract classes]

is this supposed to be where the implementation of accessible objects goes?

class GenericAccessible : public Accessible; (nsAccessible)

class ApplicationAccessible : public Accessible; (nsApplicationAccessible)

class ARIAGridAccessible (nsARIAGridAccessible)

class DocAccessible : public GenericAccessible, DocAccessible; (nsDocAccessible)

class HyperTextAccessible

=src platforms folders=

Every platform defines AccServiceWrap used for initialization (currently done by nsAccessNodeWrap classes).
<pre>
class AccServiceWrap : public AccService {};
</pre>

==atk==

==windows==

A generic class that used as a bridge to gecko accessible.
<pre>
class NativeObject
{
public:
NativeObject(DOMNodeAccessible* aGeckoAcc) : mGeckoAcc(aGeckoAcc) { }

protected:
DOMNodeAccessible* mGeckoAcc;
};
</pre>

Classes that implement IAccessible2 interfaces.
<pre>
class ia2Accessible : virtual public NativeObject,
public IAccessible
{
public:
// IAccessible
};

hresult
ia2Accessible::IAccessible2Method()
{
Accessible* geckoAcc = mGeckoAcc->AsAccessible();
geckoAcc->AccessibleMethod();
return S_OK;
}

class ia2TableAccessible : virtual public NativeObject,
public IAccessibleTable
{
public:
// IAccessibleTable
// IAccessibleTable2
};

hresult
ia2TableAccessible::IATableMethod()
{
TableAccessible* geckoAcc = mGeckoObj->AsTable();
geckoAcc->TableMethod();
return S_OK;
}
</pre>

Final classes that implements native interfaces for specific Gecko accessible classes.
<pre>
class NativeDOMNodeAccessible : virtual public NativeObject,
public ISimpleDOMNode
public IServiceProvider
{
public:
// IUknown
// IServiceProvider
// ISimpleDOMNode
};

class NativeAccessible : public NativeDOMNodeAccessible,
public IAccessible,
public IEnumVARIANT,
public ia2Accessible
{
// IDispatch
// IAccessible
// IEnumVariant
};

class NativeTableAccessible : public NativeAccessible,
public ia2TableAccessible
{
};

class NativeDocAccessible : public NativeAccessible,
public ISimpleDOMDocument
{
// ISimpleDOMDocument
};
</pre>

Wrappers for Gecko classes that are used to create proper native class.
<pre>
class AccessibleWrap: public Accessible
{
public:
inline NativeObject* AsNativeObject()
{
if (!mNativeObj || !IsDefunct())
mNativeObj = CreateNativeAccessible();
return mNativeObj;
}

protected:
virtual NativeObject* CreateNativeAccessible()
{
return new NativeAccessible(this);
}
};

class HTMLTableAccessibleWrap : public HTMLTableAccessible
{
public:
virtual NativeObject* CreateNativeAccessible()
{
return new NativeTableAccessible(this);
}
};

class DocAccessibleWrap : public DocAccessible
{
public:
virtual NativeObject* CreateNativeAccessible()
{
return new NativeDocAccessible(this);
}
};

</pre>

==mac==
NSAccessibility protocol implementation.

=='xpcom' folder==

Classes are prefixed by 'xp'. Each xp class holds weak pointer to internal accessible object. All xp objects are contained in hash, when xp object is requested for internal object then hash is checked and new one is created if it doesn't have existing object. The xp objects creation is based on checking the supported interface (see Accessible downcasting methods).

===accessible objects===

<pre>
template<class T>
class xpTAccessible : public nsIAccessible,
public nsIHyperLinkAccessible,
public nsISelectableAccessible
{
private:
T* mInternalObj;
};

typedef xpTAccessible<Accessible> xpAccessible;
</pre>

<pre>
template<class T>
class xpTHyperTextAccessible : public xpTAccessible<T>,
public nsIAccessibleText,
public nsIAccessibleEdtiableText,
public nsIAccessibleHypertext
{};

typedef xpTHyperTextAccessible<HyperTextAccessible> xpHyperTextAccessible;
</pre>

<pre>
class xpImageAccessible : public xpTAccessible<ImageAccessible>,
public nsIAccessibleImage
</pre>

<pre>
class xpTableAccessible : public xpTAccessible<TableAccessible>,
public nsIAccessibleTable
{};
class xpTableCellAccessible : public xpTHyperTextAccessible<TableCellAccessible>,
public nsIAccessibleTableCell
{};
</pre>

<pre>
class xpDocumentAccessible : public xpTHyperTextAccessible<DocAccessible>,
public nsIAccessibleDocument
{};
</pre>

<pre>
class xpApplicationAccessible : public xpTAccessible<AppAccessible>,
public nsIApplicationAccessible
{};
</pre>

===accessible relations===

<pre>
class xpRelation : public nsIAccessibleRelation
{};
</pre>

===accessibility service===
<pre>
class xpAccService : public AccServiceWrap,
public nsIAccessibleProvider
{};
</pre>

Accessibility/NewArchitecture

2011-04-21T14:07:50Z

TREVOR:

=Summary=
The page describes proposed Gecko a11y architectural changes.

=Folders=

#build - accessibility service factory
#idl
##ia2 - IAccessible2 interfaces
##msaa - ISimpleDOM interfaces
##xpcom - XPCOM interfaces
#public - exported a11y headers
#src
##base - common files
##generic - generic accessible classes
##html - HTML accessible classes
##xul - XUL accessible classes
##xforms - XForms accessible classes
##atk - ATK implementation (Linux)
##windows - MSAA/IAccessible2/SimpleDOM interfaces implementation (Windows)
##mac - NSAccessibility protocol implementation (OS X)
##others - other platforms
##xpcom - XPCOM interfaces implementation
#tests
##crashtests
##mochitest

='public' folder=
# No excess dependences. All inline methods that requires extra includes are prototyped here and defined in implementation classes.
# Defined inside mozilla::a11y namespace

==accessible objects==
<pre>
/**
* The existing base/nsAccessNode.
*/
class DOMNodeAccessible;
</pre>

<pre>
/**
* The existing base/nsAccessible.
*/
class Accessible : public DOMNodeAccessible {};
</pre>

<pre>
/**
* Existing html/nsHyperTextAccessible.
*/
class HyperTextAccessible : public Accessible {};
</pre>

<pre>
/**
* Existing base/nsDocAccessible.
*/
class DocAccessible : public HyperTextAccessible {};
</pre>

<pre>
/**
* Existing base/nsRootAccessible.
*/
class RootAccessible : public DocAccessible {};
</pre>

<pre>
/**
* Existing base/nsApplicationAccessible.
*/
class AppAccessible : public Accessible {};
</pre>

<pre>
/**
* New interface classes based on nsIAccessibleTable and nsIAccessibleTableCell.
*/
class TableAccessible : public Accessible {
};
class TableCellAccessible : public HyperTextAccessible {};
</pre>

==accessibility service==
<pre>
/**
* Existing nsDocAccManager and nsAccessibilityService
*/
class DocAccessibleMgr {};
class AccService : public DocAccessibleMgr {};
</pre>

=src/generic folder=

[approach shouldn't work because of multiple inheritance from non abstract classes]
class GenericAccessible : public Accessible; (nsAccessible)

class ApplicationAccessible : public Accessible; (nsApplicationAccessible)

class ARIAGridAccessible (nsARIAGridAccessible)

class DocAccessible : public GenericAccessible, DocAccessible; (nsDocAccessible)

class HyperTextAccessible

=src platforms folders=

Every platform defines AccServiceWrap used for initialization (currently done by nsAccessNodeWrap classes).
<pre>
class AccServiceWrap : public AccService {};
</pre>

==atk==

==windows==

A generic class that used as a bridge to gecko accessible.
<pre>
class NativeObject
{
public:
NativeObject(DOMNodeAccessible* aGeckoAcc) : mGeckoAcc(aGeckoAcc) { }

protected:
DOMNodeAccessible* mGeckoAcc;
};
</pre>

Classes that implement IAccessible2 interfaces.
<pre>
class ia2Accessible : virtual public NativeObject,
public IAccessible
{
public:
// IAccessible
};

hresult
ia2Accessible::IAccessible2Method()
{
Accessible* geckoAcc = mGeckoAcc->AsAccessible();
geckoAcc->AccessibleMethod();
return S_OK;
}

class ia2TableAccessible : virtual public NativeObject,
public IAccessibleTable
{
public:
// IAccessibleTable
// IAccessibleTable2
};

hresult
ia2TableAccessible::IATableMethod()
{
TableAccessible* geckoAcc = mGeckoObj->AsTable();
geckoAcc->TableMethod();
return S_OK;
}
</pre>

Final classes that implements native interfaces for specific Gecko accessible classes.
<pre>
class NativeDOMNodeAccessible : virtual public NativeObject,
public ISimpleDOMNode
public IServiceProvider
{
public:
// IUknown
// IServiceProvider
// ISimpleDOMNode
};

class NativeAccessible : public NativeDOMNodeAccessible,
public IAccessible,
public IEnumVARIANT,
public ia2Accessible
{
// IDispatch
// IAccessible
// IEnumVariant
};

class NativeTableAccessible : public NativeAccessible,
public ia2TableAccessible
{
};

class NativeDocAccessible : public NativeAccessible,
public ISimpleDOMDocument
{
// ISimpleDOMDocument
};
</pre>

Wrappers for Gecko classes that are used to create proper native class.
<pre>
class AccessibleWrap: public Accessible
{
public:
inline NativeObject* AsNativeObject()
{
if (!mNativeObj || !IsDefunct())
mNativeObj = CreateNativeAccessible();
return mNativeObj;
}

protected:
virtual NativeObject* CreateNativeAccessible()
{
return new NativeAccessible(this);
}
};

class HTMLTableAccessibleWrap : public HTMLTableAccessible
{
public:
virtual NativeObject* CreateNativeAccessible()
{
return new NativeTableAccessible(this);
}
};

class DocAccessibleWrap : public DocAccessible
{
public:
virtual NativeObject* CreateNativeAccessible()
{
return new NativeDocAccessible(this);
}
};

</pre>

==mac==
NSAccessibility protocol implementation.

=='xpcom' folder==

Classes are prefixed by 'xp'. Each xp class holds weak pointer to internal accessible object. All xp objects are contained in hash, when xp object is requested for internal object then hash is checked and new one is created if it doesn't have existing object. The xp objects creation is based on checking the supported interface (see Accessible downcasting methods).

===accessible objects===

<pre>
template<class T>
class xpTAccessible : public nsIAccessible,
public nsIHyperLinkAccessible,
public nsISelectableAccessible
{
private:
T* mInternalObj;
};

typedef xpTAccessible<Accessible> xpAccessible;
</pre>

<pre>
template<class T>
class xpTHyperTextAccessible : public xpTAccessible<T>,
public nsIAccessibleText,
public nsIAccessibleEdtiableText,
public nsIAccessibleHypertext
{};

typedef xpTHyperTextAccessible<HyperTextAccessible> xpHyperTextAccessible;
</pre>

<pre>
class xpImageAccessible : public xpTAccessible<ImageAccessible>,
public nsIAccessibleImage
</pre>

<pre>
class xpTableAccessible : public xpTAccessible<TableAccessible>,
public nsIAccessibleTable
{};
class xpTableCellAccessible : public xpTHyperTextAccessible<TableCellAccessible>,
public nsIAccessibleTableCell
{};
</pre>

<pre>
class xpDocumentAccessible : public xpTHyperTextAccessible<DocAccessible>,
public nsIAccessibleDocument
{};
</pre>

<pre>
class xpApplicationAccessible : public xpTAccessible<AppAccessible>,
public nsIApplicationAccessible
{};
</pre>

===accessible relations===

<pre>
class xpRelation : public nsIAccessibleRelation
{};
</pre>

===accessibility service===
<pre>
class xpAccService : public AccServiceWrap,
public nsIAccessibleProvider
{};
</pre>