HTML5 Speech API - Revision history

Rohandalvi: /* Second Half */

2012-04-04T08:12:34Z

Second Half

← Older revision		Revision as of 08:12, 4 April 2012
Line 63:		Line 63:
	(Aug 16th - Aug 22nd) - Bug fixing and miscellaneous tasks. Committing code to mozilla repos and google code.<br>		(Aug 16th - Aug 22nd) - Bug fixing and miscellaneous tasks. Committing code to mozilla repos and google code.<br>
	(Aug 23rd) - Firm pencil down date.<br>		(Aug 23rd) - Firm pencil down date.<br>
	~~(28th November - 4th December) - SpeechRequest + endpointer etc code compiled.~~
	~~(5th December - 11th December) - Fixes to microphone handling on linux, some other small fixes, getting familiar with the code.~~
	~~(12th December - 18th December) - continue fix small fixes (for example simplify thread handling).~~
	~~(19th December - 25th December) - Christmas etc, not much progress, but continue with fixing SpeechRequest API, adding possibly some new features.~~
	~~(26th December - 1st January) - Holiday season, not much progress, but continue with SpeechRequest implementation.~~
	~~(2nd January - 8th January) - Get TTS working (at least on linux).~~
	~~(9th January - 15th January) - Enhancements to the TTS API implementation.~~
	~~(16th January - 22nd January) - First speech commands: for example "browser go back", "go forward", etc.~~
	~~(23rd January - 29th January) - More speech commands: maybe "read this page".~~

	== Additional Resources ==		== Additional Resources ==

Rohandalvi: /* Second Half */

2012-04-04T08:09:22Z

Second Half

← Older revision		Revision as of 08:09, 4 April 2012
Line 63:		Line 63:
	(Aug 16th - Aug 22nd) - Bug fixing and miscellaneous tasks. Committing code to mozilla repos and google code.<br>		(Aug 16th - Aug 22nd) - Bug fixing and miscellaneous tasks. Committing code to mozilla repos and google code.<br>
	(Aug 23rd) - Firm pencil down date.<br>		(Aug 23rd) - Firm pencil down date.<br>
			(28th November - 4th December) - SpeechRequest + endpointer etc code compiled.
			(5th December - 11th December) - Fixes to microphone handling on linux, some other small fixes, getting familiar with the code.
			(12th December - 18th December) - continue fix small fixes (for example simplify thread handling).
			(19th December - 25th December) - Christmas etc, not much progress, but continue with fixing SpeechRequest API, adding possibly some new features.
			(26th December - 1st January) - Holiday season, not much progress, but continue with SpeechRequest implementation.
			(2nd January - 8th January) - Get TTS working (at least on linux).
			(9th January - 15th January) - Enhancements to the TTS API implementation.
			(16th January - 22nd January) - First speech commands: for example "browser go back", "go forward", etc.
			(23rd January - 29th January) - More speech commands: maybe "read this page".

	== Additional Resources ==		== Additional Resources ==

Roshanvid: /* Updates */

2011-08-10T06:33:26Z

Updates

← Older revision		Revision as of 06:33, 10 August 2011
Line 74:		Line 74:
	*[[GSoC Update 3 - HTML5 Speech API\|Update 3]]		*[[GSoC Update 3 - HTML5 Speech API\|Update 3]]
	*[[GSoC Update 4 - HTML5 Speech API\|Update 4]]		*[[GSoC Update 4 - HTML5 Speech API\|Update 4]]
			*[[GSoC Update 5 - HTML5 Speech API\|Update 5]]

Roshanvid: /* Updates */

2011-07-27T13:35:20Z

Updates

← Older revision		Revision as of 13:35, 27 July 2011
Line 73:		Line 73:
	*[[GSoC Update 2 - HTML5 Speech API\|Update 2]]		*[[GSoC Update 2 - HTML5 Speech API\|Update 2]]
	*[[GSoC Update 3 - HTML5 Speech API\|Update 3]]		*[[GSoC Update 3 - HTML5 Speech API\|Update 3]]
			*[[GSoC Update 4 - HTML5 Speech API\|Update 4]]

Roshanvid: /* Updates */

2011-07-06T09:56:32Z

Updates

← Older revision		Revision as of 09:56, 6 July 2011
Line 72:		Line 72:
	*[[GSoC Update 1 - HTML5 Speech API\|Update 1]]		*[[GSoC Update 1 - HTML5 Speech API\|Update 1]]
	*[[GSoC Update 2 - HTML5 Speech API\|Update 2]]		*[[GSoC Update 2 - HTML5 Speech API\|Update 2]]
			*[[GSoC Update 3 - HTML5 Speech API\|Update 3]]

Roshanvid: /* Updates */

2011-06-15T14:52:41Z

Updates

← Older revision		Revision as of 14:52, 15 June 2011
Line 71:		Line 71:
	== Updates ==		== Updates ==
	*[[GSoC Update 1 - HTML5 Speech API\|Update 1]]		*[[GSoC Update 1 - HTML5 Speech API\|Update 1]]
			*[[GSoC Update 2 - HTML5 Speech API\|Update 2]]

Roshanvid at 14:13, 31 May 2011

2011-05-31T14:13:21Z

← Older revision		Revision as of 14:13, 31 May 2011
Line 9:		Line 9:

	The group's mailing lists can be found here: [http://lists.w3.org/Archives/Public/public-xg-htmlspeech/]		The group's mailing lists can be found here: [http://lists.w3.org/Archives/Public/public-xg-htmlspeech/]
			<br>

	== 1.Speech Input API ==		== 1.Speech Input API ==
Line 32:		Line 33:
	*The developer should be able to choose what speech engine to use.		*The developer should be able to choose what speech engine to use.
	*The developer should be able to start, stop, handle errors and multiple requests as required.		*The developer should be able to start, stop, handle errors and multiple requests as required.
			<br>
	== 2.Text To Speech API ==		== 2.Text To Speech API ==

	The text to speech API will be based on google's proposal(http://lists.w3.org/Archives/Public/public-xg-htmlspeech/2011Feb/att-0022/htmltts-draft.html).This API can be used for speech translation, turn by turn navigation, dialog systems etc.		The text to speech API will be based on google's proposal([http://lists.w3.org/Archives/Public/public-xg-htmlspeech/2011Feb/att-0022/htmltts-draft.html]).This API can be used for speech translation, turn by turn navigation, dialog systems etc.

	==== API Design - ====		==== API Design - ====
Line 44:		Line 45:
	*The API should itself be independent of the underlying speech synthesizer. If speech synthesis is not supported, appropriate text should be displayed. <br>		*The API should itself be independent of the underlying speech synthesizer. If speech synthesis is not supported, appropriate text should be displayed. <br>
	*What speech engines is yet to be decided.		*What speech engines is yet to be decided.
			<br>
			== Tentative Schedule ==

			=== First Half ===
			(May 24th - June 7th) - Implementing the media capture API <br>
			(June 8th - June 14th) - Implementing the SpeechRequest API using google's speech reco server along with unit tests for the same. <br>
			(June 15th - June 30th) - Low activity due to exams. <br>
			(July 1st - July 8th) - Finish whatever coding is left of Speech Request <br>
			(July 8th - July 13th) - Tying up loose ends, documentation, code review. By the end of this period, i would like to have the Speech Input API working perfectly. <br>
			(July 13th - July 16th) - Mid-term evaluations <br>
			If time permits, I'll look at native speech engines and how they can be implemented.

			=== Second Half ===
			(July 17th - July 24th) - Research and decide on possible speech synthesis engines<br>
			(July 25th - Aug 8th) - Work on the API implementation and unit tests. <br>
			(Aug 8th - Aug 15th) - Tying up loose ends, documentation, code review. <br>
			(Aug 16th - Aug 22nd) - Bug fixing and miscellaneous tasks. Committing code to mozilla repos and google code.<br>
			(Aug 23rd) - Firm pencil down date.<br>


	== Additional Resources ==		== Additional Resources ==

Roshanvid: /* What and Why? */

2011-05-29T15:01:47Z

What and Why?

← Older revision		Revision as of 15:01, 29 May 2011
Line 5:		Line 5:
	*Speech Input API		*Speech Input API
	*Text to Speech API		*Text to Speech API

			The incubator group is still discussing the APIs and their features. The latest draft can be found here : [http://www.w3.org/2005/Incubator/htmlspeech/live/NOTE-htmlspeech.html]

			The group's mailing lists can be found here: [http://lists.w3.org/Archives/Public/public-xg-htmlspeech/]

	== 1.Speech Input API ==		== 1.Speech Input API ==

Roshanvid: /* Updates */

2011-05-17T11:21:03Z

Updates

← Older revision		Revision as of 11:21, 17 May 2011
Line 46:		Line 46:

	== Updates ==		== Updates ==
	*[[GSoC Update 1]]		*[[GSoC Update 1 - HTML5 Speech API\|Update 1]]

Roshanvid at 10:49, 17 May 2011

2011-05-17T10:49:32Z

← Older revision		Revision as of 10:49, 17 May 2011
Line 3:		Line 3:
	The HTML Speech Incubator group has proposed the implementation of speech technology in browsers in the form of uniform, cross-platform APIs that can be used to build rich web applications. The API itself contains 2 components -		The HTML Speech Incubator group has proposed the implementation of speech technology in browsers in the form of uniform, cross-platform APIs that can be used to build rich web applications. The API itself contains 2 components -

	*Speech Input API		*Speech Input API
	*Text to Speech API		*Text to Speech API

Line 12:		Line 12:
	The API consists of 2 main components -		The API consists of 2 main components -

	*A Media Capture API to capture a stream of raw audio. Its implementation is platform dependent. Mac, Windows and Linux are to be supported first, eventually adding support for android.		*A Media Capture API to capture a stream of raw audio. Its implementation is platform dependent. Mac, Windows and Linux are to be supported first, eventually adding support for android.
	*A streaming API to asynchronously stream microphone data to a speech recognition server and to get the results back. This will be similar to how XMLHttpRequest is implemented. The api should be able to support both local and remote engines or a combination of both depending on the network connection available.		*A streaming API to asynchronously stream microphone data to a speech recognition server and to get the results back. This will be similar to how XMLHttpRequest is implemented. The api should be able to support both local and remote engines or a combination of both depending on the network connection available.

	==== Security/Privacy issues ====		==== Security/Privacy issues ====

	*A speech input session should be allowed only with the user's consent. This could be provided using a doorhanger notification.		*A speech input session should be allowed only with the user's consent. This could be provided using a doorhanger notification.
	*The user should be notified when audio is being recorded possibly using a record symbol somewhere in the web browser UI itself like the URL bar or status bar.		*The user should be notified when audio is being recorded possibly using a record symbol somewhere in the web browser UI itself like the URL bar or status bar.

	==== API Design - ====		==== API Design - ====

	The API will look like the interface described in the SpeechRequest proposal.		The API will look like the interface described in the SpeechRequest proposal.
Line 29:		Line 29:
	*The developer should be able to start, stop, handle errors and multiple requests as required.		*The developer should be able to start, stop, handle errors and multiple requests as required.

	== 2.Text To Speech API ==		== 2.Text To Speech API ==

	The text to speech API will be based on google's proposal(http://lists.w3.org/Archives/Public/public-xg-htmlspeech/2011Feb/att-0022/htmltts-draft.html).This API can be used for speech translation, turn by turn navigation, dialog systems etc.		The text to speech API will be based on google's proposal(http://lists.w3.org/Archives/Public/public-xg-htmlspeech/2011Feb/att-0022/htmltts-draft.html).This API can be used for speech translation, turn by turn navigation, dialog systems etc.
Line 35:		Line 35:
	==== API Design - ====		==== API Design - ====

	*The API will introduce a new element <tts> that extends HTMLMediaElement. It will be similar to how the <audio> and and <video> tags are implemented.<br>		*The API will introduce a new element <tts> that extends HTMLMediaElement. It will be similar to how the <audio> and and <video> tags are implemented.<br>
	*A playback UI should allow the user to start, stop and disable text to speech. The current spoken word can be highlighted.<br>		*A playback UI should allow the user to start, stop and disable text to speech. The current spoken word can be highlighted.<br>
	*The developer should be able to specify the language, position, start/stop playback and handle errors programmatically. <br>		*The developer should be able to specify the language, position, start/stop playback and handle errors programmatically. <br>
	*The API should itself be independent of the underlying speech synthesizer. If speech synthesis is not supported, appropriate text should be displayed. <br>		*The API should itself be independent of the underlying speech synthesizer. If speech synthesis is not supported, appropriate text should be displayed. <br>
	*What speech engines is yet to be decided.		*What speech engines is yet to be decided.

	==Additional Resources==		== Additional Resources ==

			=== Demos and Examples ===

	==~~=Demos and Examples=~~==		== Updates ==
			*[[GSoC Update 1]]

← Older revision		Revision as of 06:33, 10 August 2011
Line 74:		Line 74:
	*[[GSoC Update 3 - HTML5 Speech API\|Update 3]]		*[[GSoC Update 3 - HTML5 Speech API\|Update 3]]
	*[[GSoC Update 4 - HTML5 Speech API\|Update 4]]		*[[GSoC Update 4 - HTML5 Speech API\|Update 4]]
			*[[GSoC Update 5 - HTML5 Speech API\|Update 5]]

← Older revision		Revision as of 13:35, 27 July 2011
Line 73:		Line 73:
	*[[GSoC Update 2 - HTML5 Speech API\|Update 2]]		*[[GSoC Update 2 - HTML5 Speech API\|Update 2]]
	*[[GSoC Update 3 - HTML5 Speech API\|Update 3]]		*[[GSoC Update 3 - HTML5 Speech API\|Update 3]]
			*[[GSoC Update 4 - HTML5 Speech API\|Update 4]]

← Older revision		Revision as of 09:56, 6 July 2011
Line 72:		Line 72:
	*[[GSoC Update 1 - HTML5 Speech API\|Update 1]]		*[[GSoC Update 1 - HTML5 Speech API\|Update 1]]
	*[[GSoC Update 2 - HTML5 Speech API\|Update 2]]		*[[GSoC Update 2 - HTML5 Speech API\|Update 2]]
			*[[GSoC Update 3 - HTML5 Speech API\|Update 3]]