canmove, Confirmed users, Bureaucrats and Sysops emeriti
2,305
edits
Websites/Domain List/robots-blocked: Difference between revisions
Websites/Domain List/robots-blocked (view source)
Revision as of 16:36, 27 October 2011
, 27 October 2011no edit summary
No edit summary |
No edit summary |
||
| Line 1: | Line 1: | ||
The following is a list of active websites that are blocked from ALL robot spidering: | The following is a list of active websites that are blocked from ALL robot spidering: | ||
* [http://addons.allizom.org addons.allizom.org] | |||
* [http://addons-dev.allizom.org addons-dev.allizom.org] | |||
* [http://bonsai.mozilla.org bonsai.mozilla.org] | * [http://bonsai.mozilla.org bonsai.mozilla.org] | ||
* [http://bonsai-www.mozilla.org bonsai-www.mozilla.org] | * [http://bonsai-www.mozilla.org bonsai-www.mozilla.org] | ||
* [http://builder-addons.allizom.org builder-addons.allizom.org] | |||
* [http://builder-addons-dev.allizom.org builder-addons-dev.allizom.org] | |||
* [http://builder.addons.mozilla.org builder.addons.mozilla.org] | * [http://builder.addons.mozilla.org builder.addons.mozilla.org] | ||
* [http://build-graphs.mozilla.org build-graphs.mozilla.org] | * [http://build-graphs.mozilla.org build-graphs.mozilla.org] | ||
* [http://build.mozillamessaging.com build.mozillamessaging.com] | * [http://build.mozillamessaging.com build.mozillamessaging.com] | ||
* [http://ci.mozilla.org ci.mozilla.org] | |||
* [http://crash-stats.allizom.org crash-stats.allizom.org] | |||
* [http://crash-stats.mozilla.com crash-stats.mozilla.com] | * [http://crash-stats.mozilla.com crash-stats.mozilla.com] | ||
* [http://developer-stage9.mozilla.org developer-stage9.mozilla.org] | |||
* [http://doctor.mozilla.org doctor.mozilla.org] | * [http://doctor.mozilla.org doctor.mozilla.org] | ||
* [http://forums.mozillazine.org forums.mozillazine.org] | * [http://forums.mozillazine.org forums.mozillazine.org] | ||
* [http://forums-test.mozillazine.org forums-test.mozillazine.org] | * [http://forums-test.mozillazine.org forums-test.mozillazine.org] | ||
* [http://hg.mozilla.org hg.mozilla.org] | * [http://hg.mozilla.org hg.mozilla.org] | ||
* [http://ispdb.mozillamessaging.com ispdb.mozillamessaging.com] | |||
* [http://litmus.mozilla.org litmus.mozilla.org] | * [http://litmus.mozilla.org litmus.mozilla.org] | ||
* [http://live.mozillamessaging.com live.mozillamessaging.com] | * [http://live.mozillamessaging.com live.mozillamessaging.com] | ||
| Line 20: | Line 28: | ||
* [http://personas.stage.mozilla.com personas.stage.mozilla.com] | * [http://personas.stage.mozilla.com personas.stage.mozilla.com] | ||
* [http://support.allizom.org support.allizom.org] | * [http://support.allizom.org support.allizom.org] | ||
* [http://support-dev.allizom.org support-dev.allizom.org] | |||
* [http://support.mozillamessaging.com support.mozillamessaging.com] | * [http://support.mozillamessaging.com support.mozillamessaging.com] | ||
* [http://support-release.allizom.org support-release.allizom.org] | * [http://support-release.allizom.org support-release.allizom.org] | ||
| Line 27: | Line 36: | ||
* [http://webifyme.org webifyme.org] | * [http://webifyme.org webifyme.org] | ||
* [http://webtools.mozilla.org webtools.mozilla.org] | * [http://webtools.mozilla.org webtools.mozilla.org] | ||
* [http://www-dev.allizom.org www-dev.allizom.org] | |||
* [http://www-stage.seamonkey-project.org www-stage.seamonkey-project.org] | |||
* [http://www-stage.seamonkeyproject.org www-stage.seamonkeyproject.org] | |||