stableversion-3.0
Last change
on this file since b9d4e2e was
6627152,
checked in by José Gregorio Puentes <jpuentes@…>, 8 años ago
|
se actualizo el cord
|
-
Propiedad mode establecida a
100755
|
File size:
1.5 KB
|
Ver. | Línea | |
---|
[b354002] | 1 | # |
---|
| 2 | # robots.txt |
---|
| 3 | # |
---|
| 4 | # This file is to prevent the crawling and indexing of certain parts |
---|
| 5 | # of your site by web crawlers and spiders run by sites like Yahoo! |
---|
| 6 | # and Google. By telling these "robots" where not to go on your site, |
---|
| 7 | # you save bandwidth and server resources. |
---|
| 8 | # |
---|
| 9 | # This file will be ignored unless it is at the root of your host: |
---|
| 10 | # Used: http://example.com/robots.txt |
---|
| 11 | # Ignored: http://example.com/site/robots.txt |
---|
| 12 | # |
---|
| 13 | # For more information about the robots.txt standard, see: |
---|
[6627152] | 14 | # http://www.robotstxt.org/robotstxt.html |
---|
[b354002] | 15 | # |
---|
| 16 | # For syntax checking, see: |
---|
[6627152] | 17 | # http://www.frobee.com/robots-txt-check |
---|
[b354002] | 18 | |
---|
| 19 | User-agent: * |
---|
| 20 | Crawl-delay: 10 |
---|
| 21 | # Directories |
---|
| 22 | Disallow: /includes/ |
---|
| 23 | Disallow: /misc/ |
---|
| 24 | Disallow: /modules/ |
---|
| 25 | Disallow: /profiles/ |
---|
| 26 | Disallow: /scripts/ |
---|
| 27 | Disallow: /themes/ |
---|
| 28 | # Files |
---|
| 29 | Disallow: /CHANGELOG.txt |
---|
| 30 | Disallow: /cron.php |
---|
| 31 | Disallow: /INSTALL.mysql.txt |
---|
| 32 | Disallow: /INSTALL.pgsql.txt |
---|
| 33 | Disallow: /install.php |
---|
| 34 | Disallow: /INSTALL.txt |
---|
| 35 | Disallow: /LICENSE.txt |
---|
| 36 | Disallow: /MAINTAINERS.txt |
---|
| 37 | Disallow: /update.php |
---|
| 38 | Disallow: /UPGRADE.txt |
---|
| 39 | Disallow: /xmlrpc.php |
---|
| 40 | # Paths (clean URLs) |
---|
| 41 | Disallow: /admin/ |
---|
| 42 | Disallow: /comment/reply/ |
---|
[d7a822e] | 43 | Disallow: /filter/tips/ |
---|
[b354002] | 44 | Disallow: /logout/ |
---|
| 45 | Disallow: /node/add/ |
---|
| 46 | Disallow: /search/ |
---|
| 47 | Disallow: /user/register/ |
---|
| 48 | Disallow: /user/password/ |
---|
| 49 | Disallow: /user/login/ |
---|
| 50 | # Paths (no clean URLs) |
---|
| 51 | Disallow: /?q=admin/ |
---|
| 52 | Disallow: /?q=comment/reply/ |
---|
[d7a822e] | 53 | Disallow: /?q=filter/tips/ |
---|
[b354002] | 54 | Disallow: /?q=logout/ |
---|
| 55 | Disallow: /?q=node/add/ |
---|
| 56 | Disallow: /?q=search/ |
---|
| 57 | Disallow: /?q=user/password/ |
---|
| 58 | Disallow: /?q=user/register/ |
---|
| 59 | Disallow: /?q=user/login/ |
---|
Nota: Vea
TracBrowser
para ayuda de uso del navegador del repositorio.