stableversion-3.0
|
Last change
on this file since 60aa084 was
6627152,
checked in by José Gregorio Puentes <jpuentes@…>, 8 años ago
|
|
se actualizo el cord
|
-
Propiedad mode establecida a
100755
|
|
File size:
1.5 KB
|
| Línea | |
|---|
| 1 | # |
|---|
| 2 | # robots.txt |
|---|
| 3 | # |
|---|
| 4 | # This file is to prevent the crawling and indexing of certain parts |
|---|
| 5 | # of your site by web crawlers and spiders run by sites like Yahoo! |
|---|
| 6 | # and Google. By telling these "robots" where not to go on your site, |
|---|
| 7 | # you save bandwidth and server resources. |
|---|
| 8 | # |
|---|
| 9 | # This file will be ignored unless it is at the root of your host: |
|---|
| 10 | # Used: http://example.com/robots.txt |
|---|
| 11 | # Ignored: http://example.com/site/robots.txt |
|---|
| 12 | # |
|---|
| 13 | # For more information about the robots.txt standard, see: |
|---|
| 14 | # http://www.robotstxt.org/robotstxt.html |
|---|
| 15 | # |
|---|
| 16 | # For syntax checking, see: |
|---|
| 17 | # http://www.frobee.com/robots-txt-check |
|---|
| 18 | |
|---|
| 19 | User-agent: * |
|---|
| 20 | Crawl-delay: 10 |
|---|
| 21 | # Directories |
|---|
| 22 | Disallow: /includes/ |
|---|
| 23 | Disallow: /misc/ |
|---|
| 24 | Disallow: /modules/ |
|---|
| 25 | Disallow: /profiles/ |
|---|
| 26 | Disallow: /scripts/ |
|---|
| 27 | Disallow: /themes/ |
|---|
| 28 | # Files |
|---|
| 29 | Disallow: /CHANGELOG.txt |
|---|
| 30 | Disallow: /cron.php |
|---|
| 31 | Disallow: /INSTALL.mysql.txt |
|---|
| 32 | Disallow: /INSTALL.pgsql.txt |
|---|
| 33 | Disallow: /install.php |
|---|
| 34 | Disallow: /INSTALL.txt |
|---|
| 35 | Disallow: /LICENSE.txt |
|---|
| 36 | Disallow: /MAINTAINERS.txt |
|---|
| 37 | Disallow: /update.php |
|---|
| 38 | Disallow: /UPGRADE.txt |
|---|
| 39 | Disallow: /xmlrpc.php |
|---|
| 40 | # Paths (clean URLs) |
|---|
| 41 | Disallow: /admin/ |
|---|
| 42 | Disallow: /comment/reply/ |
|---|
| 43 | Disallow: /filter/tips/ |
|---|
| 44 | Disallow: /logout/ |
|---|
| 45 | Disallow: /node/add/ |
|---|
| 46 | Disallow: /search/ |
|---|
| 47 | Disallow: /user/register/ |
|---|
| 48 | Disallow: /user/password/ |
|---|
| 49 | Disallow: /user/login/ |
|---|
| 50 | # Paths (no clean URLs) |
|---|
| 51 | Disallow: /?q=admin/ |
|---|
| 52 | Disallow: /?q=comment/reply/ |
|---|
| 53 | Disallow: /?q=filter/tips/ |
|---|
| 54 | Disallow: /?q=logout/ |
|---|
| 55 | Disallow: /?q=node/add/ |
|---|
| 56 | Disallow: /?q=search/ |
|---|
| 57 | Disallow: /?q=user/password/ |
|---|
| 58 | Disallow: /?q=user/register/ |
|---|
| 59 | Disallow: /?q=user/login/ |
|---|
Nota: Vea
TracBrowser
para ayuda de uso del navegador del repositorio.
