Google macht mich grad irre... Oder die Suche nach der perfekten robots.txt

[kindspech]

Hi Leutes,

ich habe mich heute seit längerem mal wieder bei Google eingeloggt. Gleich auf der Übersicht springt mir ins Auge:

URLs durch robots.txt eingeschränkt: 4.505

Ein Blick auf die Details offenbahrt Schreckliches:

index.php 20mal mit XTCsid!

login.php ca. 3500mal mit XTCsid!

aber auch wirklich nur diese beiden mit Session-ID.

und das, obwohl in der robots.txt Disallow: /login.php steht...

Wie konnte es dazu kommen? Was kann man dagegen machen??

Liebe Grüße

Natascha

[Gecko6]

Hallo Natascha,

versuch es mal hiermit:

User-agent: *

Disallow: /*?XTCsid

Disallow: /address_book_process.php 

Disallow: /account.php 

Disallow: /account_edit.php 

Disallow: /account_edit_process.php 

Disallow: /account_history.php 

Disallow: /account_history_info.php 

Disallow: /address_book.php 

Disallow: /coID/3/content/AGB 

Disallow: /coID/4/content/Impressum

Disallow: /coID/7/content/Kontakt

Disallow: /coID/9/content/Wir-ueber-uns

Disallow: /coID/1/product/Versandkosten

Disallow: /checkout_process.php 

Disallow: /advanced_search.php 

Disallow: /advanced_search_result.php 

Disallow: /checkout_address.php 

Disallow: /checkout_confirmation.php 

Disallow: /checkout_payment.php 

Disallow: /checkout_success.php 

Disallow: /contact_us.php 

Disallow: /create_account.php

Disallow: /create_account_guest.php 

Disallow: /create_account_process.php 

Disallow: /create_account_success.php 

Disallow: /info_shopping_cart.php 

Disallow: /login.php 

Disallow: /logoff.php

Disallow: /password_double_opt.php

Disallow: /popup_image.php 

Disallow: /popup_search_help.php 

Disallow: /privacy.php 

Disallow: /product_notifications.php 

Disallow: /product_reviews.php 

Disallow: /product_reviews_info.php 

Disallow: /reviews.php 

Disallow: /shipping.php 

Disallow: /admin/

Disallow: /export/

Disallow: /download/ 

Disallow: /includes/ 

Disallow: /pub/ 

Disallow: /media/

Disallow: /images/


User-Agent: Googlebot

Disallow: /address_book_process.php 

Disallow: /account.php 

Disallow: /account_edit.php 

Disallow: /account_edit_process.php 

Disallow: /account_history.php 

Disallow: /account_history_info.php 

Disallow: /address_book.php 

Disallow: /checkout_process.php 

Disallow: /advanced_search.php 

Disallow: /advanced_search_result.php 


Disallow: /coID/3/content/AGB 

Disallow: /coID/4/content/Impressum

Disallow: /coID/7/content/Kontakt

Disallow: /coID/0/content/Widerrufsrecht

Disallow: /coID/2/content/Datenschutz

Disallow: /coID/10/content/Zahlarten

Disallow: /coID/1/content/Versandkosten


Disallow: /checkout_address.php 

Disallow: /checkout_confirmation.php 

Disallow: /checkout_payment.php 

Disallow: /checkout_success.php 

Disallow: /contact_us.php 

Disallow: /create_account.php

Disallow: /create_account_guest.php 

Disallow: /create_account_process.php 

Disallow: /create_account_success.php 

Disallow: /info_shopping_cart.php 

Disallow: /login.php 

Disallow: /logoff.php

Disallow: /password_double_opt.php

Disallow: /popup_image.php 

Disallow: /popup_search_help.php 

Disallow: /privacy.php 

Disallow: /product_notifications.php 

Disallow: /product_reviews.php 

Disallow: /product_reviews_info.php 

Disallow: /reviews.php 

Disallow: /shipping.php 

Disallow: /admin/

Disallow: /export/

Disallow: /download/ 

Disallow: /includes/ 

Disallow: /pub/ 

Disallow: /media/

Disallow: /*?XTCsid


User-Agent: Googlebot-Image

Disallow: /

Disallow: /*.gif$

Disallow: /*.jpg$

Disallow: /*.pdf$

Disallow: /*.zip$