Setinel spanked Google Bot / robots.txt help needed

Worker Joined: Mar 11, 2004 Posts: 209

Hello

Just having mails from sentinel like

User Agent: Mediapartners-Google/2.1
Query String: mysite.com/admin.php?op=ABMain
Get String: mysite.com/admin.php?op=ABMain
Post String: mysite.com/admin.php

and to other parts

is this the line i need to add to robots.txt

Disallow: /modules/NukeSentinel/

after that happen i added G bots to protected range area but not sure if its ok or not

Thanks

Posted: Thu Jan 12, 2006 5:19 pm

User-agent: *
Disallow: /admin.php
Disallow: /admin/
Disallow: /images/
Disallow: /includes/
Disallow: /themes/
Disallow: /blocks/
Disallow: /modules/
Disallow: /language/

Posted: Thu Jan 12, 2006 5:33 pm

Thank you

Posted: Sat Jan 21, 2006 7:50 am

Guardian2003 wrote:

User-agent: *
Disallow: admin.php
Disallow: /admin/
Disallow: /images/
Disallow: /includes/
Disallow: /themes/
Disallow: /blocks/
Disallow: /modules/
Disallow: /language/

i just validated my robots.txt through this sites validater and it said i should have a forword slash "/" infront of the admin.php file. ? Confused

also for using the validater were do i place the code to get it to work on my site. thanks..

Posted: Sat Jan 21, 2006 8:23 am

Yes that is correct the missing slash was an oversight on my part.
You can grab the code from the validation service website. The easiest way is just to add it into one of the footer fields in nuke preferences.
But a more professional approach would be to add it directly in the footer.php file.

Posted: Sat Jan 21, 2006 8:43 am

thanks for the quick response guardian. Smile