Ravens PHP Scripts: Forums
 

 
  Forum Index  •  Forum FAQ  •  Search  •  Memberlist  •  Usergroups  •  Profile  •  Log in to check your private messages  •  Log in

stop being crawled
 View next topic
View previous topic
Post new topic   Reply to topic    Ravens PHP Scripts And Web Hosting Forum Index -> Post Installation Help
Author Message
express
Client



Joined: Jan 03, 2007
Posts: 94
PostPosted: Sun Nov 18, 2007 7:18 pm Reply with quote
I found this script that Raven had posted on how to stop your site from being crawled. Is the correct place to install this to is the .index file? Also, in what location.
Thanks,
Express
 
View user's profile Send private message
jakec
Site Admin



Joined: Feb 06, 2006
Posts: 3048
Location: United Kingdom
PostPosted: Mon Nov 19, 2007 1:17 am Reply with quote
Which script is this?

You can alter the robots.txt file to try and prevent legitimate bots from crawling your site, you can also use the .htaccess to prevent bots from crawling your site. Both have been discussed before in detail.
 
View user's profile Send private message
express
PostPosted: Mon Nov 19, 2007 10:08 am Reply with quote
Here is an example of the script.

<!-- Prevents indexing of the page and of links on the page. -->
meta name=robots content no index

<!-- Prevents indexing of the page. -->

<!-- Prevents indexing of links off the page. -->
Where does this script go?
 
evaders99
Former Moderator in Good Standing



Joined: Apr 30, 2004
Posts: 3221
PostPosted: Mon Nov 19, 2007 6:51 pm Reply with quote
Meta tags go into includes/meta.php

_________________
- Only registered users can see links on this board! Get registered or login! -

Need help? Only registered users can see links on this board! Get registered or login! 
View user's profile Send private message Visit poster's website
express
PostPosted: Mon Nov 19, 2007 8:11 pm Reply with quote
Thanks again evaders99! I found this and just added to NO to both the index and follow txt. I hope I did this right.

$metastring .= "<meta name=\"ROBOTS\" content=\"NOINDEX, NOFOLLOW\" />\n";
~S~
Express
 
Display posts from previous:       
Post new topic   Reply to topic    Ravens PHP Scripts And Web Hosting Forum Index -> Post Installation Help


 Jump to:   




View next topic
View previous topic
You cannot post new topics in this forum
You cannot reply to topics in this forum
You cannot edit your posts in this forum
You cannot delete your posts in this forum
You cannot vote in polls in this forum
You can attach files in this forum
You can download files in this forum


Powered by phpBB © 2001-2007 phpBB Group
All times are GMT - 6 Hours
 
Forums ©