Search found 8 matches

One thing you need to be aware of: If a crawler finds a link like that (modules/PHP-Nuke_HOWTO/xoops-vs-post-nuke.html) then it's linked somewhere in your website like that. So if you submit a sitemap ...

Hi hitwalker
Did the file come out of CoffeeCup like that? Ouch. I see you replaced the & with &amps; BUT you still have another (typical american) problem -- your last-mod dates are incorrec ...

Here are some links to the robots tag + the Googlebot one (for good measure):
http://www.robotstxt.org/wc/meta-user.html
http://www.google.com/remove.html

No, the scrolling forum blocks on the fr ...

No, it doesn't override things in the robots.txt - also it doesn't override the robots-meta-tag. The program actually reads and uses the robots.txt (+ the robots-meta tags) so you should be able to te ...

Don't worry about "stupid" questions, it's the stupid answers you have to be afraid of Smile

. These are all things which are really new and Google doesn't explain them very well (sometimes), so they are ...

@Guardian2003: Refiltering is high on my list, thanks for the confirmation. Search + Replace in the URLs sounds like a good idea, I'll add it to my list as well.

@Steptoe: To your first suggestion ...

@Steptoe: sounds good. Yes it makes a BIG difference on a "complex" site (i.e. most CMS-based sites) if you play with the filter settings or not. These types of things have been known to keep Google ( ...

Hi guys
just a short note, I'm the one behind the GSiteCrawler (looks like tracking referrers is worth it after all Smile

).

@Dauthus: the size doesn't matter, the program will automatically make a ...

Author	Message
Topic: Error in xml ,need solution.
softplus Replies: 9 Views: 7305	Forum: General/Other Stuff Posted: Wed Aug 24, 2005 3:55 am Subject: Error in xml ,need solution.
softplus Replies: 9 Views: 7305	One thing you need to be aware of: If a crawler finds a link like that (modules/PHP-Nuke_HOWTO/xoops-vs-post-nuke.html) then it's linked somewhere in your website like that. So if you submit a sitemap ...
Topic: Error in xml ,need solution.
softplus Replies: 9 Views: 7305	Forum: General/Other Stuff Posted: Wed Aug 24, 2005 1:42 am Subject: Error in xml ,need solution.
softplus Replies: 9 Views: 7305	Hi hitwalker Did the file come out of CoffeeCup like that? Ouch. I see you replaced the & with &amps; BUT you still have another (typical american) problem -- your last-mod dates are incorrec ...
Topic: Google Sitemap
softplus Replies: 28 Views: 21674	Forum: General/Other Stuff Posted: Wed Aug 03, 2005 2:30 am Subject: Google Sitemap
softplus Replies: 28 Views: 21674	Here are some links to the robots tag + the Googlebot one (for good measure): http://www.robotstxt.org/wc/meta-user.html http://www.google.com/remove.html No, the scrolling forum blocks on the fr ...
Topic: Google Sitemap
softplus Replies: 28 Views: 21674	Forum: General/Other Stuff Posted: Wed Aug 03, 2005 1:20 am Subject: Google Sitemap
softplus Replies: 28 Views: 21674	No, it doesn't override things in the robots.txt - also it doesn't override the robots-meta-tag. The program actually reads and uses the robots.txt (+ the robots-meta tags) so you should be able to te ...
Topic: Google Sitemap
softplus Replies: 28 Views: 21674	Forum: General/Other Stuff Posted: Tue Aug 02, 2005 2:53 pm Subject: Google Sitemap
softplus Replies: 28 Views: 21674	Don't worry about "stupid" questions, it's the stupid answers you have to be afraid of . These are all things which are really new and Google doesn't explain them very well (sometimes), so they are ...
Topic: Google Sitemap
softplus Replies: 28 Views: 21674	Forum: General/Other Stuff Posted: Tue Aug 02, 2005 1:46 am Subject: Google Sitemap
softplus Replies: 28 Views: 21674	@Guardian2003: Refiltering is high on my list, thanks for the confirmation. Search + Replace in the URLs sounds like a good idea, I'll add it to my list as well. @Steptoe: To your first suggestion ...
Topic: Google Sitemap
softplus Replies: 28 Views: 21674	Forum: General/Other Stuff Posted: Mon Aug 01, 2005 2:57 pm Subject: Google Sitemap
softplus Replies: 28 Views: 21674	@Steptoe: sounds good. Yes it makes a BIG difference on a "complex" site (i.e. most CMS-based sites) if you play with the filter settings or not. These types of things have been known to keep Google ( ...
Topic: Google Sitemap
softplus Replies: 28 Views: 21674	Forum: General/Other Stuff Posted: Sun Jul 31, 2005 7:17 am Subject: re: Google Sitemap
softplus Replies: 28 Views: 21674	Hi guys just a short note, I'm the one behind the GSiteCrawler (looks like tracking referrers is worth it after all ). @Dauthus: the size doesn't matter, the program will automatically make a ...