View Full Version : Msn exclusion
sross
18-06-2003, 07:26/07:26AM
I have optimized several pages so that they will rank well in google. I would like to be able create an entry in my robot.txt file that will exclude these pages from being included in MSN. I know that they don't do the spidering themselves so who do i need to block?
User-agent: Who do I block?
Disallow: google optimized pages
ihelpyou
18-06-2003, 07:28/07:28AM
Inktomi. Why would you want to do that?
sross
18-06-2003, 07:42/07:42AM
I guess it really doesn't matter if the pages get spidered. I was just trying to make sure that the right search engine spidered the right page.
I guess what I should have asked is does it really matter if a search engine spiders a page and it doesn't rank the page well will it affect the ranking of other pages on my site. (But this would be better a question for a different area)
ihelpyou
18-06-2003, 07:48/07:48AM
I don't why you feel that one page ranking in Google will not rank on other engines. I've Never had to separate pages and engines and hopefully never will. That sounds like toooo darn much work to me for next to zero benefit.
It sounds like you have been reading a little too much of WPG software. :)
sross
18-06-2003, 07:53/07:53AM
I am new to the SEO World and am still learning what to do and what not to do. I was thinking that I could tailor pages to do well in a specific search engine then exclude them from being spidered by other engines. But I guess that if I spend the time optimizing them for an engine, I might as well let any spider get a hold of them...Ya never know something good may come out my SEO work
ihelpyou
18-06-2003, 07:56/07:56AM
Yep. You got it. Just read all you can in here as well. Ask questions about what you don't understand. Any page of your site can rank for all the search engines. I would not spend any time separating pages.
vBulletin® v3.8.3, Copyright ©2000-2010, Jelsoft Enterprises Ltd.