View Full Version : Robot.txt can help in Domain Move?
Rocknroll
01-08-2006, 12:32/12:32PM
Hi all,
I was just thinking about moving my site to new domain name. And to avoid loosing rankings, I was thinking about doing this.
1. Copying the content to the new domain (still keeping it on OLD!)
2. Putting robot.txt on old domain to stop indexing the OLD site so that I am not duplicating the content for SE's
3. And eventually when my NEW domain start to show up on the SERPs, I can place 301 redirect from OLD to NEW domain!
Now here is my issue. I believe robot.txt wont clear the files SE's already have from my site in their Databases. SO when they crawl my new site, will they still penalize me for content duplication?
OR my ONLY choice is to put 301s right away! Any other ideas are welcome!
Thanks
ihelpyou
01-08-2006, 12:35/12:35PM
Changing domains is the "worse" thing a site can do in history. I have to wonder why you would want to start from scratch? The age of a domain means lots. Not to mention the sandbox in Google that will probably hit you.
You better have a good reason.... no, a great reason.
Connie
01-08-2006, 12:46/12:46PM
Besides what Doug said I don't think a robots.txt will do what you want. You will probably start loosing currant rankings when you stop the robots from crawling your site.
If you have a good enough reason (great reason) to change the domain name, then you should do the 301 redirect immediately.
ihelpyou
01-08-2006, 12:51/12:51PM
yeah, that's the best, but it won't avoid the sandbox for a NEW domain, which means a brand new website in Google's eyes.
Again; you better have a great reason.
The domain in your profile is fine and dandy if that is the one you mean. If that's the one, you have no great reason for changing it.
g1smd
01-08-2006, 12:57/12:57PM
If you really are gong to move then the redirect needs to be active immediately the new domain goes live.
Don't disallow the old site. Google needs to be able to see the redirects.
Rocknroll
01-08-2006, 13:12/01:12PM
Thanks ihelpyou and others!!
I have a compelling reason to move the site. I have an advantage though (at least I think it is!). I have about 6 months when I need to move the old domain. I can use this time to put the new domain up with some content (related but not the final content ofcourse) and try to "age" the new domain in SE's. Do you think doing that will help alot?
Another quick question. How do I get my Directory listings (DMOZ, Yahoo Directory etc) updated? I would hate to loose those as you all know how hard it is to even get in dmoz. Can I go into my dmoz directory listing and change the Domain? Do they allow us to change domain? OR do I have to go through the whole painful process of requesting listing and praying to get included?
PS - This is not rearging the domain in my profile.
Thanks guys!
Blue
01-08-2006, 13:29/01:29PM
http://www.dmoz.com/help/update.html
ihelpyou
01-08-2006, 13:50/01:50PM
Okay, you say "compelling" but don't tell us what that is?
You are also trying to think of ways to keep your old positions. I'm sorry, but you simply have NO GOOD options. The 301 is your very best way but that isn't a guarantee by any stretch of your imagination. How can I be more clear about this?
And again; why do you feel the need to make the worse move any owner can possibly make?
You being a SEO yourself should already know the huge risks involved in changing domain names.
g1smd
01-08-2006, 18:49/06:49PM
The ODP will update a listing only if the OLD domain contains a notice about the new domain OR it has a redirect to the new domain.
Quadrille
01-08-2006, 20:06/08:06PM
There is only one good reason I can think of for a domain move - and that is, you had a .biz or .info (having been poorly advised), then someone moved in on the .com - either a competitor, or a spoiler site.
In that circumstance, move to a new domain, a .com - or if you feel the need for .biz or .info - at least get the .com as well, and forward it by 301 to the new domain. I'd use the .com
I've seen that domain move saving a site from ruin. But you'd need to assess the situation carefully; in general, domain moves are seriously unwise (yes, I learned the hard way!).
MrRoy
02-08-2006, 05:18/05:18AM
The ODP will update a listing only if the OLD domain contains a notice about the new domain OR it has a redirect to the new domain.
You mean to say that the dmoz editors will manually check the domain and if they notice a redirection then they will change the url ???
Do they check each n every url's listed in different categories manually???
If Yes, then i think it will take long time to get changed.
Just wanted to clear my understanding.
:)
Rocknroll
02-08-2006, 10:12/10:12AM
Doug,
I didnt mean to br obscure, by "compelling" I just wanted to save you hassle of explaining all the "legal advice and compulsion" faced by my client.
I am going to just put some pages up on the new domain today and hope that by the time the actual content is moved to the NEW domain, it has already aged well in the search engines.
Any advice of mod_rewrite advice given here - http://www.domaininformer.com/guides/Marketing/articles/changingdomainname.html
Vs.
our regular 301 redirects (.htaccess or another method).
BTW count me in to be always on the forum and picthing in to answer any questions by members (I hope you guys are okay with that).
Thanks all!
ihelpyou
02-08-2006, 10:18/10:18AM
Hi, That article is saying exactly what all the threads in here are saying. No difference.
I simply am saying that it's NOT smooth nor seamless, in that you might NOT keep your rankings at all do to the sandbox. Period.
You have to do what you have to do however. I just don't want you to tell your client that all is fine and dandy when it certainly is not fine and dandy.
Of course we want you to help in here. :)
Blue
02-08-2006, 11:26/11:26AM
Originally posted by Rocknroll
...BTW count me in to be always on the forum and picthing in to answer any questions by members (I hope you guys are okay with that). Anybody whos forum name is "Rocknroll" has got to be cool. :cheers:
Dave Hawley
02-08-2006, 22:46/10:46PM
The ODP will update a listing only if the OLD domain contains a notice about the new domain OR it has a redirect to the new domainYes, but that can take 2 years or more.
g1smd
03-08-2006, 20:18/08:18PM
Many of the redirect issues are updated within weeks at the ODP. A separate process often deals with those.
vBulletin® v3.8.3, Copyright ©2000-2010, Jelsoft Enterprises Ltd.