PDA

View Full Version : Robots revisiting


Marianthi
14-05-2003, 06:25/06:25AM
Hello everyone!:hi:

I would like to congratulate you all on the fine job you're doing in this forum. I've been watching you for the last couple of months and I'm very interested in what you have to say.
I'm taking the advice of a wise man who said that lurking was not enough and you actually learn from interaction, so I've decided to come forward with a question (or two, or three, or.. )
I have an affiliate site for an internet marketing company with its own domain and host. I've been a webmaster for only four months now so you understand I'm just beginning to scratch the surface on HTML.
I would like to ask you about robots. As I am constantly adding content and links, is it important to have a line of code telling robots to visit often (do you know of any such code)? Is Googlebot included in these robots? Would this update affect rankings inbetween the dances?
Well, I've got a few other questions (about a hundred of them) but I thought I shouldn't scare you off! I'll post them later!
Thank you :o:

scottiecl
14-05-2003, 07:16/07:16AM
Hi Marianthi :hi:

Welcome to the forum!

If you like, you can put a robots tag in your meta tags with the following:

<meta name=robots content="index, follow">

But it isn't really necessary. You do want to have a robots.txt file in the root directory of your site though. Open Notepad and save a blank file as robots.txt and upload it to the root directory of your site.

Since it is blank, all robots will know it is OK to index your site.

Marianthi
16-05-2003, 04:23/04:23AM
Thanks Scottie for your quick response! :)
I was tied up for a while and couldn't come to the forum but I appreciate your answer. I 'll take your advice but I just wanted to know the robots will see this file when they come crawling again, right? (in a month or so) If they come inbetween their major updates and find new content will they rank me differently at that time or will they make the changes at the time of the major update?
Also, what's this I hear about Webposition **** now then in your forum? I couldn't get the whole story. What is wrong with it? I am really tempted to buy it. :confused: