PDA

View Full Version : Help!!! My site appears to have been dropped from Ink


Jastor
12-04-2002, 08:08/08:08AM
I'm baffled by this one!

I submitted my site to Inktomi via Network Solutions about eight months ago. My site has been in Inktomi since that time, until recently that is.

My site appears to have been dropped from Inktomi. I double checked it from Pro Techs Inktomi Search Tool.

According to Network Solutions, my site has been indexed.

I checked my access logs and see that my site has been crawled by Slurp without any errors as early as yesterday.

I made a couple of simple changes to my site a week or two ago:

I did the following:

1.) I incorporated the use of the <NOFRAMES> tag into my site.
2.) I added text and links to the other content pages of my web site within the <NOFRAMES> section of the index pages so that my site would be viewable by SE Robots and Non-Frames capable browsers.
3.) I added a small piece of javascript to maintain frame context.
4.) I added a couple of index pages to be called by the above mentioned javascript code in the event that someone accesses my content pages directly, so that the appropriate frames would be loaded.

Other than that, there has been no other changes to my site.

I don't understand why I no longer appear in Inktomi.

Please Help!!!
I need all the advice I can get on this one. :confused:

Advisor
12-04-2002, 10:29/10:29AM
Jastor, is it the site in your sig.? If so (and I don't really think this is the problem), why is your noframes content different than the content a person sees on the main page? You don't really want to show the search engines something different than you're showing your human visitors, if you can help it. But like I said, I doubt that's your problem with Ink. I have no idea what might be happening there.

Jill

Jastor
12-04-2002, 14:06/02:06PM
Thanks for the reply Jill.

I'm glad that you don't see anything wrong with my code that would cause Inktomi to fail to index my site or penalize my listing in their database.

It's nice to have another set of eyes to help spot problems.

I e-mailed Network Solutions, or I should say Verisign, this morning. Hopefully, they will answer my question.

The content in my index page is intended mainly for Search Engines to see. The message contained in the index page is really the same as that on my Home content page, I just worded it a little bit differently especially trying to be brief. I placed links to all the content pages on my site at the bottom of the page for Search Engines to index.

I am still planning to rewrite my content to better utilize my targeted keywords, but I want to be careful how I do it because I am still new at this stuff. I was planning to make some changes to the content of the index page first, as kind of an experiment before I go and revamp my main content pages. Once someone loads my site, they will see my content pages which currently say and look like I want them to.

Once I am sure that I have worded the index page correctly, such that it presents the message I want to convey, while at the same time being optimized for proper keyword usage, I will publish the content to my main content pages.

I just don't want my content pages to continually be changing, just because I am messing with trying to tweak them for keyword usage; especially when their message should already be clear to a person. I through the existing index pages up quickly. Right now, they are mainly just allowing search engines to crawl the content pages on my site via the links at the bottom.

I hope that makes sense. I just want to be sure that I publish the content that my perspective clients will see only after I am sure that is correctly worded for everyone concerned (i.e. Both People and Search Engines).

Maybe my whole line of reasoning is retarded. :confused:

While I'm on the subject of search engines crawling links, I am still wondering:

When you pay to have multiple pages from the same site indexed, is that for the sole purpose of having multiple entries in the Search Engine by targeting different sets of keywords?? I thought that search engines would crawl the main URL and index any other pages you have linked to. I am still very confused on this.

Sorry for the length of this post. I didn't mean to make you read a book. I just didn't know a better way to explain my reasons for laying out the index page content the way I did.

Jastor
12-04-2002, 14:14/02:14PM
Hold the Phone!!!!!

I just checked Network Solutions's site again, and my site now shows the following error related to my Inktomi Search Submit.

Error:7001

I don't know what this means yet. I'm going to try and call them.

Advisor
12-04-2002, 14:22/02:22PM
I'm glad that you don't see anything wrong with my code that would cause Inktomi to fail to index my site or penalize my listing in their database. Actually, I didn't look at your code all that closely, so don't go by me! I just took a quick peak to see what you were doing with your noframes tag.

Good luck figuring out what the error code is. You may have better luck finding the error codes on their site as opposed to the phone...just a thought!

Jill

Jastor
12-04-2002, 17:28/05:28PM
Jill,

I tried to find information on Verisign's site about the error code prior to my last post. The link doesn't work on their web site. Not only that, but if you try to search for the information through their on-line help, that doesn't work either. So they have some issues on their site.

I e-mailed them earlier today and your not going to believe the reply. :1:

I e-mailed them the following information earlier this morning before their site showed the actual error code:

Our URL, www.gambitsystems.net, appears to no longer be listed in the Inktomi Database. Our Verisign Account shows the site as Indexed. Our access logs show that Inktomi has crawled our site as early as yesterday without any errors. What is the problem?? Please Help.

Thank You

They sent me this stupid reply:

Thank you for contacting VeriSign.

To answer your questions about WebSites from VeriSign, please
follow the instructions below:

1. Please visit us at http://www.verisignwebsites.com/

2. Click the "Frequently Asked Questions" link located at the top
of the webpage.

***In addition, we offer live, Web-based support from the
WebSites from VeriSign homepage, or if you have questions that
were not answered on the website, please forward them to:

websitesupport@verisign.com

Best regards,

Abe K
VeriSign, Inc.
http://www.networksolutions.com


I have to tell you, I wouldn't have ever become immediately upset under normal conditions. You have to understand, when I first started my company, I had Network Solutions host the site initially. From day one, I have never been able to get descent support out of them, on the phone or otherwise. I'm telling you, I spent literally hours trying to get simple problems resolved with them. I signed up for Inktomi through them before I had had enough bad experience with them.

I have to tell you that when you sign up for their services, as long as everything gets set up correctly initially, and you never need any changes made, you will be a happy camper. But if a problem crops up, or if you just need to make a simple change, you can just forget it.

I was so frustrated just having some simple changes made with regard to my web hosting that I just changed domain registrars and went with a different hosting company. That's right! I had to change domain registrars because I couln't get them to renew my domain name without renewing my web site hosting. I no longer wanted them to host my web site because they would not allow you to add javascript to your site.

Anyway, the idiots didn't even know what an MX record was, which was another reason why I had to change domain registrars.

As an IT professional, albeit one that is new to web site promotion, I would never recommend that anyone go to Verisign for anything. Unless they were just using them as a primary CA.

With all that said, I have decided to just pay for Inktomi Search Submit through another company. My Inktomi submission through Verisign expires in three months anyway.

Who should I purchase the Inktome Search Submission through?? I have seen Position Tech and ineedhits mentioned in these forums. I purchased my Teoma submission through ineedhits, but I have read a couple of posts on these forums that lead me to question whether I should use ineedhits again.

Am I better off going with Position Tech or should I use someone else? What do you think?

Advisor
12-04-2002, 17:33/05:33PM
Position Tech is very good. I know some people who work there. They're very responsive and are good people. I would highly recommend them.

Jill

Jastor
12-04-2002, 17:37/05:37PM
Thanks so much Jill.

Man ........ You reply quick!!!!

You sure you don't have these forums linked to your pager. :D

See Ya

Advisor
12-04-2002, 17:40/05:40PM
Don't need a pager...I'm at my 'puter 24/7!

J

aps
12-04-2002, 18:07/06:07PM
Jastor,

I just went through a terrible time with Ink/Slurp Crawler.

7001 ERROR_DISALLOW: Indexing disallowed by noindex meta tag.
Problem: Your Web page (or one of the frames in your frameset) has a Meta-tag called "robots" which has a value of "noindex". This is a specific request to search engine indexers to not index this page.
Solution: Locate a Meta-tag in your document called "Robots" and modify it so it does not say "noindex". This could be in your Web page or one of your frames.


You can find the inclusion errors here:
http://ink.ineedhits.com/inclusionerrors.asp#7001

Jastor
15-04-2002, 21:41/09:41PM
Thanks for the post Aps. :)

I have been away from the forums for the last couple of days.

I actually figured out the problem a couple of days a ago.

You are right, I had the noindex tag in my title frame and navigation frame. Before I realized that robots would ultimately only index your index.htm page and any links located between the <NOFRAMES> tags, I had been afraid that the individual navigation and or title frame would be indexed and given a listing on some of the search engines. That's why I had had the noindex tag in those two frames.

There was also another issue. My hosting provider changed systems. It appears that the operation of there 404 error handler changed from their previous system. Previously I had no robots.txt file at the root directory. I noticed file not found errors for the robots.txt file in my error logs. I added the robots.txt file with the following lines which fixed that problem:

User-agent: *
Disallow:

I did switch from Network Solutions to Position Tech for my Inktomi Submission. I have been thrilled with them ever since.

Jill, You were absolutely right about Position Tech. They know their stuff.

I actually received another e-mail from Network Solutions in reply to my support request to their Inktomi Search/Submit technical support group. Instead of answering my question, they tried to sell me on their new Search/Submission service called Surelist. I can't believe those Bozos. Until Network Solutions vastly improves their support system I would definitely advise everyone to use a different company unless of course they have several idle hours to spend on the phone, and don't mind the likelyhood that their problems might never be fixed.

Please don't get me wrong. Verisign and Network Solutions have some great service offerings. I personnally have just had several bad experiences with their technical support.

I'm happy to say my site was successfuly indexed. I'm waiting for my site to appear in the listings. I'm hoping it will appear in another day or two.

BTW, in a previous post on another thread, someone gave the IP address for the Position Tech URL that permitted a direct search of the Inktomi Database. I found the actual URL.

It's

When you log into your Position Tech account, the URL is listed in their FAQs.

See Ya

Advisor
16-04-2002, 00:52/12:52AM
Hey Jastor, glad that PT is working out for you. They are good people from what I know of them. I've only heard good stuff about them, compared to what I've heard regarding Verisign/Netsol. Like night and day, I suspect!

Glad you have you situation now under control!

Jill