Ink spidering

[laetoli]

Does Ink spider sub-pages if the main page is a paid for Ink listing? If it does, how long does it take?

Our site is listed in dmoz, yahoo, looksmart and has at least 100 links from related content sites elsewhere on the web. Not all the links are to my main page.

On the main subject keyword, the main page is ranked on average about 15 in all the other major search engines. However in Ink it ranks 160. The other engines all list subpages (Goggle lists almost all of them) but not Ink. We have a number of first place rankings in several search engines including Ink on more specific search terms.

Why doesn't Ink list any of my subpages? The site is extremely content rich. More detailed search facilties would enable people to find specific information more easily - my users don't tend to like to navigate about - they want to go straight to the specific information they are looking for.

The site is the most part of a small charity offering online support and information for people with MS so we really cannot afford to pay for any more listings.

Take care,
Paul

[Advisor]

Paul, if there are certain definite pages you want in Ink, you've gotta pay for them. Yes, Ink may eventually spider and find them, but then again, they may not. They're very interested in making money, so they don't set their regular (free) spider to get everything these days, it seems.

For instance, my Rank Write site which has hundreds of content-rich pages, has only 2 pages in Inktomi it appears. That's pathetic. How can they be comprehensive when they only add most pages if you pay? Blech...

Oops...just did some additional checking, it appears they do have more than 2 of mine in. Just hard to tell how many. They don't seem to come up when typing in rankwrite or the URL.

Jill

[markymark]

Inktomi will spider your site and it will get included eventually - but this has nothing to do with paid inclusion, it will just follow inbound links from other sites.

Be patient and you will get the other pages (or at least some of them ) in eventually.

[MakeMeTop]

I found 87 pages with this search Jill at Hotbot UK (http://www.hotbot.lycos.co.uk/result.html?query=rankwrite&bool=all&z=1111121111111111211&languagefield=any&numresult_field=10&description_field=full&domain=www.rankwrite.com&bpo=checkbox&uk=ww&qm=rankwrite&hs=s)

The way I search is look for a unique phrase on each page then do a search just in the URL. Gives a fair idea of how many pages are indexed.

[ihelpyou]

Welcome to the forums laetoli! :hi:

Yep, the above advice is good. You just have to be patient but they never will index ALL of your good information. They are very flawed about that and are not a comprehensive search engine database like Google is. They never will be because they are more money hungry. Not a bad thing, I guess, but does not serve them well at all.

[Advisor]

Thanks, MMT. I tried doing that in the "Pure Inktomi" search engine from Position Tech, but couldn't get all the results to show for some reason. Good to know they're at least indexing most of the important pages of the site. (Don't get much traffic from Ink engines though!)

Jill

[mcfleet]

Jill,

Try searching at this PT Inktomi link instead Pure Search (http://169.207.238.189) , you'll get a more accurate list of pages that are listed in Inktomi. It shows you have 89 pages.

[Advisor]

McFleet, that's the place where I was searching. PositionTech's pure inktomi search. What did you use for your query to get the results. When I tried "rankwrite" the other day it gave me 2 results. But hmm....doing it now, I see all the other ones. Strange! Maybe just a glitch yesterday I guess.

Jill

[mcfleet]

Jill, I just searched on your domain name.

The difference in the results is the URL in the above post is slightly different than where you probably originally went to. Most likely you originally checked at http://169.207.238.189/search/search.pl
the URL I sent you to is- http://169.207.238.189 .
The screens look identical, but give you completely differant results. The first URL won't tell you all the sites that are listed in Inktomi, it will list all the paid sites (on occasion not even those)and some free sites. The second URL will list all sites in Inktomi, paid, free and BOW.

[Advisor]

Thanks, Charlie! Good info to have. I never realized there could be different interfaces/results!

Jill

[Alan Perkins]

Jill

I know you know about the page on our site here:

http://www.searchmechanics.com/look/look.htm

because you linked to it from RankWrite!

Using that page I generated a Hotbot lookup for rankwrite.com (http://hotbot.lycos.com/?MT=domain%3Awww%2Erankwrite%2Ecom&SQ=1&TR=1&RD=DM&Domain=www%2Erankwrite%2Ecom) and found more than 200 pages.