Strange dance?

[ric_harris]

Hi,

I have a metasearch site recently on line (from 3 or 4 of september).

15 days ago i put a link from another site and google get my new site from the first day.

The site is a search engine, but i build 5000 pages results as static content (thinking on search engines) and the possibilitie to search on real time.

My site offers result per year form 1960 to 1999 (its about artists)

My site has 5 levels:

1.- Main page

2.- Decade index pointing to every year

3.- Year index pointing to 4 pages (every page with 25 results)

4.- the 4th part of every year with 25 results for the main artists

5.- result page itself for every artist with something like 20~30 links for every artist.

I have to do it in this way to avoid having more than 100 links per page (the 100 results for year plus the banners, navigation, etc)

Google is crawling something like 100 pages in daily basis.

Every 3th day it show for some hours some of the pages as results in google, then -after those fe hours in google- only the main page are available but the rest has gone.

The first time shows 40, the next time shows 75 (the same 40 plus 35) and tonight is showing 115 (the same 75 plus 40).

In fact tonight i can see that google has crawled 502 pages since the first day (today crawl something like 100 pages).

My question is:

What is here happening?

Did someday my pages will stop showing only a few hours and will show all the indexed pages?

What does the rate (500 pages crawled but shows 115 only) means:

Google only likes those 115?
Dosent mean nothing?

Could i spect that finally all the pages crawled will be showed?

Remember that all my results pages are very similar, only change the name of the artist and the urls in the links, etc. but the structure are almost the same on every result page.

Is this the Google Dance?

One more point:

By a mistake i upload one of the pages (named top searches) void, it only has the template of my site (navigation bar, banners, etc) but no real content, just the word "results" and this is one of the pages that google is showing tonight.

That makes me think that Google is not selecting pages that "he likes" or Google has strange preferences...:p

In the other hand, if all my results pages are similar (As google results pages are very similar to other google results page), i dont think that google preffer some artist :p so i cant understand if google could apply some criteria to select which pages to index (suppousing that not all crawled pages will be indexed).

Well, sorry for the large question, but i want to be clear.

Thanks in advance if anyone explain me what is happening and what can i expect from this situation.

Thanks:D

[Farhan]

Okay, I'll try a few :)

Every 3th day it show for some hours some of the pages as results in google, then -after those fe hours in google- only the main page are available but the rest has gone.

That's nothing to worry about. Google only has one link from an outside site to reach to your site. The day it skips crawling the site linking to you, it leaves you out as well. That's pretty normal for new sites.

What does the rate (500 pages crawled but shows 115 only) means:

Once your site acquires a decent page rank, all your pages will show up regularly. If you have duplicate content on various pages, Google might keep only one page and ignore the rest.

Hope this helps.

[Bernard]

Could i spect that finally all the pages crawled will be showed?

Get more links to improve stickyness in the index. Get links directly to your deep content. Didn't we discuss this already? (http://www.ihelpyouservices.com/forums/showthread.php?s=&threadid=9613&perpage=10&pagenumber=3)

Remember that all my results pages are very similar, only change the name of the artist and the urls in the links, etc. but the structure are almost the same on every result page.

I would recommend ensuring that the title tag is unique for every page.

[ric_harris]

Originally posted by Bernard
Get more links to improve stickyness in the index. Get links directly to your deep content.

Yes, we discuss it and i get the point, but what i wasnt sure is why google shows 115 during a few hours and then fade out those pages and why crawl 500 and shows only 115.

One question:

Does Google consider search results (from google, altavista, etc) as links?

If i link from my other site to a searchengine results page that points to my page, will google take it as incoming links?

I would recommend ensuring that the title tag is unique for every page.

Yes, every page has its own title and tags.

[Bernard]

Just because Google crawls a page does not mean that it will stick in the index. Google sometimes displays newly crawled results for a short period of time and then they disappear. If they return more permanently later, they are said to "stick" to the index.

Most major search engines disallow their search results from being crawled and included in another search engine's index. Google probably would not include them even if they were not disallowed. Why answer a search query with another engine's idea of the most relevant pages?

[ric_harris]

Originally posted by Bernard
Most major search engines disallow their search results from being crawled and included in another search engine's index. Google probably would not include them even if they were not disallowed. Why answer a search query with another engine's idea of the most relevant pages?

Ok, i was only trying to show google that other searchengines have links to my page and as searchengines has big PR...

[ric_harris]

Some news:

My site is getting good traffic.

Now i have 247 pages indexed on Google (247 of 5,000) and im starting with nice traffic!!

According to Alexa i was on position 4,110,413 because the 3 months average (and my site uploads the 4 of september).

But today i am in place: 53,992 !!!!!!!!!!!!!!!!!!!!

Wooowwww

I know that maybe Alexa its not to confident, but it shows the big jump, and must are because Google!

I think that my site was going to take 3 months to get on google and after 15 days uploaded im growing!!

Just want to say thanks to all suggestions, because it works!!!!!!!

:cheers:

[ihelpyou]

Nice job ric! :thumb:

[Bernard]

:cheers:

[Dan0]

Ric:

Congrats! :cheers:

Looks like you've got a nice site, and a very nice tool.

One usability critique for you:

The banners/links from MP3 Oldies go directly to your MP3 Doctor download page, where a download starts immediately. That's probably not what users will expect, and it would be better to send them to a page that describes the application, system requirements, etc.

I'd suggest having a "download now" button+link on that page, instead of instantly pushing the file to the browser.

[ric_harris]

Originally posted by Dan0
Ric:

Congrats! :cheers:

Looks like you've got a nice site, and a very nice tool.

One usability critique for you:

The banners/links from MP3 Oldies go directly to your MP3 Doctor download page, where a download starts immediately. That's probably not what users will expect, and it would be better to send them to a page that describes the application, system requirements, etc.

I'd suggest having a "download now" button+link on that page, instead of instantly pushing the file to the browser.

Yeap, i think you are right.
I will change it.

BTW, the site is getting more traffic!! And a very nice 'page per visitors': 8 ~ 17 average!!

What i need to do is to 'convince' Google to go deeper, im changing my index links (that point to deep pages) everyday and i think Google is eating from my hands now 8) ha ha (its a joke!)

But seriously, i wasnt aware that the 'top downloads', etc. cells in the front of a site was a good way to drive Google to a deeper look, now im learning.

Thanks again for all your advices, im learning a lot from this forum.

[ric_harris]

In fact, the blogger tip that i read somewhere in this froum is pure ****, i start 2 days ago and its working... i just discovered that google follow the links that i put in my blog in www.blogger.com and now its crawling deeper.

And about this thread of Google Dance:

It seems that Google is updating now very fast and all the time. ¿i am right

[OptWizard]

With the bog do you host it at blogger or put on your own website?

Thoughts

[ric_harris]

Originally posted by OptWizard
With the bog do you host it at blogger or put on your own website?

Thoughts

I use the blogger hosted.
And searching at google, irs was crawled very often.
So everytime Google crawls it it goes for every lniks that found there.

One tip:

The Blog has some column dedicated to the links, but until now Google ignore those links. In my case, it only follows the links that are in the main text, as a part of the content.

[OptWizard]

Can you please explain this further I am ver interested in this blogging...

So say I write a little blog and in the blog include a link google will follow that link?

How does it get to your blog page?

[ric_harris]

Originally posted by OptWizard
Can you please explain this further I am ver interested in this blogging...



Somwhere in this forum, there are a very instructive discussion about this matter.

So say I write a little blog and in the blog include a link google will follow that link?

How does it get to your blog page?

Yes. Not at this moment, but a few days (2~3).

Google find it because Blogger is property of Google Inc.;)

But however, all big sites that are updated daily, has a google visit in daily basis.

When you publish you blog (every time you write something) you get to a 'most recent updates' of Blogger and Google check there.

So update 2 or 3 times a day (Write something) and Google will be reading your Blog.

In fact, only Google reads mine, but its my favorite fan!!!

[Bernard]

Perhaps Ric was referring to Microdoc's How to Get Listed In Google in 30 Days (http://www.ihelpyouservices.com/forums/showthread.php?s=&threadid=7144)

[OptWizard]

OK I thinkg I get it

Say I mak e ablog about widgets...
it will be hosted at http://sitename.blogspot.com, correct

Google will then spider that page and follow links that you add to that page correct?

Is this how it works

does what you call the page mean anything (meaning http://keyowrd.blogspot.com or http://whatever.blogspot.com) or is it just the way you use hypertext?

[Bernard]

Yes. You are on the right track. Google apparantly follows blog links frequently. Use the good anchor text (hyperlink text) within your blog copy.

[OptWizard]

I actually want to blog for business and pleasure..I will become a blogging fool...

Does the name of URL matter for blog

[OptWizard]

So is it better to FTP you blogs to your site so it is on your server or use googles blog hosting?

[ric_harris]

Google will then spider that page and follow links that you add to that page correct?

Is this how it works

does what you call the page mean anything (meaning http://keyowrd.blogspot.com or http://whatever.blogspot.com) or is it just the way you use hypertext? [/B]

Yes.

I think that the 'subdomine' name isnt important, but to be sure try to use some related name.

I dont use FTP, but cant tell you if that makes a difference.

I start using it when read the tip here, and 3 days ago i notice that google has followed the links i put into the blog, crawled and is showing it as results, all in 3 days just as the forums says!!!!

Just try to write something several times a day to keep you blog up in the 'recent' list.