googlebot is looking for pages in the wrong site (.cz instead of .net)

Hello coreybryant,
thank you for your response. I know about pagerank, googledance and keywords density factors. (BTW some people thinks, that google dance is gone, and Google is updating it's index all the time and there are no difference between google freshbot and google deepbot now).

The link to the forum looks nice, I'll try to ask them.

My problem is, that dropping my site from the index looks like a ban, and I don't know what is wrong with the site. Google bot is visiting rebex.net website once a day (for about o month), but it downloads only homepage and robots.txt. I've tried to contact Google, with no response.

Some of my pages are even in Google directory (http://www.rebex.net/rconvlog) which is in http://directory.google.com/Top/Computers/Software/Internet/Site_Management/Log_Analysis/Related_Utilities/, but this page is also not crawled :-(

Also just curious, all your pages are linked & most can be reached withing two-three clicks?  This will really help you as well.

-Corey

AFAIK yes. Most pages are only two click from the homepage. You select product, than select one of detail pages.

That is always good.  I do not knw if it might be because it is a CZ domain & since google.com is primarily English it might think yours is in another language?  What about using the Language Tools?  Does that bring up your site in the correct place there?  Checking the google tool bar, it does seem you are fairly up there on the CZ site actually.  Do you have some US based customers as well?

-Corey

I guess another reason I am asking - I have had a quote for about $500 to complete two websites (one .NET / one ASP).  Almost everything is done - e-commerce.  And trying to read thru the CZ site - not too sure if you guys do that?  If you would like, I am working on the overview now - I could send it to you & maybe get a quote.  I'll send you links etc.

Thanks!

-Corey
(crb@coreybryant.org)

There is no problem with cz domain. Rebex.cz is indexed very well by the Google. Problem is with rebex.NET domain (which is in English).

Rebex.net is focused on creating and selling .NET components for developers worldwide, we have customers from USA, EU, even from Island and Korea. Being dropped from the google means singnificant decrease of visitors/new customers count :-(

For the .net development - yes, we can do it. I'll send you details in email...

Sounds great.  Well that one still show up fairly well on the google tool bar.  I would suggest maybe adding .NET / programmers or something to your title.  That might help some since Google does look at the title more and the online content.

-Corey

Ok, I'll think about it. Our .net site is primary for selling components to developers. I don't want Rebex to look as their offshore competition...

Thanks duz for your excelen comment!

> search engines index pages not websites

I'm aware of it. http://www.rebex.net/rconvlog/ page is included in both DMOZ and Google Directory for more that 6 motnth and now is not indexed. Homepage is neither in DMOZ nor Google Directory and is indexed.

There are even more backlinks to http://www.rebex.net/ftp.net/ than to http://www.rebex.net/ and first one is not indexed, and homepage is. Strange, isn't it?

> change meta name "description"

done

> change meta name "keywords"

done. Personaly I'm a bit skeptic about this one - afaik meta name keywords is widely ignored by search engines, but give it a try.

> insert following text...

done.

I've also added "ftp.net" and "image gallery" absolute hyperlinks to their pages (rest of the site is using relative hyperlinks).

Googlebot is still visiting homepage once a day and is ignoring all other pages, so let's wait a few days and give it a chance...

Hello coreybryant,
I'll check those forums...

martinv

martinv ...afaik meta name keywords is widely ignored by search engines

coreybryant  ...You are right about the Meta tag martinv.  Most SE do not pick up on them

In fact only one common search engine that I know of completely ignores meta name="KEYWORDS" and it is not Google. I would agree that it is only a minor ranking factor but attention to the many minor factors all add up in the end to a major factor.

martinv ...rest of the site is using relative hyperlinks

Always use absolute hyperlinks it's better for the search engines.

- duz

> In fact only one common search engine that I know of completely ignores meta name="KEYWORDS" and it is not Google. I would agree that it is only a minor ranking factor but attention to the many minor factors all add up in the end to a major factor.

Sounds interesting. Which one?

> Always use absolute hyperlinks it's better for the search engines.

I've never heard about it. Why are absolute links much better? Can you post url with more info about this?

Absolute links are IMHO bad for site development. You cannot test bad links on development machine for example and all testing must be done on the live server. All my other sites (e.g. rebex.cz which is build on exactly the same engine) are using only relative urls and has no problem with Google.

martinv - Sounds interesting. Which one?

Lycos (from my own ongoing research - last test in April this year)

martinv - Can you post url with more info about this?

Here is one that gives some of the ideas http://www.searchengineworld.com/newsletter/1999/q3/absolute.htm

martinv - Absolute links are IMHO bad for site development.

You can use a utility to change the links to absolute after testing. I agree it is an extra step but it is worth doing.

- duz

Thank you for the link. I've googled it and it looks like it's ongoing debate and sort of religious question (like Which OS is better - Windows or Linux?) :-)

BTW - It's from newsletter which is 4 years old - quite a lot of things has changes in SEO world from 1999 to 2003.

I'll think about it..

martinv - it looks like it's ongoing debate and sort of religious question (like Which OS is better - Windows or Linux?) :-)

I know what you mean. But look at this way there are some advantages to absolute links and only one disadvantage, which is the one you mentioned and that is not an SEO disadvantage it is a practical one that is easily overcome.

martinv - It's from newsletter which is 4 years old

Yes but the reasons are still valid, it is just that more reasons have been noted since. For example if your domain was made up from keywords like programming-net-components.com there is another advantage in absolute links. (btw you should change your directory names to keywords e.g. /ftp.net --------> /components-ftp-net two hyphens max).

martinv - quite a lot of things has changes in SEO world from 1999 to 2003.

Not only in the last 4 years but sometimes in the last 4 hours :(

- duz

for changing directory names:
It could improve position in search results. But I was quite satisfied with position (pos 2-5 on the first pagefor my keywords) one moth ago. My problem is that I'm now dropped from the index :-(.

I preferer not to change it now, because there are a lot of backlinks to current directory structure.

Well it is up to you but http://www.rebex.net/ftp.net/default.aspx was probably dropped because Google bots can get very confused when they come across names with a 'dot' in. The Google algo is complex but the Google bots are very simple (as they must be visiting so many pages). The underscore and hyphen, A-Z, a-z, and 0-9 are safe but nothing else is safe. The under score should not be used, even though it is safe with the google bot, for other reasons.

Hmm, it could be that case, but why are dropped all other pages?

Why is dropped /ImageGallery folder (http://www.rebex.net/ImageGallery)? It has no strange character in the url.

It's even in the Google Directory - http://directory.google.com/Top/Computers/Programming/Component_Frameworks/NET/Tools/Components/Image_Rendering/)

Same question for /RConvLog folder (http://www.rebex.net/RConvLog)

which is also in the Google Directory -
directory.google.com/Top/Computers/Software/Internet/ Site_Management/Log_Analysis/Related_Utilities

Both are dropped from the index (and googlebot is trying to find them on rebex.cz instead of rebex.net - even if both of them has quite a lot of backlinks to rebex.net from external sites).

IMHO Google bot has no problem with ".". See results for "asp.net" http://www.google.com/search?hl=en&lr=&ie=UTF-8&oe=UTF-8&q=%22asp.net%22

For example there is "msdn.microsoft.com/asp.net/using/ migrating/jspmig/default.aspx" on the first page of results.

martinv - ...but why are dropped all other pages?

I do not know the exact mechanism of the bot malfunction, all I can say for sure is that some of the Google bots get confused and do strange things when they see a "." in a sub directory.  Also I can say that on my clients sites where we stick to the characters I mentioned we have never had any problems with any bot spidering all the pages. (I am talking millions of pages here).

martinv - IMHO Google bot has no problem with "."

I did not say that they would ALWAYS have a problem, in fact there are many, many indexed pages that have "." character. What I did say was that it is NOT SAFE because sometimes some of the Google bots do have a problem with it - which is not the same thing. For example it used to be  true that Google bots could never understand a url with a "?" in it - now they can but not every time (it is getting better though) so why use it?

- duz

Ok,
I get it. I'll not change it now (because of backlinks - see Googleguys First Rule TM: "Get a lot of backlinks") but will consider it with next site redesign.