shtml and search engines

Posted on 2003-11-05
Last Modified: 2012-05-04
Ok, i am not sure where to ask this so i will ask it here as i am using perl SSI.

I am working on making a site with a shopping cart, i want to add in some nice features (using SSI) but i need to be sure that using ssi will not hurt my search engine rankings, does anyone know if using ssi will hurt my rankings on search engines?

also, i was told that using blah.cgi?blah=blah&blah=blah is looked down on through search engine bots, is this true? the site i am building is going to be in a VERY flooded market so search engine ranking is going to be vital to my success.

Thank you for any help.
Question by:tcompany
LVL 20

Expert Comment

ID: 9688578
A: Search engines cannot tell whether you are using SSI if you arrange your web server (can I assume it's Apache) to process certain .html files for SSI. See the comments about the XBitHack at

B: Most bots will not spend time looking at dynamically generated pages from a URL that's clearly a CGI script. If you want the content to be spidered, you have to arrange for the bot to think it's a bunch of static web pages.


Author Comment

ID: 9688754
do i need to have root access to do this or can i do this just in selected directories with .htaccess file?
LVL 20

Accepted Solution

jmcg earned 63 total points
ID: 9689393
I don't know for certain, but my reading of that documentation page indicates you can put the directives in a .htaccess file.
Better Security Awareness With Threat Intelligence

See how one of the leading financial services organizations uses Recorded Future as part of a holistic threat intelligence program to promote security awareness and proactively and efficiently identify threats.

LVL 18

Expert Comment

ID: 9689441
FWIW, Google indexes our cgi pages just fine.
LVL 51

Assisted Solution

ahoffmann earned 62 total points
ID: 9697003
A.(as said) a robot does not see any SSI
B. "I am using perl SSI"
   what does this mean? perl does not use SSI.
   If your perl generates pages with SSI, your web Server most likely does not deliver what you expect' I only know of apache 2.x which can do that (if configured properly)
C. pages with SSI can be part of .htaccess, you even can include only parts which are protected
LVL 20

Expert Comment

ID: 10049465
Nothing has happened on this question in more than 8 weeks. It's time for cleanup!

My recommendation, which I will post in the Cleanup topic area, is to
split points between jmcg and ahoffman.


EE Cleanup Volunteer

Featured Post

Free Trending Threat Insights Every Day

Enhance your security with threat intelligence from the web. Get trending threat insights on hackers, exploits, and suspicious IP addresses delivered to your inbox with our free Cyber Daily.

Join & Write a Comment

I've just discovered very important differences between Windows an Unix formats in Perl,at least 5.xx.. MOST IMPORTANT: Use Unix file format while saving Your script. otherwise it will have ^M s or smth likely weird in the EOL, Then DO NOT use m…
I have been pestered over the years to produce and distribute regular data extracts, and often the request have explicitly requested the data be emailed as an Excel attachement; specifically Excel, as it appears: CSV files confuse (no Red or Green h…
Explain concepts important to validation of email addresses with regular expressions. Applies to most languages/tools that uses regular expressions. Consider email address RFCs: Look at HTML5 form input element (with type=email) regex pattern: T…
This video discusses moving either the default database or any database to a new volume.

708 members asked questions and received personalized solutions in the past 7 days.

Join the community of 500,000 technology professionals and ask your questions.

Join & Ask a Question

Need Help in Real-Time?

Connect with top rated Experts

12 Experts available now in Live!

Get 1:1 Help Now