Search engine indexing and frames
Posted on 1997-05-12
Do search engine indexing robots include pages within framesets on the same basis as other pages?
The scenario I'm thinking of: the usual two frames, one with navigation links and the other displaying the documents you select. The frameset document is linked from a homepage. It contains a <FRAME SRC=...> reference to the navigation frame document, which in turn contains <A HREF=...> links to the text documents.
Will a robot find the SRC= link, or will it only see any <A HREF=...> links in the <NOFRAMES> part of the frameset?
If it does follow the SRC= link, I guess it will then find the links to individual text documents and index them. But anyone retrieving these documents alone, through a reference from the search engine, may find them meaningless - or more likely, will want to see other related documents from the same site but can't locate them - because they weren't designed to be viewed alone, only as part of the frameset. The frameset itself probably contains no relevant terms, so it won't be found by a search.
If the robot doesn't follow the SRC= link, it won't find the relevant stuff at all - except (perhaps) in the <NOFRAMES> alternative version.