Virtual Hosting and Robot.txt
Posted on 2006-06-15
I have 2 websites running on my web server. I am running Linux and Apache.
My question is: How do I get my robots.txt files working for both domains?
Do I just both a robot.txt in each of the website root directories? If so, I have done that. But my second website still is not coming up. My first website is still showing old stuff for 6 months ago when I search in google for it. I have updated my site since then with major changes.
But the main one I am concerned about is the second website. Here is a week, it will be fully functional and I want it to come up in google or other.