I need to ask about robot.txt behaviour.
I have a folder '/var/www/html/images/stories/*'
and my robot.txt disallow folder '/images/'
I make a subdomain: 'images.mydomain.com' that point to '/var/www/html/images/'
will search engine crawl to my subdomain: 'images.mydomain.com/' ?
I want the search engine can crawl into my subdomain but disallow to crawl '/images/*'
is it possible?
or I should make a new pointed folder for my subdomain?
If I make a new pointed folder: /var/www/html/advertImage/
do the search engine get the address 'www.mydomain.com/advertimage/' or 'images.mydomain.com/' ?
Please kindly advise.