We have an internally used web system that we do not want outsiders to find on the internet. The owner wants to preclude anyone doing a search & finding it.
I was told if I put a robots.txt file into the root, constructed as attached, this will prevent it from being found by web searches.
I did this & did a search on the site url & it finds it.
Did I do something wrong or is it not possible to block this?