I am developing a document management system in ASP for our company's intranet. We have employees all over the country so the intranet is accessible by login/password.
The database I am using (MS SQL Express) has a size limit of 4GB so instead of storing the files inside the database I have to drop the physical files inside folders on the web site.
I know there are web site download programs that will troll your site and grab every file it can.
I am worried about people outside the company AND even employees accessing files they should not see (as some of the files would only be viewable by some employees).
Is there a way I can block this from happening? We have a dedicated windows server so I can change IIS settings, etc if needed.
I'm looking for any ideas.
For instance, suppose you have the files in the file system and you just map the directory in IIS to give direct access. That way only normal HTTP-level security (basic auth and challenge / response auth) is possible, which is easily hacked but can be just what you need.
If you have scripts doing the security for you, you can also use these scripts to allow / prevent access to these files. In that case, you'll have to hide them behind a proxy (for instance), so that the user sees a link relative to your site and you internally redirect that to the file.