We are putting together a business plan for a new venture and there is one part that I need to get some clarity on. Online storage. This project might take up 500-800 TB of space. I am a LAN network guy and none of my networks has anything over 2 TB so my questions is, what is the best way to create an environment that can handle that amount of data? Most of the files will be 500-600MB. I have 5Gbps bandwidth that we can easily increase and plenty or physical storage space and power.
1) I am most familiar with Windows but the 2TB volume size limit is a problem. Or is it?
2) I am not afraid of LINUX but what limitations would I run into with that?
3) What would the hardware setup on a large storage system like this look like? I.E. what components would I need to put together?
4) I have a pretty strong feeling that in the end, we will have to hire a company to design/build something like this like IBM or someone but I want some info so I am not just accepting the recommendation blindly.