Solved

File Server Storage Planning

Posted on 2010-11-11
10
509 Views
Last Modified: 2012-05-10
I am planning a large file server and I would like your advice and suggestions.  We currently have 4TB of data and I anticipate, based on growth history, we will grow to 25TB within the next 5 years. I am planning our storage infrastructure for this.  Our files are 95% .jpg files and 5% word documents, excel docs and other misc. documents.  We have 2 servers.  One in building A and one in Building B (DR Site) that are connected via GB LAN.  The plan is to replicate the data from serverA to ServerB using DFSR.  This will provide high availability in the event of a failure on ServerA.  We also have a 3rd server in buildingB that is a DPM2010 server which will backup this data.

I am trying to decide between to options and would like to know your input and advise.

Option 1:  Split our data into 4 volumes and then grow those volumes over time by adding storage and spanning each disk as necessary.

Option 2:  Put all data on the same volume and grow that one volume over time by adding storage and spanning the disk.

 Taking into account our scenario, which decision do you recommend and why?
0
Comment
Question by:ITPro44
  • 5
  • 5
10 Comments
 
LVL 22

Expert Comment

by:Matt V
ID: 34113897
Disk volumes generally have performance issues (if not compatibility issues) around 2TB.  I would suggest you examine how much of your data is accessed on a regular basis and consider tiered storage where you would put "in use" files (determined by last access date) on the faster media, and migrate the older files to slower cheaper storage in whichever array will work.
You may wish to consult with HP/Dell/IBM (whomever you are using for storage) on this type of setup.
You would defiantely see better performance on the files that are frequently accessed.  
0
 

Author Comment

by:ITPro44
ID: 34114102
thanks Matt, that is a good suggestion.  At this point in time our hardware has been purchased and we are invested in the current infrastructure described above.  I think this will be something we consider next time this project rolls around.

You mentioned that volumes have performance and possibly compatibility issues around 2TB.  Can you expand on your knowledge of this?
0
 
LVL 22

Accepted Solution

by:
Matt V earned 500 total points
ID: 34115408
I know with many SANs I have worked on there is a manufacturer recommended 2TB limit on LUNs, due to the performance degrading significantly after this size.
Also, Windows and other OSes have limitations on partition and volume sizes that are architecturally enforced outside of performance issues.
"If you're planning on booting to a disk or RAID volume that is greater than 2TB, be aware that the only way this is supported is with x64 versions of Vista or 2008, using GPT partitioning scheme, and using an EFI BIOS.  Doing so would put you on the bleeding edge, and I wouldn't recommend it.  
Also note that the 2TB limit is not strictly speaking a limit on the partition size, it's actually a limit on the sice of disk that the MBR partitioning scheme can address.  MBR can address a maximum of 2^32 sectors.  Each sector is usually 512 bytes.  Hence, 4 billion * 512 = 2 trillion -> hence the 2TB limit.  
As stated above, GPT should handle a 12TB non-boot partition without a problem. "
-- From: http://www.experts-exchange.com/OS/Microsoft_Operating_Systems/Server/Windows_Server_2008/Q_23913594.html
0
Back Up Your Microsoft Windows Server®

Back up all your Microsoft Windows Server – on-premises, in remote locations, in private and hybrid clouds. Your entire Windows Server will be backed up in one easy step with patented, block-level disk imaging. We achieve RTOs (recovery time objectives) as low as 15 seconds.

 

Author Comment

by:ITPro44
ID: 34122702
I do not plan to boot from this partition is will be for data only.  Have you, or is there anyone else who has had experience with 20TB+ volumes that can provide me with some guidance or best practices for configuring and managing large volumes?
0
 
LVL 22

Assisted Solution

by:Matt V
Matt V earned 500 total points
ID: 34122736
We currently store about 20TB, but all in 2TB chunks :)
0
 

Author Comment

by:ITPro44
ID: 34122817
:)  What is your reasoning for storing it in 2TB chunks?
0
 
LVL 22

Expert Comment

by:Matt V
ID: 34122912
Vmware limitation on storage luns.
0
 

Author Comment

by:ITPro44
ID: 34123041
gotcha.  Do you span your volumes or use something like DFS?
0
 
LVL 22

Expert Comment

by:Matt V
ID: 34124167
Currently we do not have any volumes larger than 1.5TB, so we have been lukcy.  Ask me next year though and I might have a different answer.
0
 

Author Closing Comment

by:ITPro44
ID: 34232023
Thanks for your help.
0

Featured Post

Are your AD admin tools letting you down?

Managing Active Directory can get complicated.  Often, the native tools for managing AD are just not up to the task.  The largest Active Directory installations in the world have relied on one tool to manage their day-to-day administration tasks: Hyena. Start your trial today.

Question has a verified solution.

If you are experiencing a similar issue, please ask a related question

Finding original email is quite difficult due to their duplicates. From this article, you will come to know why multiple duplicates of same emails appear and how to delete duplicate emails from Outlook securely and instantly while vital emails remai…
Many businesses neglect disaster recovery and treat it as an after-thought. I can tell you first hand that data will be lost, hard drives die, servers will be hacked, and careless (or malicious) employees can ruin your data.
This tutorial will walk an individual through configuring a drive on a Windows Server 2008 to perform shadow copies in order to quickly recover deleted files and folders. Click on Start and then select Computer to view the available drives on the se…
This tutorial will walk an individual through the steps necessary to install and configure the Windows Server Backup Utility. Directly connect an external storage device such as a USB drive, or CD\DVD burner: If the device is a USB drive, ensure i…

726 members asked questions and received personalized solutions in the past 7 days.

Join the community of 500,000 technology professionals and ask your questions.

Join & Ask a Question