Still celebrating National IT Professionals Day with 3 months of free Premium Membership. Use Code ITDAY17

x
?
Solved

File Server Storage Planning

Posted on 2010-11-11
10
Medium Priority
?
512 Views
Last Modified: 2012-05-10
I am planning a large file server and I would like your advice and suggestions.  We currently have 4TB of data and I anticipate, based on growth history, we will grow to 25TB within the next 5 years. I am planning our storage infrastructure for this.  Our files are 95% .jpg files and 5% word documents, excel docs and other misc. documents.  We have 2 servers.  One in building A and one in Building B (DR Site) that are connected via GB LAN.  The plan is to replicate the data from serverA to ServerB using DFSR.  This will provide high availability in the event of a failure on ServerA.  We also have a 3rd server in buildingB that is a DPM2010 server which will backup this data.

I am trying to decide between to options and would like to know your input and advise.

Option 1:  Split our data into 4 volumes and then grow those volumes over time by adding storage and spanning each disk as necessary.

Option 2:  Put all data on the same volume and grow that one volume over time by adding storage and spanning the disk.

 Taking into account our scenario, which decision do you recommend and why?
0
Comment
Question by:ITPro44
[X]
Welcome to Experts Exchange

Add your voice to the tech community where 5M+ people just like you are talking about what matters.

  • Help others & share knowledge
  • Earn cash & points
  • Learn & ask questions
  • 5
  • 5
10 Comments
 
LVL 22

Expert Comment

by:Matt V
ID: 34113897
Disk volumes generally have performance issues (if not compatibility issues) around 2TB.  I would suggest you examine how much of your data is accessed on a regular basis and consider tiered storage where you would put "in use" files (determined by last access date) on the faster media, and migrate the older files to slower cheaper storage in whichever array will work.
You may wish to consult with HP/Dell/IBM (whomever you are using for storage) on this type of setup.
You would defiantely see better performance on the files that are frequently accessed.  
0
 

Author Comment

by:ITPro44
ID: 34114102
thanks Matt, that is a good suggestion.  At this point in time our hardware has been purchased and we are invested in the current infrastructure described above.  I think this will be something we consider next time this project rolls around.

You mentioned that volumes have performance and possibly compatibility issues around 2TB.  Can you expand on your knowledge of this?
0
 
LVL 22

Accepted Solution

by:
Matt V earned 2000 total points
ID: 34115408
I know with many SANs I have worked on there is a manufacturer recommended 2TB limit on LUNs, due to the performance degrading significantly after this size.
Also, Windows and other OSes have limitations on partition and volume sizes that are architecturally enforced outside of performance issues.
"If you're planning on booting to a disk or RAID volume that is greater than 2TB, be aware that the only way this is supported is with x64 versions of Vista or 2008, using GPT partitioning scheme, and using an EFI BIOS.  Doing so would put you on the bleeding edge, and I wouldn't recommend it.  
Also note that the 2TB limit is not strictly speaking a limit on the partition size, it's actually a limit on the sice of disk that the MBR partitioning scheme can address.  MBR can address a maximum of 2^32 sectors.  Each sector is usually 512 bytes.  Hence, 4 billion * 512 = 2 trillion -> hence the 2TB limit.  
As stated above, GPT should handle a 12TB non-boot partition without a problem. "
-- From: http://www.experts-exchange.com/OS/Microsoft_Operating_Systems/Server/Windows_Server_2008/Q_23913594.html
0
What is SQL Server and how does it work?

The purpose of this paper is to provide you background on SQL Server. It’s your self-study guide for learning fundamentals. It includes both the history of SQL and its technical basics. Concepts and definitions will form the solid foundation of your future DBA expertise.

 

Author Comment

by:ITPro44
ID: 34122702
I do not plan to boot from this partition is will be for data only.  Have you, or is there anyone else who has had experience with 20TB+ volumes that can provide me with some guidance or best practices for configuring and managing large volumes?
0
 
LVL 22

Assisted Solution

by:Matt V
Matt V earned 2000 total points
ID: 34122736
We currently store about 20TB, but all in 2TB chunks :)
0
 

Author Comment

by:ITPro44
ID: 34122817
:)  What is your reasoning for storing it in 2TB chunks?
0
 
LVL 22

Expert Comment

by:Matt V
ID: 34122912
Vmware limitation on storage luns.
0
 

Author Comment

by:ITPro44
ID: 34123041
gotcha.  Do you span your volumes or use something like DFS?
0
 
LVL 22

Expert Comment

by:Matt V
ID: 34124167
Currently we do not have any volumes larger than 1.5TB, so we have been lukcy.  Ask me next year though and I might have a different answer.
0
 

Author Closing Comment

by:ITPro44
ID: 34232023
Thanks for your help.
0

Featured Post

Migrating Your Company's PCs

To keep pace with competitors, businesses must keep employees productive, and that means providing them with the latest technology. This document provides the tips and tricks you need to help you migrate an outdated PC fleet to new desktops, laptops, and tablets.

Question has a verified solution.

If you are experiencing a similar issue, please ask a related question

This article explains how to install and use the NTBackup utility that comes with Windows Server.
Resolving an irritating Remote Desktop connection that stops your saved credentials from being used.
This tutorial will show how to push an installation of Backup Exec to an additional server in both 2012 and 2014 versions of the software. Click on the Backup Exec button in the upper left corner. From here, select Installation and Licensing, then I…
This Micro Tutorial hows how you can integrate  Mac OSX to a Windows Active Directory Domain. Apple has made it easy to allow users to bind their macs to a windows domain with relative ease. The following video show how to bind OSX Mavericks to …

721 members asked questions and received personalized solutions in the past 7 days.

Join the community of 500,000 technology professionals and ask your questions.

Join & Ask a Question