Solved

File Server Storage Planning

Posted on 2010-11-11
10
510 Views
Last Modified: 2012-05-10
I am planning a large file server and I would like your advice and suggestions.  We currently have 4TB of data and I anticipate, based on growth history, we will grow to 25TB within the next 5 years. I am planning our storage infrastructure for this.  Our files are 95% .jpg files and 5% word documents, excel docs and other misc. documents.  We have 2 servers.  One in building A and one in Building B (DR Site) that are connected via GB LAN.  The plan is to replicate the data from serverA to ServerB using DFSR.  This will provide high availability in the event of a failure on ServerA.  We also have a 3rd server in buildingB that is a DPM2010 server which will backup this data.

I am trying to decide between to options and would like to know your input and advise.

Option 1:  Split our data into 4 volumes and then grow those volumes over time by adding storage and spanning each disk as necessary.

Option 2:  Put all data on the same volume and grow that one volume over time by adding storage and spanning the disk.

 Taking into account our scenario, which decision do you recommend and why?
0
Comment
Question by:ITPro44
[X]
Welcome to Experts Exchange

Add your voice to the tech community where 5M+ people just like you are talking about what matters.

  • Help others & share knowledge
  • Earn cash & points
  • Learn & ask questions
  • 5
  • 5
10 Comments
 
LVL 22

Expert Comment

by:Matt V
ID: 34113897
Disk volumes generally have performance issues (if not compatibility issues) around 2TB.  I would suggest you examine how much of your data is accessed on a regular basis and consider tiered storage where you would put "in use" files (determined by last access date) on the faster media, and migrate the older files to slower cheaper storage in whichever array will work.
You may wish to consult with HP/Dell/IBM (whomever you are using for storage) on this type of setup.
You would defiantely see better performance on the files that are frequently accessed.  
0
 

Author Comment

by:ITPro44
ID: 34114102
thanks Matt, that is a good suggestion.  At this point in time our hardware has been purchased and we are invested in the current infrastructure described above.  I think this will be something we consider next time this project rolls around.

You mentioned that volumes have performance and possibly compatibility issues around 2TB.  Can you expand on your knowledge of this?
0
 
LVL 22

Accepted Solution

by:
Matt V earned 500 total points
ID: 34115408
I know with many SANs I have worked on there is a manufacturer recommended 2TB limit on LUNs, due to the performance degrading significantly after this size.
Also, Windows and other OSes have limitations on partition and volume sizes that are architecturally enforced outside of performance issues.
"If you're planning on booting to a disk or RAID volume that is greater than 2TB, be aware that the only way this is supported is with x64 versions of Vista or 2008, using GPT partitioning scheme, and using an EFI BIOS.  Doing so would put you on the bleeding edge, and I wouldn't recommend it.  
Also note that the 2TB limit is not strictly speaking a limit on the partition size, it's actually a limit on the sice of disk that the MBR partitioning scheme can address.  MBR can address a maximum of 2^32 sectors.  Each sector is usually 512 bytes.  Hence, 4 billion * 512 = 2 trillion -> hence the 2TB limit.  
As stated above, GPT should handle a 12TB non-boot partition without a problem. "
-- From: http://www.experts-exchange.com/OS/Microsoft_Operating_Systems/Server/Windows_Server_2008/Q_23913594.html
0
Technology Partners: We Want Your Opinion!

We value your feedback.

Take our survey and automatically be enter to win anyone of the following:
Yeti Cooler, Amazon eGift Card, and Movie eGift Card!

 

Author Comment

by:ITPro44
ID: 34122702
I do not plan to boot from this partition is will be for data only.  Have you, or is there anyone else who has had experience with 20TB+ volumes that can provide me with some guidance or best practices for configuring and managing large volumes?
0
 
LVL 22

Assisted Solution

by:Matt V
Matt V earned 500 total points
ID: 34122736
We currently store about 20TB, but all in 2TB chunks :)
0
 

Author Comment

by:ITPro44
ID: 34122817
:)  What is your reasoning for storing it in 2TB chunks?
0
 
LVL 22

Expert Comment

by:Matt V
ID: 34122912
Vmware limitation on storage luns.
0
 

Author Comment

by:ITPro44
ID: 34123041
gotcha.  Do you span your volumes or use something like DFS?
0
 
LVL 22

Expert Comment

by:Matt V
ID: 34124167
Currently we do not have any volumes larger than 1.5TB, so we have been lukcy.  Ask me next year though and I might have a different answer.
0
 

Author Closing Comment

by:ITPro44
ID: 34232023
Thanks for your help.
0

Featured Post

Secure Your WordPress Site: 5 Essential Approaches

WordPress is the web's most popular CMS, but its dominance also makes it a target for attackers. Our eBook will show you how to:

Prevent costly exploits of core and plugin vulnerabilities
Repel automated attacks
Lock down your dashboard, secure your code, and protect your users

Question has a verified solution.

If you are experiencing a similar issue, please ask a related question

This article aims to explain the working of CircularLogArchiver. This tool was designed to solve the buildup of log file in cases where systems do not support circular logging or where circular logging is not enabled
Concerto Cloud Services, a provider of fully managed private, public and hybrid cloud solutions, announced today it was named to the 20 Coolest Cloud Infrastructure Vendors Of The 2017 Cloud  (http://www.concertocloud.com/about/in-the-news/2017/02/0…
This tutorial will walk an individual through locating and launching the BEUtility application and how to execute it on the appropriate database. Log onto the server running the Backup Exec database. In a larger environment, this would generally be …
This tutorial will walk an individual through setting the global and backup job media overwrite and protection periods in Backup Exec 2012. Log onto the Backup Exec Central Administration Server. Examine the services. If all or most of them are stop…
Suggested Courses

623 members asked questions and received personalized solutions in the past 7 days.

Join the community of 500,000 technology professionals and ask your questions.

Join & Ask a Question