Solved

Linux Deduplication for Backup Server

Posted on 2011-03-08
8
880 Views
Last Modified: 2012-05-11
Ok I think the time (and budget) has come to give Linux a serious look on my network. I am currently in the process of building a new NAS storage point. The entire goal of this storage is to act as a backup location for Symantec Backup Exec. For hardware I am using an Intel SR2612URRNA server with 12 2TB drives in Raid 1+0. The hardware part is easy for me, but when it came time to choose an OS I ran into a bit of a conundrum. I'm comfortable within the MS environment, but I don't really need or want a full blown Server 2008 R2 install here. Also I'd really like OS level Deduplication. I now Backup Exec has a version with deduplication on the client side, but I cannot imagine that is a cost effective way to do it. Plus I'd like the hardware to be easily switched to whatever backup software we choose in the future.

So now my actual questions. First what is the best Linux build to use as a simple NAS? Since I've never even installed a Linux distro I'd prefer a consolidated  package. I've heard opensolaris supports is natively, but there are other projects out there. Any recommendations?

What I'd really like is something very easy to install that can be easily seen as a network share on my AD domain. Burn the ISO, hop through a wizard and good to go would b nice. However I just don't know if Linux is there yet.

0
Comment
Question by:bhieb
[X]
Welcome to Experts Exchange

Add your voice to the tech community where 5M+ people just like you are talking about what matters.

  • Help others & share knowledge
  • Earn cash & points
  • Learn & ask questions
8 Comments
 
LVL 47

Expert Comment

by:David
ID: 35071005
why not go solaris? it has built-in dedup and can do every bit of what you ask ... a lot better than LINUX can.
0
 

Author Comment

by:bhieb
ID: 35071047
That is where I'm leaning actually, just wanted to hear from the Linux guys if there are other options. Guess I will toss it on a box to see what the setup is like. Plus if I get in over my head I can buy a support plan from oracle for an extra safety net.
0
 
LVL 31

Expert Comment

by:farzanj
ID: 35071070
If you are looking for scalable, free and stable, download CentOS.  It is the free version of Red Hat.

http://www.centos.org/

You want to implement Samba on it.  Then sharing would not be a problem.  
0
Microsoft Certification Exam 74-409

Veeam® is happy to provide the Microsoft community with a study guide prepared by MVP and MCT, Orin Thomas. This guide will take you through each of the exam objectives, helping you to prepare for and pass the examination.

 
LVL 12

Accepted Solution

by:
mccracky earned 250 total points
ID: 35084069
For a NAS (not talking about dedup, usually your options would be Openfiler (Linux based: http://www.openfiler.com) or FreeNAS (FreeBSD based: http://freenas.org/).  I just ran across another based on OpenSolaris: Nexenta. (http://www.nexenta.org/)

As for deduplication, it is provided in ZFS or I just saw OpenDedup (http://www.opendedup.org/)

You might want to read these:
http://krypted.com/ubuntu/goodbye-opensolarisopenstorage-hello-openfileropendedup/
http://mattgadient.com/2010/05/23/freenas-a-powerful-file-serving-solution-but-not-without-its-issues/
0
 
LVL 47

Assisted Solution

by:David
David earned 250 total points
ID: 35084265
Nexenta is opensource, but it is a commercial product, so you have to purchase a license if you have > 4TB of disk, BTW.

However, the price is reasonable and as long as your hardware is on their supported device list you will be fine.  This is important as you literally can not install the software if your disk controller is not on the supported list, even if solaris drivers are available.]
0
 

Author Comment

by:bhieb
ID: 35094810
Well thanks all for the input, I'm going to split the points. ZFS looks very promising but with the demise of OpenSolaris, I'm skeptical of implementing it for long term production use. Also I'm thinking that the memory and CPU requirements for dedupe would be large enough that simply adding more spindles would be a better option. Here is another link that was in one of yours mccraky, it does not address my need directly, but it does talk at length about ZFS (the comments section is helpful too).

http://www.anandtech.com/show/3963/zfs-building-testing-and-benchmarking/1 
0
 
LVL 47

Expert Comment

by:David
ID: 35094852
use solaris.  not opensolaris.
0
 

Author Comment

by:bhieb
ID: 35094863
What version of ZFS is it currently on though? Dedupe (which was the point of looking to open source anyway) is not on earlier versions prior to 12 i think.
0

Featured Post

Want Experts Exchange at your fingertips?

With Experts Exchange’s latest app release, you can now experience our most recent features, updates, and the same community interface while on-the-go. Download our latest app release at the Android or Apple stores today!

Question has a verified solution.

If you are experiencing a similar issue, please ask a related question

Network Interface Card (NIC) bonding, also known as link aggregation, NIC teaming and trunking, is an important concept to understand and implement in any environment where high availability is of concern. Using this feature, a server administrator …
I am a long time windows user and for me it is normal to have spaces in directory and file names. Changing to Linux I found myself frustrated when I moved my windows data over to my new Linux computer. The problem occurs when at the command line.…
Learn several ways to interact with files and get file information from the bash shell. ls lists the contents of a directory: Using the -a flag displays hidden files: Using the -l flag formats the output in a long list: The file command gives us mor…
Learn how to get help with Linux/Unix bash shell commands. Use help to read help documents for built in bash shell commands.: Use man to interface with the online reference manuals for shell commands.: Use man to search man pages for unknown command…
Suggested Courses

628 members asked questions and received personalized solutions in the past 7 days.

Join the community of 500,000 technology professionals and ask your questions.

Join & Ask a Question