Still celebrating National IT Professionals Day with 3 months of free Premium Membership. Use Code ITDAY17

x
?
Solved

Linux Deduplication for Backup Server

Posted on 2011-03-08
8
Medium Priority
?
900 Views
Last Modified: 2012-05-11
Ok I think the time (and budget) has come to give Linux a serious look on my network. I am currently in the process of building a new NAS storage point. The entire goal of this storage is to act as a backup location for Symantec Backup Exec. For hardware I am using an Intel SR2612URRNA server with 12 2TB drives in Raid 1+0. The hardware part is easy for me, but when it came time to choose an OS I ran into a bit of a conundrum. I'm comfortable within the MS environment, but I don't really need or want a full blown Server 2008 R2 install here. Also I'd really like OS level Deduplication. I now Backup Exec has a version with deduplication on the client side, but I cannot imagine that is a cost effective way to do it. Plus I'd like the hardware to be easily switched to whatever backup software we choose in the future.

So now my actual questions. First what is the best Linux build to use as a simple NAS? Since I've never even installed a Linux distro I'd prefer a consolidated  package. I've heard opensolaris supports is natively, but there are other projects out there. Any recommendations?

What I'd really like is something very easy to install that can be easily seen as a network share on my AD domain. Burn the ISO, hop through a wizard and good to go would b nice. However I just don't know if Linux is there yet.

0
Comment
Question by:bhieb
[X]
Welcome to Experts Exchange

Add your voice to the tech community where 5M+ people just like you are talking about what matters.

  • Help others & share knowledge
  • Earn cash & points
  • Learn & ask questions
8 Comments
 
LVL 47

Expert Comment

by:David
ID: 35071005
why not go solaris? it has built-in dedup and can do every bit of what you ask ... a lot better than LINUX can.
0
 

Author Comment

by:bhieb
ID: 35071047
That is where I'm leaning actually, just wanted to hear from the Linux guys if there are other options. Guess I will toss it on a box to see what the setup is like. Plus if I get in over my head I can buy a support plan from oracle for an extra safety net.
0
 
LVL 31

Expert Comment

by:farzanj
ID: 35071070
If you are looking for scalable, free and stable, download CentOS.  It is the free version of Red Hat.

http://www.centos.org/

You want to implement Samba on it.  Then sharing would not be a problem.  
0
Learn Veeam advantages over legacy backup

Every day, more and more legacy backup customers switch to Veeam. Technologies designed for the client-server era cannot restore any IT service running in the hybrid cloud within seconds. Learn top Veeam advantages over legacy backup and get Veeam for the price of your renewal

 
LVL 12

Accepted Solution

by:
mccracky earned 1000 total points
ID: 35084069
For a NAS (not talking about dedup, usually your options would be Openfiler (Linux based: http://www.openfiler.com) or FreeNAS (FreeBSD based: http://freenas.org/).  I just ran across another based on OpenSolaris: Nexenta. (http://www.nexenta.org/)

As for deduplication, it is provided in ZFS or I just saw OpenDedup (http://www.opendedup.org/)

You might want to read these:
http://krypted.com/ubuntu/goodbye-opensolarisopenstorage-hello-openfileropendedup/
http://mattgadient.com/2010/05/23/freenas-a-powerful-file-serving-solution-but-not-without-its-issues/
0
 
LVL 47

Assisted Solution

by:David
David earned 1000 total points
ID: 35084265
Nexenta is opensource, but it is a commercial product, so you have to purchase a license if you have > 4TB of disk, BTW.

However, the price is reasonable and as long as your hardware is on their supported device list you will be fine.  This is important as you literally can not install the software if your disk controller is not on the supported list, even if solaris drivers are available.]
0
 

Author Comment

by:bhieb
ID: 35094810
Well thanks all for the input, I'm going to split the points. ZFS looks very promising but with the demise of OpenSolaris, I'm skeptical of implementing it for long term production use. Also I'm thinking that the memory and CPU requirements for dedupe would be large enough that simply adding more spindles would be a better option. Here is another link that was in one of yours mccraky, it does not address my need directly, but it does talk at length about ZFS (the comments section is helpful too).

http://www.anandtech.com/show/3963/zfs-building-testing-and-benchmarking/1 
0
 
LVL 47

Expert Comment

by:David
ID: 35094852
use solaris.  not opensolaris.
0
 

Author Comment

by:bhieb
ID: 35094863
What version of ZFS is it currently on though? Dedupe (which was the point of looking to open source anyway) is not on earlier versions prior to 12 i think.
0

Featured Post

Free Tool: Path Explorer

An intuitive utility to help find the CSS path to UI elements on a webpage. These paths are used frequently in a variety of front-end development and QA automation tasks.

One of a set of tools we're offering as a way of saying thank you for being a part of the community.

Question has a verified solution.

If you are experiencing a similar issue, please ask a related question

Little introduction about CP: CP is a command on linux that use to copy files and folder from one location to another location. Example usage of CP as follow: cp /myfoder /pathto/destination/folder/ cp abc.tar.gz /pathto/destination/folder/ab…
SSH (Secure Shell) - Tips and Tricks As you all know SSH(Secure Shell) is a network protocol, which we use to access/transfer files securely between two networked devices. SSH was actually designed as a replacement for insecure protocols that sen…
Learn how to find files with the shell using the find and locate commands. Use locate to find a needle in a haystack.: With locate, check if the file still exists.: Use find to get the actual location of the file.:
Connecting to an Amazon Linux EC2 Instance from Windows Using PuTTY.
Suggested Courses

704 members asked questions and received personalized solutions in the past 7 days.

Join the community of 500,000 technology professionals and ask your questions.

Join & Ask a Question