Solved

Linux Deduplication for Backup Server

Posted on 2011-03-08
8
839 Views
Last Modified: 2012-05-11
Ok I think the time (and budget) has come to give Linux a serious look on my network. I am currently in the process of building a new NAS storage point. The entire goal of this storage is to act as a backup location for Symantec Backup Exec. For hardware I am using an Intel SR2612URRNA server with 12 2TB drives in Raid 1+0. The hardware part is easy for me, but when it came time to choose an OS I ran into a bit of a conundrum. I'm comfortable within the MS environment, but I don't really need or want a full blown Server 2008 R2 install here. Also I'd really like OS level Deduplication. I now Backup Exec has a version with deduplication on the client side, but I cannot imagine that is a cost effective way to do it. Plus I'd like the hardware to be easily switched to whatever backup software we choose in the future.

So now my actual questions. First what is the best Linux build to use as a simple NAS? Since I've never even installed a Linux distro I'd prefer a consolidated  package. I've heard opensolaris supports is natively, but there are other projects out there. Any recommendations?

What I'd really like is something very easy to install that can be easily seen as a network share on my AD domain. Burn the ISO, hop through a wizard and good to go would b nice. However I just don't know if Linux is there yet.

0
Comment
Question by:bhieb
8 Comments
 
LVL 47

Expert Comment

by:dlethe
ID: 35071005
why not go solaris? it has built-in dedup and can do every bit of what you ask ... a lot better than LINUX can.
0
 

Author Comment

by:bhieb
ID: 35071047
That is where I'm leaning actually, just wanted to hear from the Linux guys if there are other options. Guess I will toss it on a box to see what the setup is like. Plus if I get in over my head I can buy a support plan from oracle for an extra safety net.
0
 
LVL 31

Expert Comment

by:farzanj
ID: 35071070
If you are looking for scalable, free and stable, download CentOS.  It is the free version of Red Hat.

http://www.centos.org/

You want to implement Samba on it.  Then sharing would not be a problem.  
0
 
LVL 12

Accepted Solution

by:
mccracky earned 250 total points
ID: 35084069
For a NAS (not talking about dedup, usually your options would be Openfiler (Linux based: http://www.openfiler.com) or FreeNAS (FreeBSD based: http://freenas.org/).  I just ran across another based on OpenSolaris: Nexenta. (http://www.nexenta.org/)

As for deduplication, it is provided in ZFS or I just saw OpenDedup (http://www.opendedup.org/)

You might want to read these:
http://krypted.com/ubuntu/goodbye-opensolarisopenstorage-hello-openfileropendedup/
http://mattgadient.com/2010/05/23/freenas-a-powerful-file-serving-solution-but-not-without-its-issues/
0
What is SQL Server and how does it work?

The purpose of this paper is to provide you background on SQL Server. It’s your self-study guide for learning fundamentals. It includes both the history of SQL and its technical basics. Concepts and definitions will form the solid foundation of your future DBA expertise.

 
LVL 47

Assisted Solution

by:dlethe
dlethe earned 250 total points
ID: 35084265
Nexenta is opensource, but it is a commercial product, so you have to purchase a license if you have > 4TB of disk, BTW.

However, the price is reasonable and as long as your hardware is on their supported device list you will be fine.  This is important as you literally can not install the software if your disk controller is not on the supported list, even if solaris drivers are available.]
0
 

Author Comment

by:bhieb
ID: 35094810
Well thanks all for the input, I'm going to split the points. ZFS looks very promising but with the demise of OpenSolaris, I'm skeptical of implementing it for long term production use. Also I'm thinking that the memory and CPU requirements for dedupe would be large enough that simply adding more spindles would be a better option. Here is another link that was in one of yours mccraky, it does not address my need directly, but it does talk at length about ZFS (the comments section is helpful too).

http://www.anandtech.com/show/3963/zfs-building-testing-and-benchmarking/1 
0
 
LVL 47

Expert Comment

by:dlethe
ID: 35094852
use solaris.  not opensolaris.
0
 

Author Comment

by:bhieb
ID: 35094863
What version of ZFS is it currently on though? Dedupe (which was the point of looking to open source anyway) is not on earlier versions prior to 12 i think.
0

Featured Post

Ransomware-A Revenue Bonanza for Service Providers

Ransomware – malware that gets on your customers’ computers, encrypts their data, and extorts a hefty ransom for the decryption keys – is a surging new threat.  The purpose of this eBook is to educate the reader about ransomware attacks.

Question has a verified solution.

If you are experiencing a similar issue, please ask a related question

Suggested Solutions

Title # Comments Views Activity
Virtual Box issue 6 85
BASH script to modify crontab? 3 50
How to have a cron job run until a condition is met 12 55
Best way to virtualise a remote Linux server 2 52
I am a long time windows user and for me it is normal to have spaces in directory and file names. Changing to Linux I found myself frustrated when I moved my windows data over to my new Linux computer. The problem occurs when at the command line.…
SSH (Secure Shell) - Tips and Tricks As you all know SSH(Secure Shell) is a network protocol, which we use to access/transfer files securely between two networked devices. SSH was actually designed as a replacement for insecure protocols that sen…
Learn how to navigate the file tree with the shell. Use pwd to print the current working directory: Use ls to list a directory's contents: Use cd to change to a new directory: Use wildcards instead of typing out long directory names: Use ../ to move…
Connecting to an Amazon Linux EC2 Instance from Windows Using PuTTY.

895 members asked questions and received personalized solutions in the past 7 days.

Join the community of 500,000 technology professionals and ask your questions.

Join & Ask a Question

Need Help in Real-Time?

Connect with top rated Experts

14 Experts available now in Live!

Get 1:1 Help Now