Solved

iSCSI target vs. Samba vs. NFS share for storing backup files over the network

Posted on 2010-11-11
8
1,167 Views
Last Modified: 2012-05-10
Hi All,

I'd like to know which one is the fastest transfer / throughput rate across the network for the file sharing ?

I'm trying to create some more datastore for storing the very large backup to disk files.

so I'm now considering between running the following over the network:

Ubuntu Server + Samba
Openfiler + iSCSI target (never try this before).

all of those will be over the gigabit network.

Thanks.
0
Comment
Question by:jjoz
  • 4
  • 3
8 Comments
 
LVL 1

Author Comment

by:jjoz
ID: 34111154
the shared network drive will be mainly used by Windows Server 2003
0
 
LVL 77

Expert Comment

by:arnold
ID: 34112319
The question should start based on the destination supported by the backup & restore software i.e. can the software read/write from a mapped drive (samba/NFS)? Or does the software need to use a "local drive" (iscsi).
iscsi sends SCSI commands over Ethernet and depends on which option you choose when configuring the iscsi lun. blockio or fileio (preferred)
https://forums.openfiler.com/viewtopic.php?id=1846

samba/nfs has a lower overhead and would likely be faster.
0
 
LVL 1

Author Comment

by:jjoz
ID: 34115897
thanks for the reply arnold, so for large sequential file transfer using samba over the network is better compares to iSCSI ?
0
Migrating Your Company's PCs

To keep pace with competitors, businesses must keep employees productive, and that means providing them with the latest technology. This document provides the tips and tricks you need to help you migrate an outdated PC fleet to new desktops, laptops, and tablets.

 
LVL 77

Assisted Solution

by:arnold
arnold earned 250 total points
ID: 34116014
iscsi would normally be 50-80Mbits/sec. a 15GB MS SQL database backup would take around 18 minutes using blockio.
You have to test how long it will take to copy a 500MB file to a samba/nfs share to estimate its transfer rate.

The main issue deals with whether the backup software can backup to mapped network drives or must those be seen as local physical drives.

I/O wise I think it will take longer to transfer 20 files that amount to 500 MB versus a single 500MB file because of the start/stop overhead for each file.
0
 
LVL 12

Accepted Solution

by:
mccracky earned 250 total points
ID: 34121513
The other consideration (for the archives more than specifically your case) is which platforms will be using the network drive.  If it's only Windows (as you mentioned) then Samba is probably better than nfs.  If Linux or other variant, then probably nfs over Samba.  It also depends on how the files are being backed up.  If just copied the prior sentences are even more important as the file permissions and ownership are better preserved.

If the backup software creates a large backup file that contains all the relevant permissions/ownership/timestamps in the one file, then the storage medium doesn't matter as much, but just needs to be something the backup software can use.  As mentioned by arnold, one looks more local and the other more remote.

The speed will also be affected by the disk subsystems and network.  Theoretical maximum for a gigabit network would be around 115MB/s including some of the Ethernet overhead.  Network congestion will slow it down.  The speed of the disk subsystem i/o might also.  

Since both your options are free it might just be best to set up the test case and test the throughput.
0
 
LVL 1

Author Comment

by:jjoz
ID: 34130813
Guys, thanks for the suggestion,
It seems that iSCSI is the fastest when configured properly with the following parameters in the Openfiler VM:

R/W Mode: Write-thru
Transfer Mode: blockio

am I doing it right ?
iSCSI-BlockIO-WriteThru.jpg
0
 
LVL 77

Expert Comment

by:arnold
ID: 34131102
The settings you've choosen should be fine.
I've not checked whether the write back is  a better performing setting.
0
 
LVL 1

Author Closing Comment

by:jjoz
ID: 34132811
thanks man !
0

Featured Post

Announcing the Most Valuable Experts of 2016

MVEs are more concerned with the satisfaction of those they help than with the considerable points they can earn. They are the types of people you feel privileged to call colleagues. Join us in honoring this amazing group of Experts.

Question has a verified solution.

If you are experiencing a similar issue, please ask a related question

Suggested Solutions

This article is an update and follow-up of my previous article:   Storage 101: common concepts in the IT enterprise storage This time, I expand on more frequently used storage concepts.
Create your own, high-performance VM backup appliance by installing NAKIVO Backup & Replication directly onto a Synology NAS!
This video teaches viewers how to encrypt an external drive that requires a password to read and edit the drive. All tasks are done in Disk Utility. Plug in the external drive you wish to encrypt: Make sure all previous data on the drive has been …
This tutorial will walk an individual through the process of installing of Data Protection Manager on a server running Windows Server 2012 R2, including the prerequisites. Microsoft .Net 3.5 is required. To install this feature, go to Server Manager…

816 members asked questions and received personalized solutions in the past 7 days.

Join the community of 500,000 technology professionals and ask your questions.

Join & Ask a Question

Need Help in Real-Time?

Connect with top rated Experts

11 Experts available now in Live!

Get 1:1 Help Now