asked on

Samba and overcoming the 2 Gig file size limitation

I am downloading a compressed file, decompressing it using gunzip, and placing the decompressed file on a NTFS file system via SAMBA (v3.0). The problem is, once the file reaches the magical (and well documented in the news-groups) 2 Gig file size point, it stops. Needless to say, I am a little frustrated and need some help. I have tried CIFS (it mounts, but then freezes the box when any file operation is attempted), and USFW (Unix Services for Windows) to no avail.

Can someone please answer my simple question, is there a way around the 2 Gig file size limit with Samba/NTFS, or do I need to figure out a different solution?

Thanks,

QWade

owensleftfoot

Have you tried ftp :)

owensleftfoot

What size is the file when its compressed? Most archivers such as winzip can deal with gzip files.

lmbotg

ASKER

So a little more context for you: The file is pulled from an FTP site (about 300 Meg compressed) and then decommpredded via a qunzip pipe to the NTFS file system so an ETL package can process it. We once had Winzip performing the decompression outside of the transfer/parsing routines, but are now being asked to code this functionality into the transfer/parsing PERL script hosted on the Linux box.

I have been reading about LFS support in the kernel (smbfs), and there appears to be a patch created for this problem (http://www.ps.uni-sb.de/~errror/smbfs-lfs.html) that I am going to try. I will let you all know if it works.

Thanks,

QWade

P.S. Yes, FTP would be the simple solution, but the specs require that we provide a more "elegant" solution... ;)

owensleftfoot

You could always use split and cut the the file in a couple of chunks, copy them to your ntfs partition and then cat them together again, all from within your script - an extra couple of lines of code at the most.

lmbotg

ASKER

Excellent suggestion! I will pass this by our PERL coder and see what he thinks..... Didn't even think about using cut/cat in the script (to busy looking for the uber-solution I guess)...

Cheers,

QWade

lmbotg

ASKER

I have decided to use the smbclient route as it appears to be unencumbered by the 2 Gig file limit that appears to be a smbfs limitation, and not a SAMBA limitation... I have tested it, and it works great....

Thanks for all the help and suggestions.

QWade

owensleftfoot

You'll need to get the admins to close the question and refund your points.

lmbotg

ASKER

How do I close this question?

lmbotg

ASKER

Admins

Please close this question.

Q. Wade Billings

ASKER CERTIFIED SOLUTION

Netminder

membership

This solution is only available to members.

To access this solution, you must be a member of Experts Exchange.

Start Free Trial