Samba and overcoming the 2 Gig file size limitation

I am downloading a compressed file, decompressing it using gunzip, and placing the decompressed file on a NTFS file system via SAMBA (v3.0). The problem is, once the file reaches the magical (and well documented in the news-groups) 2 Gig file size point, it stops. Needless to say, I am a little frustrated and need some help. I have tried CIFS (it mounts, but then freezes the box when any file operation is attempted), and USFW (Unix Services for Windows) to no avail.

Can someone please answer my simple question, is there a way around the 2 Gig file size limit with Samba/NTFS, or do I need to figure out a different solution?

Thanks,

QWade
lmbotgAsked:
Who is Participating?
 
NetminderConnect With a Mentor Commented:
User resolved; closed, 250 points refunded.

Netminder
Site Admin
0
 
owensleftfootCommented:
Have you tried ftp :)
0
 
owensleftfootCommented:
What size is the file when its compressed? Most archivers such as winzip can deal with gzip files.
0
Upgrade your Question Security!

Your question, your audience. Choose who sees your identity—and your question—with question security.

 
lmbotgAuthor Commented:
So a little more context for you: The file is pulled from an FTP site (about 300 Meg compressed) and then decommpredded via a qunzip pipe to the NTFS file system so an ETL package can process it. We once had Winzip performing the decompression outside of the transfer/parsing routines, but are now being asked to code this functionality into the transfer/parsing PERL script hosted on the Linux box.

I have been reading about LFS support in the kernel (smbfs), and there appears to be a patch created for this problem (http://www.ps.uni-sb.de/~errror/smbfs-lfs.html) that I am going to try. I will let you all know if it works.

Thanks,

QWade

P.S. Yes, FTP would be the simple solution, but the specs require that we provide a more "elegant" solution... ;)
0
 
owensleftfootCommented:
You could always use split and cut the the file in a couple of chunks, copy them to your ntfs partition and then cat them together again, all from within your script - an extra couple of lines of code at the most.
0
 
lmbotgAuthor Commented:
Excellent suggestion! I will pass this by our PERL coder and see what he thinks..... Didn't even think about using cut/cat in the script (to busy looking for the uber-solution I guess)...

Cheers,

QWade
0
 
lmbotgAuthor Commented:
I have decided to use the smbclient route as it appears to be unencumbered by the 2 Gig file limit that appears to be a smbfs limitation, and not a SAMBA limitation... I have tested it, and it works great....

Thanks for all the help and suggestions.

QWade
0
 
owensleftfootCommented:
You'll need to get the admins to close the question and refund your points.
0
 
lmbotgAuthor Commented:
How do I close this question?
0
 
lmbotgAuthor Commented:
Admins

Please close this question.

Q. Wade Billings
0
Question has a verified solution.

Are you are experiencing a similar issue? Get a personalized answer when you ask a related question.

Have a better answer? Share it in a comment.

All Courses

From novice to tech pro — start learning today.