Want to protect your cyber security and still get fast solutions? Ask a secure question today.Go Premium

x
  • Status: Solved
  • Priority: Medium
  • Security: Public
  • Views: 274
  • Last Modified:

Samba and overcoming the 2 Gig file size limitation

I am downloading a compressed file, decompressing it using gunzip, and placing the decompressed file on a NTFS file system via SAMBA (v3.0). The problem is, once the file reaches the magical (and well documented in the news-groups) 2 Gig file size point, it stops. Needless to say, I am a little frustrated and need some help. I have tried CIFS (it mounts, but then freezes the box when any file operation is attempted), and USFW (Unix Services for Windows) to no avail.

Can someone please answer my simple question, is there a way around the 2 Gig file size limit with Samba/NTFS, or do I need to figure out a different solution?

Thanks,

QWade
0
lmbotg
Asked:
lmbotg
  • 5
  • 4
1 Solution
 
owensleftfootCommented:
Have you tried ftp :)
0
 
owensleftfootCommented:
What size is the file when its compressed? Most archivers such as winzip can deal with gzip files.
0
 
lmbotgAuthor Commented:
So a little more context for you: The file is pulled from an FTP site (about 300 Meg compressed) and then decommpredded via a qunzip pipe to the NTFS file system so an ETL package can process it. We once had Winzip performing the decompression outside of the transfer/parsing routines, but are now being asked to code this functionality into the transfer/parsing PERL script hosted on the Linux box.

I have been reading about LFS support in the kernel (smbfs), and there appears to be a patch created for this problem (http://www.ps.uni-sb.de/~errror/smbfs-lfs.html) that I am going to try. I will let you all know if it works.

Thanks,

QWade

P.S. Yes, FTP would be the simple solution, but the specs require that we provide a more "elegant" solution... ;)
0
Independent Software Vendors: We Want Your Opinion

We value your feedback.

Take our survey and automatically be enter to win anyone of the following:
Yeti Cooler, Amazon eGift Card, and Movie eGift Card!

 
owensleftfootCommented:
You could always use split and cut the the file in a couple of chunks, copy them to your ntfs partition and then cat them together again, all from within your script - an extra couple of lines of code at the most.
0
 
lmbotgAuthor Commented:
Excellent suggestion! I will pass this by our PERL coder and see what he thinks..... Didn't even think about using cut/cat in the script (to busy looking for the uber-solution I guess)...

Cheers,

QWade
0
 
lmbotgAuthor Commented:
I have decided to use the smbclient route as it appears to be unencumbered by the 2 Gig file limit that appears to be a smbfs limitation, and not a SAMBA limitation... I have tested it, and it works great....

Thanks for all the help and suggestions.

QWade
0
 
owensleftfootCommented:
You'll need to get the admins to close the question and refund your points.
0
 
lmbotgAuthor Commented:
How do I close this question?
0
 
lmbotgAuthor Commented:
Admins

Please close this question.

Q. Wade Billings
0
 
NetminderCommented:
User resolved; closed, 250 points refunded.

Netminder
Site Admin
0

Featured Post

Free Tool: ZipGrep

ZipGrep is a utility that can list and search zip (.war, .ear, .jar, etc) archives for text patterns, without the need to extract the archive's contents.

One of a set of tools we're offering as a way to say thank you for being a part of the community.

  • 5
  • 4
Tackle projects and never again get stuck behind a technical roadblock.
Join Now