Solved

Samba and overcoming the 2 Gig file size limitation

Posted on 2004-04-20
10
221 Views
Last Modified: 2010-03-18
I am downloading a compressed file, decompressing it using gunzip, and placing the decompressed file on a NTFS file system via SAMBA (v3.0). The problem is, once the file reaches the magical (and well documented in the news-groups) 2 Gig file size point, it stops. Needless to say, I am a little frustrated and need some help. I have tried CIFS (it mounts, but then freezes the box when any file operation is attempted), and USFW (Unix Services for Windows) to no avail.

Can someone please answer my simple question, is there a way around the 2 Gig file size limit with Samba/NTFS, or do I need to figure out a different solution?

Thanks,

QWade
0
Comment
Question by:lmbotg
  • 5
  • 4
10 Comments
 
LVL 17

Expert Comment

by:owensleftfoot
ID: 10868986
Have you tried ftp :)
0
 
LVL 17

Expert Comment

by:owensleftfoot
ID: 10868996
What size is the file when its compressed? Most archivers such as winzip can deal with gzip files.
0
 

Author Comment

by:lmbotg
ID: 10869406
So a little more context for you: The file is pulled from an FTP site (about 300 Meg compressed) and then decommpredded via a qunzip pipe to the NTFS file system so an ETL package can process it. We once had Winzip performing the decompression outside of the transfer/parsing routines, but are now being asked to code this functionality into the transfer/parsing PERL script hosted on the Linux box.

I have been reading about LFS support in the kernel (smbfs), and there appears to be a patch created for this problem (http://www.ps.uni-sb.de/~errror/smbfs-lfs.html) that I am going to try. I will let you all know if it works.

Thanks,

QWade

P.S. Yes, FTP would be the simple solution, but the specs require that we provide a more "elegant" solution... ;)
0
 
LVL 17

Expert Comment

by:owensleftfoot
ID: 10869529
You could always use split and cut the the file in a couple of chunks, copy them to your ntfs partition and then cat them together again, all from within your script - an extra couple of lines of code at the most.
0
 

Author Comment

by:lmbotg
ID: 10869634
Excellent suggestion! I will pass this by our PERL coder and see what he thinks..... Didn't even think about using cut/cat in the script (to busy looking for the uber-solution I guess)...

Cheers,

QWade
0
How to run any project with ease

Manage projects of all sizes how you want. Great for personal to-do lists, project milestones, team priorities and launch plans.
- Combine task lists, docs, spreadsheets, and chat in one
- View and edit from mobile/offline
- Cut down on emails

 

Author Comment

by:lmbotg
ID: 10870979
I have decided to use the smbclient route as it appears to be unencumbered by the 2 Gig file limit that appears to be a smbfs limitation, and not a SAMBA limitation... I have tested it, and it works great....

Thanks for all the help and suggestions.

QWade
0
 
LVL 17

Expert Comment

by:owensleftfoot
ID: 10873041
You'll need to get the admins to close the question and refund your points.
0
 

Author Comment

by:lmbotg
ID: 11475400
How do I close this question?
0
 

Author Comment

by:lmbotg
ID: 11854004
Admins

Please close this question.

Q. Wade Billings
0
 
LVL 5

Accepted Solution

by:
Netminder earned 0 total points
ID: 11864509
User resolved; closed, 250 points refunded.

Netminder
Site Admin
0

Featured Post

Free Trending Threat Insights Every Day

Enhance your security with threat intelligence from the web. Get trending threat insights on hackers, exploits, and suspicious IP addresses delivered to your inbox with our free Cyber Daily.

Join & Write a Comment

I have seen several blogs and forum entries elsewhere state that because NTFS volumes do not support linux ownership or permissions, they cannot be used for anonymous ftp upload through the vsftpd program.   IT can be done and here's how to get i…
Note: for this to work properly you need to use a Cross-Over network cable. 1. Connect both servers S1 and S2 on the second network slots respectively. Note that you can use the 1st slots but usually these would be occupied by the Service Provide…
Sending a Secure fax is easy with eFax Corporate (http://www.enterprise.efax.com). First, Just open a new email message.  In the To field, type your recipient's fax number @efaxsend.com. You can even send a secure international fax — just include t…
Access reports are powerful and flexible. Learn how to create a query and then a grouped report using the wizard. Modify the report design after the wizard is done to make it look better. There will be another video to explain how to put the final p…

707 members asked questions and received personalized solutions in the past 7 days.

Join the community of 500,000 technology professionals and ask your questions.

Join & Ask a Question

Need Help in Real-Time?

Connect with top rated Experts

15 Experts available now in Live!

Get 1:1 Help Now