Solved

PHP copy() and a 4GB limit

Posted on 2008-10-13
12
1,439 Views
Last Modified: 2013-12-06
On a FreeBSD 6.2 system, my PHP scripts are encountering a 4GB filesize limit when using copy(). The copy process simply fails when 4 gigabytes have been transferred.

The attempted transfer is from a local file to a local file, and the filesystem is UFS (which has a 1TB filesize limit).

I have been unable to find any documentation regarding such a limit in PHP or FreeBSD. Can anyone provide a work-around for copying large files within PHP? Shelling out and using system commands is a possibility, but I would prefer to stay in PHP if possible.

PHP version is 5.1.6 with the Suhosin patch.
0
Comment
Question by:glcummins
12 Comments
 
LVL 9

Expert Comment

by:chingmd
Comment Utility
I'm no php expert, but reading your question, made me think that the limit is PHP itself.    That being the case, I would split the file into managable sizes, and unsplit (if needed) in the destination location.

0
 
LVL 24

Author Comment

by:glcummins
Comment Utility
I agree that this sounds like a PHP limit. However, I have been unable to find anything in the PHP documentation that would indicate such a limit.

Unfortunately, splitting the file is not an option in this case. A confirmation from someone that they have encountered a similar issue would be enough to determine that this is a system (rather than a user) error.
0
 
LVL 3

Expert Comment

by:smueller72
Comment Utility
You can always use shell_exec to run shell commands with php
http://us3.php.net/shell_exec

There will be no limit as you are basically running a shell command, and it uses php.
0
 
LVL 24

Author Comment

by:glcummins
Comment Utility
Shelling out is a possibility, but I would prefer to stay in PHP if I can.

If no other solution presents itself, however, this will be the only option I can see.
0
 
LVL 3

Expert Comment

by:smueller72
Comment Utility
can you do a df -h in bash and post the results here? im wondering if your /tmp dir only has 4gb available.
0
 
LVL 3

Expert Comment

by:smueller72
Comment Utility
also, if you are using a fat32 filesystem, it does not support files larger than 4gb.
0
Find Ransomware Secrets With All-Source Analysis

Ransomware has become a major concern for organizations; its prevalence has grown due to past successes achieved by threat actors. While each ransomware variant is different, we’ve seen some common tactics and trends used among the authors of the malware.

 
LVL 24

Author Comment

by:glcummins
Comment Utility
I am using ufs which should have a 1TB filesize limit. Here is the output of df:

Filesystem     Size    Used   Avail Capacity  Mounted on
/dev/ad4s1a   190M     57M   117M    33%     /
devfs              1.0K    1.0K       0B   100%    /dev
/dev/ad4s4d     74G     42G     26G     62%    /usr
/dev/ad4s3d     69G     56M     64G      0%    /var
/dev/ad5s1     144G     35G     97G     27%    /var/db/mysql

If the file copy process was dependent on the /tmp directory it would fail much sooner than 4GB, I think, since the / directory has only 190M in total size.
0
 
LVL 3

Expert Comment

by:smueller72
Comment Utility
have you tried a similar transfer with something large, but not as large as 4gb? (ex. 1gb).
0
 
LVL 24

Author Comment

by:glcummins
Comment Utility
Yes, I have tested with a range of file sizes, and anything up to 4GB works.
0
 
LVL 2

Accepted Solution

by:
michel-angelo earned 500 total points
Comment Utility
If this is a PHP limitation and you would like to stay within the script (No exec""), could you use fopen and fread to copy the file in chuncks?
0
 
LVL 24

Author Comment

by:glcummins
Comment Utility
@michel-angelo:

That's an idea. I'll give it a try and report back.
0
 
LVL 24

Author Comment

by:glcummins
Comment Utility
I apologize for the delay in closing this question. Thank you for your assistance.
0

Featured Post

How to run any project with ease

Manage projects of all sizes how you want. Great for personal to-do lists, project milestones, team priorities and launch plans.
- Combine task lists, docs, spreadsheets, and chat in one
- View and edit from mobile/offline
- Cut down on emails

Join & Write a Comment

Popularity Can Be Measured Sometimes we deal with questions of popularity, and we need a way to collect opinions from our clients.  This article shows a simple teaching example of how we might elect a favorite color by letting our clients vote for …
Using libpcap/Jpcap to capture and send packets on Solaris version (10/11) Library used: 1.      Libpcap (http://www.tcpdump.org) Version 1.2 2.      Jpcap(http://netresearch.ics.uci.edu/kfujii/Jpcap/doc/index.html) Version 0.6 Prerequisite: 1.      GCC …
Learn several ways to interact with files and get file information from the bash shell. ls lists the contents of a directory: Using the -a flag displays hidden files: Using the -l flag formats the output in a long list: The file command gives us mor…
The viewer will learn how to count occurrences of each item in an array.

763 members asked questions and received personalized solutions in the past 7 days.

Join the community of 500,000 technology professionals and ask your questions.

Join & Ask a Question

Need Help in Real-Time?

Connect with top rated Experts

11 Experts available now in Live!

Get 1:1 Help Now