yeah, i tried 125MB, and it had no effect.
I found that my editor, Ultraedit-32 has a nice Sort function that removes duplicate entries... so i just used that...
thanks for the add
Main Topics
Browse All TopicsIve got this code:
-------------------------
$lines = file('RAW_output.txt');
$lines = array_unique($lines);
$handle = fopen('CLEANED.txt', "w+");
if (!$handle)
die('error opening file');
$writeMe = '';
foreach ($lines as $line)
$writeMe .= rtrim($line)."\n";
fwrite($handle, $writeMe);
fclose($handle);
Trying to clean out all the Duplicate entries of a 28MB file, and i'm getting a 500 Internal Server Error.
The code works fine on files that are smaller... but now I've got a big file, and it tweaks.
I tried altering the PHP.INI Upload File setting.. but that's didn't work...as it's not related.
Anyone?
This Question has been solved and asker verified All Experts Exchange premium technology solutions are available to subscription members.
Experts Exchange has been collecting answers to technology questions since 1996…3 million and counting! If you have a question, chances are we already have your answer.
If you can't find the exact answer you're looking for, ask our exclusive community of 50,000 experts. You’ll get a personalized answer from a trusted professional.
Thousands of free tech tips, tricks, how-to’s and tutorials are available in our peer reviewed articles section. See for yourself how smart our experts are, no login required.
Access the answers to your technology questions today.
30-day free trial. Register in 60 seconds.
Members of the expert community talk about why the experience at Experts Exchange is different than what you will find anywhere else.

Try it out and discover for yourself.
30-day free trial. Register in 60 seconds.
Join the community of experts here and help other tech pros by answering question in your area of expertise. You can earn FREE access to all Experts Exchange's premium features and resources.
No comment has been added to this question in more than 21 days, so it is now classified as abandoned.
I will leave the following recommendation for this question in the Cleanup topic area:
Accept: jk2001 {http:#18145403}
Any objections should be posted here in the next 4 days. After that time, the question will be closed.
Huji
EE Cleanup Volunteer
Business Accounts
Answer for Membership
by: jk2001Posted on 2006-12-13 at 23:45:41ID: 18137196
Have you set memory_limit to something larger? It's a php.ini setting.