Solved

php sort for dups in two files

Posted on 2003-11-02
5
245 Views
Last Modified: 2007-12-19
OK here's the problem I have two files block.txt and edit.txt
they contain domain entries on per line (.aol.com)
I would like to merge the twp file together but not have any dups. Both files have different amounts a entries (2400 and 420). Here's what I have so far:

set_time_limit(50);

$MAX=99999;
$free=0;
$empty="empty\n";

$array = @File("$type");
$total = count($array);

$free=$total;

// Time to open the entry file

$filename="Edit2.txt";
$fp=fopen("$filename","r")or die("Can not open file");

// Read the file into an array

if ($fp) {  $array = explode("\n", fread($fp, filesize($filename))); }

// Close the file

fclose($fp);

// Echo the second entry in the file

echo "sencond entery in new file: $array[1]<br>\n";


// Count the number of entries in the file

$entry=count($array);


// Echo the number of entries.

echo "entery count total: $entry<br>\n";



// Open the blocking file

$fp=fopen("block","r")or die("can not open the block file");
if($fp) { $arrayb = explode("\n", fread($fp, filesize(block))); }
fclose($fp);

echo "first entery in block file: $arrayb[0]<br>\n";
$blocking=count($arrayb);
echo "total blocking: $blocking\n<br>";


for($k = 0 ; $k < $blocking ; $k++) {
      //$d=$k;
      //if(trim($array[$k] != $arrayb[$d])) {
      for($d = 0; $d < $entry ; $d++) {      
                  if(trim($array[$k] != $arrayb[$d])) {
            
                        //$outputfile .= "$array[$k]\n";
                  $t=1;
                        echo "file ok $k add:$array[$k] and block:$arrayb[$d]<br>";
                  }
            if($t == 1){
                  $outputfile .= "$array[$k]\n";
                  $t=0;
            }
            else {$t=0;}
            
            
            
      }
      //else { $d++; }
}

echo $outputfile;

I know it's no right and right now I only need it to print a web page I can change it to files later.

TIA
0
Comment
Question by:jscart
5 Comments
 
LVL 33

Expert Comment

by:snoyes_jw
ID: 9667226
You could read everything from both files into an array, then use array_unique() to delete all the duplicates, and write the results back out to a file.
0
 
LVL 11

Accepted Solution

by:
shmert earned 125 total points
ID: 9667592
Just an implementation of snoyes' post:

$array = array_unique(array_merge(file('block.txt'), file('edit.txt')));

// Note: the line breaks will still be there for each element, so you may want to iterate through and trim() each entry.
// This should be a very speedy way to do it, though.

foreach($array AS $key=>$value) {
    $array[$key] = rtrim($value);
}
0
 
LVL 3

Expert Comment

by:wide_awake
ID: 9669047
If you're running in a unix environment, you can use the "sort" command to do it for you.

$array = explode("\n", `cat block.txt > tmp.txt; cat edit.txt >> tmp.txt; sort -u tmp.txt`);

-mark

0
 
LVL 3

Expert Comment

by:wide_awake
ID: 9669056
even easier:

$array = explode("\n", `sort -u block.txt edit.txt`);
0
 
LVL 1

Author Comment

by:jscart
ID: 9687215
THanks for the suggestions I'll start trying them and then score.
0

Featured Post

Free Tool: Postgres Monitoring System

A PHP and Perl based system to collect and display usage statistics from PostgreSQL databases.

One of a set of tools we are providing to everyone as a way of saying thank you for being a part of the community.

Question has a verified solution.

If you are experiencing a similar issue, please ask a related question

This article will explain how to display the first page of your Microsoft Word documents (e.g. .doc, .docx, etc...) as images in a web page programatically. I have scoured the web on a way to do this unsuccessfully. The goal is to produce something …
Build an array called $myWeek which will hold the array elements Today, Yesterday and then builds up the rest of the week by the name of the day going back 1 week.   (CODE) (CODE) Then you just need to pass your date to the function. If i…
This tutorial will teach you the core code needed to finalize the addition of a watermark to your image. The viewer will use a small PHP class to learn and create a watermark.
The viewer will learn how to create a basic form using some HTML5 and PHP for later processing. Set up your basic HTML file. Open your form tag and set the method and action attributes.: (CODE) Set up your first few inputs one for the name and …

860 members asked questions and received personalized solutions in the past 7 days.

Join the community of 500,000 technology professionals and ask your questions.

Join & Ask a Question