Solved

Need To Parse CSV file in PHP

Posted on 2014-01-04
14
837 Views
Last Modified: 2014-01-15
I have a csv file I am trying to parse two values out of it.  The first value is array element 1 productcode and the second value is element 4 weight.  After I get these two values for each product I need to create a csv file of the results using the implode function.

Here is the file
[PRODUCTS]
!PRODUCTID;!PRODUCTCODE;!PRODUCT;!CLEAN_URL;!WEIGHT;!LIST_PRICE;!DESCR;!FULLDESCR;!KEYWORDS;!TITLE_TAG;!META_KEYWORDS;!META_DESCRIPTION;!AVAIL;!RATING;!FORSALE;!SHIPPING_FREIGHT;!FREE_SHIPPING;!DISCOUNT_AVAIL;!MIN_AMOUNT;!LENGTH;!WIDTH;!HEIGHT;!LOW_AVAIL_LIMIT;!FREE_TAX;!CATEGORYID;!CATEGORY;!POS;!MEMBERSHIP;!PRICE;!TAXES;!ADD_DATE;!VIEWS_STATS;!SALES_STATS;!DEL_STATS;!SMALL_ITEM;!SEPARATE_BOX;!ITEMS_PER_BOX;!MANUFACTURERID;!MANUFACTURER
889;"10810-7";"";10810-7;0;75;"";"";"";"";"";"";0;0;N;0;N;Y;1;0;0;0;10;N;75;"ADD & ADHD";0;;50;;Wednesday 01 June 2011 02:03:18 AM;0;0;0;Y;N;1;"0";
888;"14553-4";"";14553-4;0;15;"";"";"";"";"";"";0;0;N;0;N;Y;1;0;0;0;10;N;75;"ADD & ADHD";0;;10;;Wednesday 01 June 2011 02:03:18 AM;0;0;0;Y;N;1;"0";
903;"150-6";"";150-6;0;14.050;"";"";"";"";"";"";0;0;N;0;N;Y;1;0;0;0;10;N;75;"ADD & ADHD";0;;9.350;;Wednesday 01 June 2011 02:03:35 AM;0;0;0;Y;N;1;"0";
902;"16343-9";"";16343-9;0;0;"";"";"";"";"";"";0;0;N;0;N;Y;1;0;0;0;10;N;75;"ADD & ADHD";0;;174.950;;Wednesday 01 June 2011 02:03:34 AM;0;0;0;Y;N;1;"0";
890;"166-7";"";166-7;0;14.950;"";"";"";"";"";"";0;0;N;0;N;Y;1;0;0;0;10;N;75;"ADD & ADHD";0;;9.950;;Wednesday 01 June 2011 02:03:20 AM;0;0;0;Y;N;1;"0";
906;"1672-1";"";1672-1;0;23.650;"";"";"";"";"";"";0;0;N;0;N;Y;1;0;0;0;10;N;75;"ADD & ADHD";0;;15.750;;Wednesday 01 June 2011 02:03:38 AM;0;0;0;Y;N;1;"0";
896;"1958-8";"";1958-8;0;168.750;"";"";"";"";"";"";0;0;N;0;N;Y;1;0;0;0;10;N;75;"ADD & ADHD";0;;115;;Wednesday 01 June 2011 02:03:31 AM;0;0;0;Y;N;1;"0";

Open in new window


Here is the code I am using to display the file and take it out of the csv format
<?php
$file = fopen("weight_nsp_ben.csv","r");
while(! feof($file))
  {
  print_r(fgetcsv($file));
  }
fclose($file);
?>

Open in new window


My problem is I am not sure how to extract productcode and weight for each product. As and indexed array it is index 1 and 4.  Thanks for the help.

Randal
0
Comment
Question by:sharingsunshine
  • 5
  • 4
  • 3
  • +1
14 Comments
 
LVL 82

Expert Comment

by:hielo
ID: 39756811
<?php
$data=array();
if (($handle = fopen("weight_nsp_ben.csv", "r")) !== FALSE)
{
    //fetch the "[products]" row, but do nothing with it
    fgetcsv($handle, 1000, ';');

    //fetch the headers row
    $headers = fgetcsv($handle, 1000, ';');

    //locate the index of product_code and weight
    $product_code=array_search('!PRODUCTCODE',$headers);
    $weight=array_search('!WEIGHT',$headers);

    while (($row = fgetcsv($handle, 1000, ";")) !== FALSE) 
    {
        $data[]=sprintf('"%s","%s"',$row[$product_code], $row[$weight]);
    }
    fclose($handle);

    file_put_contents(getcwd().'/result.csv', implode(PHP_EOL,$data) );
}
?>

Open in new window

0
 

Author Comment

by:sharingsunshine
ID: 39756864
I am getting this error on line 38 which is
file_put_contents(getcwd().'/result.csv', implode(PHP_EOL,$data) );

Warning: file_put_contents(/Users/abx/Sites/sandbox/result.csv): failed to open stream: Permission denied in /Users/abx/Sites/sandbox/test_weight.php on line 38

I created result.csv when the error first occurred but that didn't change anything.  I even chmodded it to 755.
0
 
LVL 13

Expert Comment

by:duncanb7
ID: 39756946
Dear sharingsunshine,

you can use explode() , file(),file_put_contents function in php to finish your work , and those
functions are  easily to use and mentioned in http://hk2.php.net/file_put_contents

the result can be saved into output.csv file by file_put_contents,

I just make simple code to finish your work, and it works on my server but not fully tested, you need to do the rest

Hope understand your question completely, if not please pt it out.

Duncan

<?php
$proverbs=file("weight_nsp_ben.csv");$cnt=count($proverbs);$str="";

//-Finding product tag, "!PRODUCTCODE" and "!WEIGHT"
for($i=0;$i<$cnt;$i++){@$producttag=explode(";",$proverbs[$i]);
if(@$producttag[1]=="!PRODUCTCODE" && @$producttag[4]=="!WEIGHT")break;}

//-Extract all product data,and $a=$i+1 is where product starting to explode
//-after getting the product tag code and weight
for($a=$i+1;$a<$cnt;$a++){
$val=explode(";",$proverbs[$a]);
$str=$str.$val[1].";".$val[4].";"."\n";}

//result save in csv format with delimiter ";"
$str=$producttag[1].";".$producttag[4].";"."\n".$str;
file_put_contents("output.csv",$str);
echo $str;

?>

Open in new window

0
Use Case: Protecting a Hybrid Cloud Infrastructure

Microsoft Azure is rapidly becoming the norm in dynamic IT environments. This document describes the challenges that organizations face when protecting data in a hybrid cloud IT environment and presents a use case to demonstrate how Acronis Backup protects all data.

 

Author Comment

by:sharingsunshine
ID: 39756972
I am getting same kind of error:

Warning: file_put_contents(/output.csv): failed to open stream: Permission denied in /Users/abx/Sites/sandbox/test_weight2.php on line 23

this is line 23

file_put_contents("output.csv",$str);
0
 
LVL 13

Expert Comment

by:duncanb7
ID: 39756989
the output is okay or not from echo $str on your server, Is it what you want ?

just make a  simple test first , could you create a file at your Linux shell and at such directory,
using command of linux such as "vim output.csv", to see it is permission issus or not
first ?

It might be disk full issue for your server account I guess if your input csv file  is really huge?
Try  "df -h" to see disk space avail

And what is weight_nsp_ben.csv,  input csv file size ?

I have no such issue  at my server running with your simple  weight_nsp_ben.csv  file posted
in this thread

Duncan
0
 
LVL 109

Expert Comment

by:Ray Paseur
ID: 39757180
It appears that PHP does not have "write" permissions for the place your script tries to put the file.  I don't know much about Mac OSX, but I believe that it closely follows Unix file permissions.  You might want to skip the top of this page and go straight to "Permissions Defined" and read on from there to get some understanding of what you need to do.
http://support.apple.com/kb/ht2963
0
 
LVL 82

Expert Comment

by:hielo
ID: 39757587
>>I even chmodded it to 755.
Be sure to adjust the permissions on the folder as well.
0
 
LVL 109

Expert Comment

by:Ray Paseur
ID: 39757676
Just a thought... PHP has fputcsv() to help with this.  It handles delimiters and enclosure characters more-or-less automatically.
0
 
LVL 13

Expert Comment

by:duncanb7
ID: 39758048
dear sharingsunshine,

Sorry I forgot to put the path in file_put_contents (for my server, it is no need)
probably it seems it is accessible file issue. I suggest

1-On top of my code please add it back,  
chdir(dirname(__FILE__)) since it reported Warning: file_put_contents(/output.csv)
in which that is no directory specified.  And be safe, also modified the code of
file_put_contents("output.csv",$str); to file_put_contents(dirname(__FILE__)."/".
"output.csv",$str);

2-Be reminded,
getchd() will return to the path of main script and
dirname(__FILE__) will return the path of the script currently running

3- Up to now it seems it is permission issue not path extraction issue
so please take a closer look at every directory or sub-directory permission
for the path of /Users/abx/Sites/sandbox/ by "ls -la" command ( or by MAC OS x command)  and look at the right of the directory , group & owner, if need, please change it back to your correct right group and owner by

chown -R -v myloginname *   //change ownership of file
chgrp -R -v myloginname *   //change ownership of group

Probably it is no issue for your system, just for cross-check only in cases

4- Please check  the right of  the your php script file,"test_weight2.php" ,
and correct back its group and owner if you FTP the file from other user account
to your server. If you can edit and save it at the same directoy, "/Users/abx/Sites/sandbox/",
there is impossilbe you can NOT  use file_put_contents to save result or output file if the path
is correct. So question, how you get the php script file on your server ,  from FTP or from server's editor ?

5-I am not quite sure about php permission on MAC system , please try to change
the file of php script, "test_weight2.php" to 777 by chmod -R  for testing to see
it work or not

you should NOT change the output file permission manually since it is impossible to do it
every time when you run your php script and it is not good practices



Hope it help on you to solve the issue finally

Duncan
<?php
chdir(dirname(__FILE__));
$proverbs=file("weight_nsp_ben.csv");$cnt=count($proverbs);$str="";

//-Finding product tag, "!PRODUCTCODE" and "!WEIGHT"
for($i=0;$i<$cnt;$i++){@$producttag=explode(";",$proverbs[$i]);
if(@$producttag[1]=="!PRODUCTCODE" && @$producttag[4]=="!WEIGHT")break;}

//-Extract all product data,and $a=$i+1 is where product starting to explode
//-after getting the product tag code and weight
for($a=$i+1;$a<$cnt;$a++){
$val=explode(";",$proverbs[$a]);
$str=$str.$val[1].";".$val[4].";"."\n";}

//result save in csv format with delimiter ";"
$str=$producttag[1].";".$producttag[4].";"."\n".$str;
file_put_contents(dirname(__FILE__)."/"."output.csv",$str);
echo $str;

?>

Open in new window

0
 

Author Comment

by:sharingsunshine
ID: 39759041
The input file is only 2 MB.  The variable $str is only writing two semi colons ;; to the output.csv file.

the permissions issues was fixed based on the link Ray gave me, the issue was you have to set the permissions on the directory first then apply to all enclosed items.

I still need the file to be created with productcode and weight for each item.  

Thanks,

Randal
0
 
LVL 109

Accepted Solution

by:
Ray Paseur earned 500 total points
ID: 39759335
This seems to test out correctly.

<?php // RAY_fgetcsv.php
error_reporting(E_ALL);

// SEE http://www.experts-exchange.com/Apple/Operating_Systems/OS_X/Q_28330742.html

// NAME OF THE INPUT AND OUTPUT CSV FILE
$csv = 'RAY_temp_sharingsunshine.csv';
$out = 'RAY_temp_sharingsunshine_new.csv';

// OPEN THE INPUT AND DISCARD THE TOP ROW
$fpr = fopen($csv, 'r');
if (!$fpr) trigger_error("CANNOT READ $csv", E_USER_ERROR);
fgets($fpr);

// OPEN THE OUTPUT
$fpw = fopen($out, 'w');
if (!$fpw) trigger_error("CANNOT WRITE $out", E_USER_ERROR);

// GET THE COLUMN NAMES AND LOCATE THE COLUMN OFFSETS WE WANT
$cols = fgetcsv($fpr, 8192, ';');
$code = array_search('!PRODUCTCODE', $cols);
$wght = array_search('!WEIGHT',      $cols);

// READ AND WRITE ONE ROW AT A TIME
while (!feof($fpr))
{
    $row = fgetcsv($fpr, 8192, ";");
    $dat = array($row[$code], $row[$wght]);
    $out = fputcsv($fpw, $dat);
}

Open in new window

Contents of the output CSV at http://www.laprbass.com/RAY_temp_sharingsunshine_new.csv
10810-7,0
14553-4,0
150-6,0
16343-9,0
166-7,0
1672-1,0
1958-8,0

Open in new window

0
 

Author Closing Comment

by:sharingsunshine
ID: 39759647
that is great and does the job.  However, it does show this error after execution

Notice: Undefined offset: 1 in /Users/rjw/Sites/sandbox/test_weight2.php on line 35

Notice: Undefined offset: 4 in /Users/rjw/Sites/sandbox/test_weight2.php on line 35

your line 35 is
 $dat = array($row[$code], $row[$wght]);

If you can explain that it would be great but not mandatory.  Thanks for your help and also telling me how to get the permissions fixed permanently.
0
 
LVL 109

Expert Comment

by:Ray Paseur
ID: 39760262
I think the problem may occur because there is an extra end-of-line character after the last line.  You might add a test to see if the $row variable is empty() and skip those lines.

Thanks for the points and best of luck with your project, ~Ray
0
 

Author Comment

by:sharingsunshine
ID: 39760540
Your welcome on the points and thanks for the additional tip on testing for empty.
0

Featured Post

Complete VMware vSphere® ESX(i) & Hyper-V Backup

Capture your entire system, including the host, with patented disk imaging integrated with VMware VADP / Microsoft VSS and RCT. RTOs is as low as 15 seconds with Acronis Active Restore™. You can enjoy unlimited P2V/V2V migrations from any source (even from a different hypervisor)

Question has a verified solution.

If you are experiencing a similar issue, please ask a related question

Suggested Solutions

In this article we will discuss some EI Capitan Mail app issues and provide some manual process to resolve them.
3 proven steps to speed up Magento powered sites. The article focus is on optimizing time to first byte (TTFB), full page caching and configuring server for optimal performance.
This tutorial will teach you the core code needed to finalize the addition of a watermark to your image. The viewer will use a small PHP class to learn and create a watermark.
The viewer will learn how to create a basic form using some HTML5 and PHP for later processing. Set up your basic HTML file. Open your form tag and set the method and action attributes.: (CODE) Set up your first few inputs one for the name and …

839 members asked questions and received personalized solutions in the past 7 days.

Join the community of 500,000 technology professionals and ask your questions.

Join & Ask a Question