I have a csv file where one of the fields contains the new line character, when I load the file using the sql loader it gives me the error.
Here is the data file
4/24/2000,Chemical Engineering Graduate Student Association (ChEGSA) at Carnegie Mellon University,"Carnegie Mellon University
Department of Chemical Engineering
Attn: Warren R. Hoffmaster
1107 Doherty Hall
Pittsburgh, Pennsylvania 15213-3890",412-268-2230,,
Letter dated: 09/12/00",,,1517273,
and the control file
LOAD DATA
infile 'f:\projects\contributions
badfile 'f:\projects\contributions
discardfile 'f:\projects\contributions
TRUNCATE
INTO TABLE temp_cont_table
FIELDS TERMINATED BY ',' OPTIONALLY ENCLOSED BY '"' TRAILING NULLCOLS
(req_received_dt,
requestor_name,
req_address CHAR "replace(:req_address, chr(10), '')",
req_phone,
req_taxid,
req_eventname,
req_eventdates,
req_location,
req_min_amtreq,
req_amtreq,
req_amtfunded,
req_reviewers,
req_reviewers2,
req_reviewers3,
req_reviewers4,
req_recommend,
req_sentrev CHAR "replace(:req_address, chr(10), '')",
req_history CHAR "replace(:req_address, chr(10), '')",
req_checkreq,
req_paydate,
req_checknbr,
req_chk_date,
req_cont_table_id "cont_table_seq.nextval")
loader is treating each new line character is new record .
Can anybody help.
This Question has been solved and asker verified All Experts Exchange premium technology solutions are available to subscription members.
Experts Exchange has been collecting answers to technology questions since 1996…3 million and counting! If you have a question, chances are we already have your answer.
If you can't find the exact answer you're looking for, ask our exclusive community of 50,000 experts. You’ll get a personalized answer from a trusted professional.
Thousands of free tech tips, tricks, how-to’s and tutorials are available in our peer reviewed articles section. See for yourself how smart our experts are, no login required.
Save solutions to your questions, answers you’ve discovered through searching plus helpful articles in your personal knowledgebase for easy future access.
Access the answers to your technology questions today.
30-day free trial. Register in 60 seconds.
Members of the expert community talk about why the experience at Experts Exchange is different than what you will find anywhere else.
Try it out and discover for yourself.
30-day free trial. Register in 60 seconds.
Join the community of experts here and help other tech pros by answering question in your area of expertise. You can earn FREE access to all Experts Exchange's premium features and resources.
Have you tried adding "ENCLOSED BY" and extra delimiters to the field that contains the newlines?
http://www.csis.gvsu.edu/G
Example 7-16 Loading LOB Data in Delimited Fields
Control File Contents
LOAD DATA
INFILE 'sample.dat' "str '|'"
INTO TABLE person_table
FIELDS TERMINATED BY ','
(name CHAR(25),
1 "RESUME" CHAR(507) ENCLOSED BY '<startlob>' AND '<endlob>')
Datafile (sample.dat)
Johny Quest,<startlob> Johny Quest
500 Oracle Parkway
jquest@us.oracle.com ... <endlob>
2 |Speed Racer, .......
Notes
<startlob> and <endlob> are the enclosure strings. With the default byte-length semantics, the maximum length for a LOB that can be read using CHAR(507) is 507 bytes. If character-length semantics were used, the maximum would be 507 characters. See Character-Length Semantics.
If the record separator '|' had been placed right after <endlob> and followed with the newline character, the newline would have been interpreted as part of the next record. An alternative would be to make the newline part of the record separator (for example, '|\n' or, in hexadecimal notation, X'7C0A').
No comment has been added lately, so it's time to clean up this TA.
I will leave a recommendation in the Cleanup topic area that this question is:
Accept er0ck's comment as answer.
Please leave any comments here within the next seven days.
PLEASE DO NOT ACCEPT THIS COMMENT AS AN ANSWER!
Henka
EE Cleanup Volunteer
Business Accounts
Answer for Membership
by: kursattuncelPosted on 2002-12-13 at 00:59:17ID: 7577061
1.) Copy your csv file as "input.csv"
2.) Save the attached file as "furnish.c" and compile
under unix
(gcc -o furnish furnish.c)
3.) run the command ./furnish > output.csv
4.) check the output.csv to make sure that everything is correct.
Best Regards,
Kursat Tuncel
--- cut here---
// furnish.c
// written by Kursat Tuncel, kursattuncel@hotmail.com
#include <stdio.h>
#include <string.h>
int main(int argc, char* argv[])
{
char buffer[1024];
char nextchar;
FILE *input;
int count = 0;
int slot = 0;
input = fopen("input.csv","r");
while(!feof(input))
{
nextchar = getc(input);
if (nextchar == ',') count++;
if (count != 23) buffer[slot++] = nextchar;
else
{
buffer[slot++] = nextchar;
buffer[slot] = '\0';
slot = 0;
while (buffer[slot] != '\0')
{
if (buffer[slot] == '\n' && slot != 0)
buffer[slot] = ' ';
slot++;
}
count = 0;
slot = 0;
printf("%s", buffer);
}
}
}