• Status: Solved
  • Priority: Medium
  • Security: Public
  • Views: 4137
  • Last Modified:

Importing very large text file into ACL (Audit Command Language)

Hi experts,

I have a big text file (4 gigs; 7 million lines). I'm trying to import this to ACL, but found that it gave me an error "can only defineASCII file with carriage return/line feed character".

It's delimited by pipes ("|") with around 10 fields or so. Some of the lines have errors, such as what supposed to be one row is broken up to two rows.

I've tried ConTEXT, Notepad++ and Crimson Editor and they can't handle it. LTFViewer can view the file, but it can't do anything besides viewing. I had previously encountered the same problem, but with a much smaller file (around hundred of megs); what I did was import the file into access and get ACL to import from Access. This doesn't work since this file is too big.

My goal is to somehow give the file carriage returns so that I can import it to ACL.

I'm working in Windows XP environment.
0
nenrico
Asked:
nenrico
1 Solution
 
debuggerauCommented:
nice thing with text files is you can split and join them with relative ease.
any of the file splitters should get you into bite size chunks.

winsplitter comes to mind.
0
 
nenricoAuthor Commented:
Good suggestion, but unfortunately this text file has weird formatting, which render the split files unreadable.
0
 
yamihoCommented:
Yes, split the huge file into smaller files. try to import those smaller files and it will be lot easier to import. Also you can easily debug.

Cheers
Yamiho
0
 
PaulPicard47Commented:
There is no need to split the data file into smaller files.
ACL can easily define a text data file that does not have carriage returns.
For ACL standards, 7 million lines is not an excessively large file.
Do you know exactly how many of the 7 million lines have errors? This would be an interesting point to find out and the nature of those errors.
How do you know that one line is finished? If you could send me a cleaned up version (sensitive data masked) I could show you how to define that file directly with ACL.
Regards,
PaulP
0

Featured Post

Never miss a deadline with monday.com

The revolutionary project management tool is here!   Plan visually with a single glance and make sure your projects get done.

Tackle projects and never again get stuck behind a technical roadblock.
Join Now