Solved

Importing very large text file into ACL (Audit Command Language)

Posted on 2008-06-17
4
3,974 Views
Last Modified: 2013-11-15
Hi experts,

I have a big text file (4 gigs; 7 million lines). I'm trying to import this to ACL, but found that it gave me an error "can only defineASCII file with carriage return/line feed character".

It's delimited by pipes ("|") with around 10 fields or so. Some of the lines have errors, such as what supposed to be one row is broken up to two rows.

I've tried ConTEXT, Notepad++ and Crimson Editor and they can't handle it. LTFViewer can view the file, but it can't do anything besides viewing. I had previously encountered the same problem, but with a much smaller file (around hundred of megs); what I did was import the file into access and get ACL to import from Access. This doesn't work since this file is too big.

My goal is to somehow give the file carriage returns so that I can import it to ACL.

I'm working in Windows XP environment.
0
Comment
Question by:nenrico
[X]
Welcome to Experts Exchange

Add your voice to the tech community where 5M+ people just like you are talking about what matters.

  • Help others & share knowledge
  • Earn cash & points
  • Learn & ask questions
4 Comments
 
LVL 23

Accepted Solution

by:
debuggerau earned 500 total points
ID: 21810552
nice thing with text files is you can split and join them with relative ease.
any of the file splitters should get you into bite size chunks.

winsplitter comes to mind.
0
 

Author Closing Comment

by:nenrico
ID: 31468234
Good suggestion, but unfortunately this text file has weird formatting, which render the split files unreadable.
0
 
LVL 1

Expert Comment

by:yamiho
ID: 22069730
Yes, split the huge file into smaller files. try to import those smaller files and it will be lot easier to import. Also you can easily debug.

Cheers
Yamiho
0
 

Expert Comment

by:PaulPicard47
ID: 22167299
There is no need to split the data file into smaller files.
ACL can easily define a text data file that does not have carriage returns.
For ACL standards, 7 million lines is not an excessively large file.
Do you know exactly how many of the 7 million lines have errors? This would be an interesting point to find out and the nature of those errors.
How do you know that one line is finished? If you could send me a cleaned up version (sensitive data masked) I could show you how to define that file directly with ACL.
Regards,
PaulP
0

Featured Post

Get Database Help Now w/ Support & Database Audit

Keeping your database environment tuned, optimized and high-performance is key to achieving business goals. If your database goes down, so does your business. Percona experts have a long history of helping enterprises ensure their databases are running smoothly.

Question has a verified solution.

If you are experiencing a similar issue, please ask a related question

When it comes to protecting Oracle Database servers and systems, there are a ton of myths out there. Here are the most common.
A company’s centralized system that manages user data, security, and distributed resources is often a focus of criminal attention. Active Directory (AD) is no exception. In truth, it’s even more likely to be targeted due to the number of companies …
Video by: Steve
Using examples as well as descriptions, step through each of the common simple join types, explaining differences in syntax, differences in expected outputs and showing how the queries run along with the actual outputs based upon a simple set of dem…
Polish reports in Access so they look terrific. Take yourself to another level. Equations, Back Color, Alternate Back Color. Write easy VBA Code. Tighten space to use less pages. Launch report from a menu, considering criteria only when it is filled…

752 members asked questions and received personalized solutions in the past 7 days.

Join the community of 500,000 technology professionals and ask your questions.

Join & Ask a Question