What language is the faster for large file processing?

What programming language is the fastest, least processor intensive language for processing large files.  An example would be Web Logs.


Thanks!

Randy
LVL 6
rjohnsonjrAsked:
Who is Participating?
I wear a lot of hats...

"The solutions and answers provided on Experts Exchange have been extremely helpful to me over the last few years. I wear a lot of hats - Developer, Database Administrator, Help Desk, etc., so I know a lot of things but not a lot about one thing. Experts Exchange gives me answers from people who do know a lot about one thing, in a easy to use platform." -Todd S.

ozoCommented:
It would depend a lot on what you write in that language, but the assembly language for the processor you are running would allow you to write the fastest, least processor intensive code.
0

Experts Exchange Solution brought to you by

Your issues matter to us.

Facing a tech roadblock? Get the help and guidance you need from experienced professionals who care. Ask your question anytime, anywhere, with no hassle.

Start your 7-day free trial
fridomCEO/ProgrammerCommented:
Languages optimized for such kind of task. ozo is of course right, however the following languages should be near-by
- C
- Ocaml
- Perl (optimized for string manipulatons)

Regards
Friedrich
0
anteuszCommented:
Of course, if you take the time to write the program into account, assembly language may not
 be the best if you cannot learn it fast enough...
What languages do you know already?
Maybe selecting a language that is close to the one you already know, can give you higher productivity.
0
Upgrade your Question Security!

Your question, your audience. Choose who sees your identity—and your question—with question security.

marco_delpercioCommented:
Hi

I suggest Perl. It's easy to learn instead of C/C++ and it's maybe the best text processing language, well on the other hand you'll have to manage regular expressions wich are not so easy but even with simple regular expressions you'll save much much development time for file parsing. Moreover Perl is cross-platform and you will easily find a perl interpreter on most web servers.

Marco Del Percio

0
rjohnsonjrAuthor Commented:
I know some c++, some java, some perl, php, coldfusion, cobol, not enough of assembly language to write any program in it.  I was thinking c or Perl.  I have never heard of Ocaml
0
fridomCEO/ProgrammerCommented:
Ocaml is a multi paradigmn language (with static types)
It a functionalk and object oriented language in one go (others in that class are:
Common Lisp, Mozart/Oz)

Ocamls homepage is at:
http://caml.inria.fr/

You can see how well it scales regarding speed at:
http://shootout.alioth.debian.org/

It's one of those totalyl underestimated fine languages, which people simple do not even try. It's a pitty really.

Regards
Friedrich
0
TimYatesCommented:
I process massive files in Java...

The speed is more than likely going to depend on how you do it, rather than what language you use...

Tim
0
anteuszCommented:
Actually, C/C++ is one of the fastest languages after assembly, I think.
So you can use it if you are comfortable with it.
On the other hand, it is more harder to maintain C/C++ programs as they have to be compiled.
Perl is almost available everywhere and it can be maintained faster.
What is more important to you, speed or maintainanability?

The question for me is what an acceptable running time for you and how complicated the processing is.
0
rjohnsonjrAuthor Commented:
The main thing would be a program that is not processor intensive, followed by speed.  Maintainability is not really an issue as I would not have to change it much.

-Randy
0
TimYatesCommented:
>> Maintainability is not really an issue as I would not have to change it much.

Those are famous last words ;-)

Tim
0
rjohnsonjrAuthor Commented:
lol yep,  that's for sure,  
0
cupCommented:
I don't know what Cobol compilers are like nowadays.  In the early 80s they were the compilers which generated the best code.  They were geared towards processing large batches of data and most of them are quite well optimized for that.  However, I haven't used Cobol in anger since the early 80s and certainly not on the same machine as C/C++ so I can't compare the two.
0
TimYatesCommented:
I think these days, all main languages are pretty much as fast as each other.  Especially for something as "run of the mill" as file processing...

Tim
0
i_maheshCommented:
Perl is quite optimized for this purpose.
0
Leo EikelmanDirector, IT and Business DevelopmentCommented:
If you are talking about LARGE files then you should use a tree structure to parse threw the file.

You can do this using ANSI C.

look at this link for code examples:

http://www.devincook.com/goldparser/engine/c.htm

cheers,

Leo
0
It's more than this solution.Get answers and train to solve all your tech problems - anytime, anywhere.Try it for free Edge Out The Competitionfor your dream job with proven skills and certifications.Get started today Stand Outas the employee with proven skills.Start learning today for free Move Your Career Forwardwith certification training in the latest technologies.Start your trial today
Programming Languages-Other

From novice to tech pro — start learning today.

Question has a verified solution.

Are you are experiencing a similar issue? Get a personalized answer when you ask a related question.

Have a better answer? Share it in a comment.