Solved

Perl versus C++ for large file processing

Posted on 2003-10-23
4
1,216 Views
Last Modified: 2007-12-19
We currently are using Perl scripts on a backoffice unix environment to process large data input files.  We are experiencing slow processing times, a limitation of 25 open hash files, and the inability to process files directly that are larger than 2 GB.  Someone in our group wants to change from Perl to C++ to overcome these limitations.  Is this the right move or should we be looking to just tune the existing Perl we have and maybe we are unaware of how to overcome the other limitations I have mentioned above. Any input would be appreciated.    Thanks.
0
Comment
Question by:tigurr
4 Comments
 
LVL 1

Accepted Solution

by:
cluedon earned 125 total points
ID: 10021710

sounds like you need some optimization on your perl script.   There's nothing about perl that's creating the limitations you mentioned (that I know of).  A little more detail might allow more detailed advice...

having said that there may be advantages to using c++.   A well written c++ program may end up being faster.   Personally
I think a decision like that should be based on the skills of your staff, either language can solve the problem.  Most people
find perl scripts easier to maintain & most managers find perl skills easier to hire/retain.   If you have a few good c++
programmers who cant handle advanced perl you should use c++.   If you have a few good perl programmers & one c++
zealot then you should use perl.
0

Featured Post

Free Tool: Site Down Detector

Helpful to verify reports of your own downtime, or to double check a downed website you are trying to access.

One of a set of tools we are providing to everyone as a way of saying thank you for being a part of the community.

Question has a verified solution.

If you are experiencing a similar issue, please ask a related question

A short article about problems I had with the new location API and permissions in Marshmallow
This is about my first experience with programming Arduino.

733 members asked questions and received personalized solutions in the past 7 days.

Join the community of 500,000 technology professionals and ask your questions.

Join & Ask a Question