Solved

Perl versus C++ for large file processing

Posted on 2003-10-23
4
1,227 Views
Last Modified: 2007-12-19
We currently are using Perl scripts on a backoffice unix environment to process large data input files.  We are experiencing slow processing times, a limitation of 25 open hash files, and the inability to process files directly that are larger than 2 GB.  Someone in our group wants to change from Perl to C++ to overcome these limitations.  Is this the right move or should we be looking to just tune the existing Perl we have and maybe we are unaware of how to overcome the other limitations I have mentioned above. Any input would be appreciated.    Thanks.
0
Comment
Question by:tigurr
[X]
Welcome to Experts Exchange

Add your voice to the tech community where 5M+ people just like you are talking about what matters.

  • Help others & share knowledge
  • Earn cash & points
  • Learn & ask questions
4 Comments
 
LVL 1

Accepted Solution

by:
cluedon earned 125 total points
ID: 10021710

sounds like you need some optimization on your perl script.   There's nothing about perl that's creating the limitations you mentioned (that I know of).  A little more detail might allow more detailed advice...

having said that there may be advantages to using c++.   A well written c++ program may end up being faster.   Personally
I think a decision like that should be based on the skills of your staff, either language can solve the problem.  Most people
find perl scripts easier to maintain & most managers find perl skills easier to hire/retain.   If you have a few good c++
programmers who cant handle advanced perl you should use c++.   If you have a few good perl programmers & one c++
zealot then you should use perl.
0

Featured Post

Industry Leaders: We Want Your Opinion!

We value your feedback.

Take our survey and automatically be enter to win anyone of the following:
Yeti Cooler, Amazon eGift Card, and Movie eGift Card!

Question has a verified solution.

If you are experiencing a similar issue, please ask a related question

A short article about problems I had with the new location API and permissions in Marshmallow
Today, the web development industry is booming, and many people consider it to be their vocation. The question you may be asking yourself is – how do I become a web developer?
In this fifth video of the Xpdf series, we discuss and demonstrate the PDFdetach utility, which is able to list and, more importantly, extract attachments that are embedded in PDF files. It does this via a command line interface, making it suitable …
Starting up a Project

726 members asked questions and received personalized solutions in the past 7 days.

Join the community of 500,000 technology professionals and ask your questions.

Join & Ask a Question