Solved

Perl versus C++ for large file processing

Posted on 2003-10-23
4
1,182 Views
Last Modified: 2007-12-19
We currently are using Perl scripts on a backoffice unix environment to process large data input files.  We are experiencing slow processing times, a limitation of 25 open hash files, and the inability to process files directly that are larger than 2 GB.  Someone in our group wants to change from Perl to C++ to overcome these limitations.  Is this the right move or should we be looking to just tune the existing Perl we have and maybe we are unaware of how to overcome the other limitations I have mentioned above. Any input would be appreciated.    Thanks.
0
Comment
Question by:tigurr
4 Comments
 
LVL 1

Accepted Solution

by:
cluedon earned 125 total points
Comment Utility

sounds like you need some optimization on your perl script.   There's nothing about perl that's creating the limitations you mentioned (that I know of).  A little more detail might allow more detailed advice...

having said that there may be advantages to using c++.   A well written c++ program may end up being faster.   Personally
I think a decision like that should be based on the skills of your staff, either language can solve the problem.  Most people
find perl scripts easier to maintain & most managers find perl skills easier to hire/retain.   If you have a few good c++
programmers who cant handle advanced perl you should use c++.   If you have a few good perl programmers & one c++
zealot then you should use perl.
0

Featured Post

How your wiki can always stay up-to-date

Quip doubles as a “living” wiki and a project management tool that evolves with your organization. As you finish projects in Quip, the work remains, easily accessible to all team members, new and old.
- Increase transparency
- Onboard new hires faster
- Access from mobile/offline

Join & Write a Comment

Suggested Solutions

Does the idea of dealing with bits scare or confuse you? Does it seem like a waste of time in an age where we all have terabytes of storage? If so, you're missing out on one of the core tools in every professional programmer's toolbox. Learn how to …
In this post we will learn how to connect and configure Android Device (Smartphone etc.) with Android Studio. After that we will run a simple Hello World Program.
Viewers will learn how to properly install Eclipse with the necessary JDK, and will take a look at an introductory Java program. Download Eclipse installation zip file: Extract files from zip file: Download and install JDK 8: Open Eclipse and …
In this fourth video of the Xpdf series, we discuss and demonstrate the PDFinfo utility, which retrieves the contents of a PDF's Info Dictionary, as well as some other information, including the page count. We show how to isolate the page count in a…

728 members asked questions and received personalized solutions in the past 7 days.

Join the community of 500,000 technology professionals and ask your questions.

Join & Ask a Question

Need Help in Real-Time?

Connect with top rated Experts

10 Experts available now in Live!

Get 1:1 Help Now