?
Solved

Perl versus C++ for large file processing

Posted on 2003-10-23
4
Medium Priority
?
1,230 Views
Last Modified: 2007-12-19
We currently are using Perl scripts on a backoffice unix environment to process large data input files.  We are experiencing slow processing times, a limitation of 25 open hash files, and the inability to process files directly that are larger than 2 GB.  Someone in our group wants to change from Perl to C++ to overcome these limitations.  Is this the right move or should we be looking to just tune the existing Perl we have and maybe we are unaware of how to overcome the other limitations I have mentioned above. Any input would be appreciated.    Thanks.
0
Comment
Question by:tigurr
[X]
Welcome to Experts Exchange

Add your voice to the tech community where 5M+ people just like you are talking about what matters.

  • Help others & share knowledge
  • Earn cash & points
  • Learn & ask questions
4 Comments
 
LVL 1

Accepted Solution

by:
cluedon earned 500 total points
ID: 10021710

sounds like you need some optimization on your perl script.   There's nothing about perl that's creating the limitations you mentioned (that I know of).  A little more detail might allow more detailed advice...

having said that there may be advantages to using c++.   A well written c++ program may end up being faster.   Personally
I think a decision like that should be based on the skills of your staff, either language can solve the problem.  Most people
find perl scripts easier to maintain & most managers find perl skills easier to hire/retain.   If you have a few good c++
programmers who cant handle advanced perl you should use c++.   If you have a few good perl programmers & one c++
zealot then you should use perl.
0

Featured Post

Get real performance insights from real users

Key features:
- Total Pages Views and Load times
- Top Pages Viewed and Load Times
- Real Time Site Page Build Performance
- Users’ Browser and Platform Performance
- Geographic User Breakdown
- And more

Question has a verified solution.

If you are experiencing a similar issue, please ask a related question

This is about my first experience with programming Arduino.
In this post we will learn how to connect and configure Android Device (Smartphone etc.) with Android Studio. After that we will run a simple Hello World Program.
Simple Linear Regression
Progress

771 members asked questions and received personalized solutions in the past 7 days.

Join the community of 500,000 technology professionals and ask your questions.

Join & Ask a Question