November 19, 2008 01:57am pst

1. Adam314 809,084
2. ozo 479,021
3. FishMonger 141,057
4. Tintin 118,861
5. hielo 74,770
6. mjcoyne 69,328
7. nedfine 45,740
8. clockwatc... 30,424
9. ahoffmann 29,519
10. teraplane 29,380
11. kawas 27,030
12. ravenpl 24,800
13. omarfarid 21,868
14. SmartIntel 21,140
15. oleber 18,950
16. marchent 17,990
17. suhasbha... 17,320
18. ddrudik 14,250
19. nognew 13,250
20. MadShiva 12,300
21. nixfreak 12,200
22. caterham... 11,000
23. hernst42 10,080
24. agriesser 10,000
25. sentner 9,648

1. ozo 3,750,786
2. Adam314 1,731,503
3. Tintin 767,155
4. kandura 579,965
5. mjcoyne 521,466
6. jmcg 517,810
7. FishMonger 493,691
8. maneshr 385,976
9. teraplane 373,588
10. manav_m... 338,348
11. clockwatc... 246,712
12. ahoffmann 215,082
13. rj2 211,481
14. davorg 153,165
15. Tim_Utsc... 113,107
16. shlomoy 109,110
17. gripe 98,559
18. suhasbha... 92,720
19. Perl_Diver 82,106
20. hielo 80,720
21. sstouk 74,470
22. nedfine 73,307
23. jhurst 72,319
24. rugdog 70,951
25. ZiaTioN 66,995

01.11.2005 at 07:11AM PST, ID: 21269887

	[x] Attachment Details

[x]

The Solution Rating System

With so many solutions, how can you tell which solutions are most likely to help you and which ones are not? To provide you with a tool to use, we rate our solutions based on various elements that most accurately determine if a solution is a quality solution. To explain what factors affect the solution rating, here are the elements we take into consideration when formulating our solution rating.

The Grade of the Solution
The Zone Rank of the Expert Providing the Solution
The Number of Author and Expert Comments
The Number of Experts Contributing
The Feedback of the Community

Your Input Matters
Because of the way the system is set up, the most important variable in this equation is you. As a member of Experts Exchange, you are able to cast your vote on the quality of the solutions in regard to how complete, accurate, helpful and easy to understand each solution is. When you provide your feedback, each rating is adjusted accordingly. So, if you see a solution that has a poor rating that you think is a good solution, let us know by rating it. As you do, the rating will be adjusted and will become more accurate for other members of our site.

If you have any suggestions that you would like to make for our rating system, please ask a question in the Suggestions Zone of Community Support.

Thank you!

5.4

parsing a huge file in perl

Asked by shahrahulb in Perl Programming Language

Tags: perl, file, parsing

i m doing the folowing:

1) moving a file from one location to another
2) unzipping that file in new location
3) parsing the file in perl in new location (size of file is approx 130 MB)

because of this it takes a long tiime: (approx 1 minute)

i want to speed up this process:
i m sure i can do someting using shell script command:

the parsing script i m using is:
`cp /u/mirror/mirrors/$day.log.gz /v/admin/extract_logs/`;
`gunzip /v/admin/extract_logs/$day.log.gz`;
open(FD, "/v/admin/extract_logs/$day.log");
while(<FD>) {
if ($_ =~ /$year$month$day.(\d\d)(\d\d)(.*)QBN Execution time: (\d*) ms/) {
$ip{$1}{$2} += $4;
$thread_count{$1}{$2}{'count'} += 1;
}
}
close FD;

this takes 95% of the execution time. this can be replace by gunzip -c piping the output and so on......but don't know how to do it

Thanks,
Start Free Trial

Keywords: parsing a huge file in perl

	Title
1	Converting from PERL to Executable us…
2	Embedd an external Perl script as subr…
3	Perl gunzip
4	Unable to implement the Perl Packager …
5	Can I copy a file from web server to us…
6	App::Packer / PAR question - Cre…

Loading Advertisement...

20080716-EE-VQP-32

parsing a huge file in perl

Asked by shahrahulb in Perl Programming Language

Tags: perl, file, parsing

About this solution