November 19, 2008 12:23am pst

1. Tintin 109,032
2. ozo 106,990
3. omarfarid 103,014
4. sirbounty 20,975
5. sunnycoder 20,640
6. hernst42 19,800
7. Adam314 18,230
8. RobSamp... 16,975
9. ahoffmann 16,895
10. blu 15,530
11. ghostdog74 14,871
12. sentner 14,300
13. MikeOM_... 13,300
14. mikelfritz 13,100
15. Shift-3 13,000
15. BSonPosh 13,000
17. AmazingT... 12,600
18. amit_g 10,000
19. merowinger 8,200
20. sungenw... 7,600
21. JustUNIX 7,435
22. knightEkni... 7,000
22. hielo 7,000
24. agriesser 6,032
25. duncan_roe 5,116

1. ozo 164,528
2. Tintin 162,818
3. omarfarid 125,257
4. ahoffmann 43,666
5. amit_g 42,400
6. RobSamp... 36,150
7. hernst42 34,500
8. sirbounty 32,575
9. Adam314 23,965
10. sunnycoder 21,040
11. Shift-3 20,600
12. BSonPosh 19,350
13. ghostdog74 18,481
14. blu 15,530
15. sentner 14,300
16. ravenpl 14,200
17. MikeOM_... 13,300
18. mikelfritz 13,100
19. AmazingT... 12,600
20. SteveGTR 11,550
21. duncan_roe 9,816
22. merowinger 8,200
23. oBdA 7,800
23. nixfreak 7,800
25. sungenw... 7,600

08.06.2008 at 06:19AM PDT, ID: 23625497

	[x] Attachment Details

[x]

The Solution Rating System

With so many solutions, how can you tell which solutions are most likely to help you and which ones are not? To provide you with a tool to use, we rate our solutions based on various elements that most accurately determine if a solution is a quality solution. To explain what factors affect the solution rating, here are the elements we take into consideration when formulating our solution rating.

The Grade of the Solution
The Zone Rank of the Expert Providing the Solution
The Number of Author and Expert Comments
The Number of Experts Contributing
The Feedback of the Community

Your Input Matters
Because of the way the system is set up, the most important variable in this equation is you. As a member of Experts Exchange, you are able to cast your vote on the quality of the solutions in regard to how complete, accurate, helpful and easy to understand each solution is. When you provide your feedback, each rating is adjusted accordingly. So, if you see a solution that has a poor rating that you think is a good solution, let us know by rating it. As you do, the rating will be adjusted and will become more accurate for other members of our site.

If you have any suggestions that you would like to make for our rating system, please ask a question in the Suggestions Zone of Community Support.

Thank you!

8.2

Need a shell script to copy html files from remote sever, read those html file and extract the particular data and put the data in new file

Asked by kvjajoo in Shell Scripting, Linux Administration, Bourne-Again Shell (bash)

Tags: Shell Script, Linux shell scripting

Hi,

I have been give a task to collect the usage stats from multiple virtual hosts we have on linux web server and put the summary of the data into new text or excel spreadsheet. Below is the explanation:

We have a linux web server which host multiple virtual hosts. Each of host site generate the html file at the end of each month which contain the information as follows :

Total Hits 418741
Total Files 377639
Total Pages 143324
Total Visits 29678
Total KBytes 15715617
Total Unique Sites 11912
Total Unique URLs 2722
Total Unique Referrers 2314
Total Unique Usernames 2
Total Unique User Agents 1251

This html file is generated by Webalizer. The html file is stored in /var/www/vhosts/<vhostname>/statistics/webstat/usage_<year><month>.html
For example : var/www/vhosts/xyz.com/statistics/webstat/usage_200806.html

Following are the html codes from the html file which displays the above data.

<TR><TD WIDTH=380>Total Hits</TD>
<TD ALIGN=right COLSPAN=2>279242</TD></TR>
<TR><TD WIDTH=380>Total Files</TD>
<TD ALIGN=right COLSPAN=2>209861</TD></TR>
<TR><TD WIDTH=380>Total Pages</TD>
<TD ALIGN=right COLSPAN=2>44464</TD></TR>
<TR><TD WIDTH=380>Total Visits</TD>
<TD ALIGN=right COLSPAN=2>9029</TD></TR>
<TR><TD WIDTH=380>Total KBytes</TD>
<TD ALIGN=right COLSPAN=2>15578780</TD></TR>
<TR><TH HEIGHT=4></TH></TR>
<TR><TD WIDTH=380>Total Unique Sites</TD>
<TD ALIGN=right COLSPAN=2>5606</TD></TR>
<TR><TD WIDTH=380>Total Unique URLs</TD>
<TD ALIGN=right COLSPAN=2>204</TD></TR>
<TR><TD WIDTH=380>Total Unique Referrers</TD>
<TD ALIGN=right COLSPAN=2>1025</TD></TR>
<TR><TD WIDTH=380>Total Unique User Agents</TD>
<TD ALIGN=right COLSPAN=2>605</TD></TR>

Now i have one more linux box which can access this web server box via ssh or sftp with root credentials. I want a shell script which will be executed on the linux box (not web server) should do the following :

1. copy the latest usage_<year><month>.html from each virtual host's webstats directory from the web server ( please note the html file's names are similer for each host so the vhost name should be appended in the begining of the file so the new file will be <vhostname>usage_<year><month>.html

2. grab the data i want ( i have mention the required data in begining) from html files and put them into one single in one vhost data in one line format so i can paste them in excel. So the format should be somthing like this : <vhostname> <Total Hits> <Total Files> <Total Pages> <Total Visits> and so on ....

I am a absolute beginner in shell scripting area.Start Free Trial

Keywords: Need a shell script to copy html files fr…

	Title
1	ssh shell script read password from tx…
2	ssh and then change shell
3	Use SQL Server 2005 to Open Emai…
4	SSH delete specific files
5	SSH Library
6	not able to get uname in shell script

Loading Advertisement...

20080716-EE-VQP-32 / EE_QW_2_20070628

Need a shell script to copy html files from remote sever, read those html file and extract the particular data and put the data in new file

Asked by kvjajoo in Shell Scripting, Linux Administration, Bourne-Again Shell (bash)

Tags: Shell Script, Linux shell scripting

About this solution