• Status: Solved
  • Priority: Medium
  • Security: Public
  • Views: 222
  • Last Modified:

getting URL contants on file

I have one URL which is showing some logging- So when ever some activity happned -- this URL will show on the browse lower frame and after 10 min. http session will gone. If we refresh this URL what ever previos logs will clear and new session will connect.

So I would like one small script which will keep on fetching logs from URL and append to the HTML file as I want to save URL logging to my machine for future ref..

Anybody can help..
0
arvind
Asked:
arvind
  • 5
  • 4
  • 2
  • +2
1 Solution
 
jimbbCommented:
Hi, I'm not sure I understand exactly what you mean.  By "URL" do you mean the actual link ('http:/blabla/') or the page itself?

Would you be able to use the 'wget' command to direct the page to a file?

wget -O - www.whatever.org >> logfile

Please clarify if that's not what you mean.
0
 
samriCommented:
or you can you lynx (http://lynx.browser.org/), and use

lynx -source http://www.anysite.com > output.txt

and you can examine the output in output.txt (the file would be the HTML source).

cheers
0
 
arvindAuthor Commented:
yeah that is Perfect HTTP URL and this is kind of network logger. so for gettting that contecting --I'm keep connceted that URL on browser -- when ever some activity will happen -- browser will show the log. After 10 min(or depand on net connectivity). it will show "Logger session closed due to inactivity." ...

So Id tried lynx option which is submited by samri -- lynx will collect data and quit.. But I would to connect as session and when ever we'll get "Logger session closed due to inactivity." we need to reconnect the session...

I think this will help
0
VIDEO: THE CONCERTO CLOUD FOR HEALTHCARE

Modern healthcare requires a modern cloud. View this brief video to understand how the Concerto Cloud for Healthcare can help your organization.

 
samriCommented:
arvind,

is this link goes to a standard HTML document, and not PHP, CGI, SHTML, etc. etc.

I would suspect that the page you are visiting is somehow have some persistent connection stuff being implemented.

Check the html documents for any Java/Javascript code for any clue.

cheers.
0
 
arvindAuthor Commented:
Samri,,


This is JSP page -- so same like CGI -- dynamic content.
0
 
samriCommented:
hi Arvind,

I would suspect that the server-side is keeping track of session information, and expire it once you are idle (or after a preset time).

One possibility that I can think of (at the moment) would be running some kind of proxy server (locally) which logs all session.  Most proxy would allow this (even the free one).   I personally use Deerfield Interquick (long gone - but search thru the web may yield some download location.  I found an old Deerfield mirror - http://ftp.k2.net/mirrors/deerfield/pub/current/iqsetup.exe), or Squid (Unix and NT).  Anyway, whatever 3rd party product, we are interested to keep track of the session loggin -- just as you wanted it.

give the option a try, and let us know.
0
 
arvindAuthor Commented:
Samri,

My basic question is how we trap the URL logging to one file-- during this period whatever is going on like session closed or new session.

I would like the script which will stay connected to URL and when ever session got disconnect --script will connect new session ..

Some Suggestion -- need to track sessionid or cookies
0
 
samriCommented:
hi arvind,

if that is the case, you could use lynx (http://www.lynxbrowser.org/).  Lynx has several feature where you could save session cookie, trace session, etc.

0
 
arvindAuthor Commented:
Samri -- that means I need to create script to myself -- OK what ever you people like. I'll create script
0
 
veerunsCommented:
you could use
perl::LWP arvnd..it could help you
there is openbook on perl LWP o'reilly
u could use that
hope it help
veeruns
0
 
arvindAuthor Commented:
Tried LWP but its not session based. Am still working to solve this problem
0
 
moduloCommented:
Dear expert(s),

A request has been made to close this Q in CS:
http://www.experts-exchange.com/Community_Support/Q_20592203.html

Without a response in 72 hrs, a moderator will finalize this question by:

 - Saving this Q as a PAQ and refunding the points to the questionner

When you agree or disagree, please add a comment here.

Thank you.

modulo

Community Support Moderator
Experts Exchange
0
 
moduloCommented:
Saving this Q as a PAQ and refunding the points to the questionner

modulo

Community Support Moderator
Experts Exchange
0

Featured Post

Get your problem seen by more experts

Be seen. Boost your question’s priority for more expert views and faster solutions

  • 5
  • 4
  • 2
  • +2
Tackle projects and never again get stuck behind a technical roadblock.
Join Now