Fetch a .jsp generated page using LWP & Perl

I would like to fetch a web page using the  LWP module, and have the results parsed and then
email users based on the contents of the page.  I have a perl scrip tthat I can modify  to do that.
My problem is,  the website I need the information from generates the page using  javascript,
 and the results appear on the browser  with the extension of .jsp (example: : landregister_new.jsp) ,
which is difficult  for me to even print the screen on, using my netscape 4.6,  let alone return something
 suitable  for parsing.

Can anyone provide  a perl script or some java code or whatever,  to convert the .jsp to html (preferably)
 or ascii, or .txt or  something that I can handle with a perl script ?
caciquemanAsked:
Who is Participating?
I wear a lot of hats...

"The solutions and answers provided on Experts Exchange have been extremely helpful to me over the last few years. I wear a lot of hats - Developer, Database Administrator, Help Desk, etc., so I know a lot of things but not a lot about one thing. Experts Exchange gives me answers from people who do know a lot about one thing, in a easy to use platform." -Todd S.

jmcgOwnerCommented:
A suffix of .jsp means that Java Server Pages is being used to generate the page, but what arrives in response to the request should still be HTML, possibly with embedded Javascript. Unless some fancy games are being played, the data you want should probably be there in the HTML. Perhaps if you could provide a sample or example of what's causing you a problem?

Do you have 'lynx' available? It's a text-only browser. Can it render the data you want on these pages? If so, another approach you can take is to dump the page with lynx and use ordinary regular expressions and such to take the page apart and extract the data you're interested in.
0
caciquemanAuthor Commented:
I don't have lynx, and I am fetching this for use on a unix server, and then parsing
the html for certain phrases.  I think the problem is arising because the html page
that calls the .jsp page is fine, but from the .jsp page you need to make a further
selection to proceed....so basically that's why I wanted a script to be able to pass
from the .jsp page one to page two, WITH the completed choice from page one. I
know the data that I need passed, so thats not a problem.
0
jmcgOwnerCommented:
Lynx is available for free for UNIX, so you _could_ have lynx.

Aside from that, you need to examine how the .jsp page is passing the choice made on to the next step. Is it a <form>? A list of different URL links? It should be apparent from the source of the page how it's being done -- your LWP script simply needs to simulate that step.
0

Experts Exchange Solution brought to you by

Your issues matter to us.

Facing a tech roadblock? Get the help and guidance you need from experienced professionals who care. Ask your question anytime, anywhere, with no hassle.

Start your 7-day free trial
caciquemanAuthor Commented:
I won't go the lynx route but thank you for your information.
0
It's more than this solution.Get answers and train to solve all your tech problems - anytime, anywhere.Try it for free Edge Out The Competitionfor your dream job with proven skills and certifications.Get started today Stand Outas the employee with proven skills.Start learning today for free Move Your Career Forwardwith certification training in the latest technologies.Start your trial today
Perl

From novice to tech pro — start learning today.

Question has a verified solution.

Are you are experiencing a similar issue? Get a personalized answer when you ask a related question.

Have a better answer? Share it in a comment.