jamesbuckney
asked on
Using cookies with WWW::Mechanize...
I am trying to screen scrape from a web site, my code works fine for sites which don't involve cookies. however, the web site i am trying to access requires that a browser have cookies enabled to log in.
what is the best way to go about solving this problem. i have considered:
1. implicitly setting the header of my my agent to the Cookie value required for the site.
2. somehow getting the Mechanize agent to have cookies enabled - but i am not sure how to go about doing this? i have tried giving it an empty cookie_jar object from HTTP::Cookie but that did not seem to work.
I am fairly new to perl and would appreciate any hints and tips anyone might have.
many thanks
james
what is the best way to go about solving this problem. i have considered:
1. implicitly setting the header of my my agent to the Cookie value required for the site.
2. somehow getting the Mechanize agent to have cookies enabled - but i am not sure how to go about doing this? i have tried giving it an empty cookie_jar object from HTTP::Cookie but that did not seem to work.
I am fairly new to perl and would appreciate any hints and tips anyone might have.
many thanks
james
ASKER CERTIFIED SOLUTION
membership
This solution is only available to members.
To access this solution, you must be a member of Experts Exchange.
Nothing has happened on this question in more than 7 weeks. It's time for cleanup!
My recommendation, which I will post in the Cleanup topic area, is to
accept answer by jmcg [grade B] (it's correct but whether it solves the problem is hard to know, asker abandoned question).
Please leave any comments here within the next seven days.
PLEASE DO NOT ACCEPT THIS COMMENT AS AN ANSWER!
jmcg
EE Cleanup Volunteer
My recommendation, which I will post in the Cleanup topic area, is to
accept answer by jmcg [grade B] (it's correct but whether it solves the problem is hard to know, asker abandoned question).
Please leave any comments here within the next seven days.
PLEASE DO NOT ACCEPT THIS COMMENT AS AN ANSWER!
jmcg
EE Cleanup Volunteer
I know that there was a problem with email notifications going out around 4 December (I certainly missed quite a few), so perhaps you are thinking we ignored your first question because Experts Exchange never seemed to contact you again. Maybe you'll get a notification this time and revisit your question.