I sometime use sas to query web sites multiple times by running a macro that changes the values of the input parameters and then save the results to a sas dataset where I can parse out the information I need. The problem is that I have trouble with the return webpage getting truncated either by width and/or length.
When I run the code below, I get a 282 records, lots of which are empty and not the complete webpage. How can set record length so that I get all the data and preferably on one line?
I would be willing to get a perl or python answer, but the respondant is going to have to spoon feed me.
filename foo url
data a ;
infile foo length=len;
input record $varying5000. len;