downloading data using a webquery in SSIS.

In MS Excel, the ability exists to run a "web query." This function is accessed via the data menu's import external data option. The web
query wizard accepts a URL address, and then is able to import the data from that address into an excel worksheet.

Is there any way to launch this using SSIS
vbnetcoderAsked:
Who is Participating?

Improve company productivity with a Business Account.Sign Up

x
 
Megan BrooksConnect With a Mentor SQL Server ConsultantCommented:
If the website hosts a web service then you may be able to query it using a Web Service Task.

Otherwise, you might be able to read from an Excel file that performs the web query for you. I have not found a good example for doing that, and I would be concerned about reliability.

I have written "scrapers" that open a website as HTML, parse it, and extract what they need. This is essentially the equivalent of Web Query, but it can be a lot more work. If I remember correctly, I was able to use the Internet Explorer API to do this from an SSIS script task, so that I could look at the DOM data and not have to actually parse the HTML myself. It was a lot more work than Web Query, and there were hangups (literally) that I had to work out, but whatever API I ended up using, it worked reliably for several years. Fortunately, the website itself did not change significantly over that period of time.
0
 
vbnetcoderAuthor Commented:
ty
0
Question has a verified solution.

Are you are experiencing a similar issue? Get a personalized answer when you ask a related question.

Have a better answer? Share it in a comment.

All Courses

From novice to tech pro — start learning today.