Solved

downloading data using a webquery in SSIS.

Posted on 2016-08-15
2
51 Views
Last Modified: 2016-09-30
In MS Excel, the ability exists to run a "web query." This function is accessed via the data menu's import external data option. The web
query wizard accepts a URL address, and then is able to import the data from that address into an excel worksheet.

Is there any way to launch this using SSIS
0
Comment
Question by:vbnetcoder
2 Comments
 
LVL 14

Accepted Solution

by:
Megan Brooks earned 500 total points
ID: 41822786
If the website hosts a web service then you may be able to query it using a Web Service Task.

Otherwise, you might be able to read from an Excel file that performs the web query for you. I have not found a good example for doing that, and I would be concerned about reliability.

I have written "scrapers" that open a website as HTML, parse it, and extract what they need. This is essentially the equivalent of Web Query, but it can be a lot more work. If I remember correctly, I was able to use the Internet Explorer API to do this from an SSIS script task, so that I could look at the DOM data and not have to actually parse the HTML myself. It was a lot more work than Web Query, and there were hangups (literally) that I had to work out, but whatever API I ended up using, it worked reliably for several years. Fortunately, the website itself did not change significantly over that period of time.
0
 

Author Closing Comment

by:vbnetcoder
ID: 41823308
ty
0

Featured Post

Free Tool: Postgres Monitoring System

A PHP and Perl based system to collect and display usage statistics from PostgreSQL databases.

One of a set of tools we are providing to everyone as a way of saying thank you for being a part of the community.

Question has a verified solution.

If you are experiencing a similar issue, please ask a related question

Suggested Solutions

This is my first ever Article on EE or elsewhere; therefore, please bear with me if I have some discrepancies in my writing. I read many articles and questions related to "how to pass values to SSIS packages at run-time?"  Hence, this common ques…
In couple weeks ago, I encountered an extremely difficult problem while deploying 2008 SSIS packages to a new environment (SQL Server 2014 standard).  My scenario is: We have one C# application that is calling 2008R2 SSIS packages to load text fi…
This video shows how to use Hyena, from SystemTools Software, to bulk import 100 user accounts from an external text file. View in 1080p for best video quality.
With Secure Portal Encryption, the recipient is sent a link to their email address directing them to the email laundry delivery page. From there, the recipient will be required to enter a user name and password to enter the page. Once the recipient …

808 members asked questions and received personalized solutions in the past 7 days.

Join the community of 500,000 technology professionals and ask your questions.

Join & Ask a Question