Solved

downloading data using a webquery in SSIS.

Posted on 2016-08-15
2
34 Views
Last Modified: 2016-09-30
In MS Excel, the ability exists to run a "web query." This function is accessed via the data menu's import external data option. The web
query wizard accepts a URL address, and then is able to import the data from that address into an excel worksheet.

Is there any way to launch this using SSIS
0
Comment
Question by:vbnetcoder
2 Comments
 
LVL 14

Accepted Solution

by:
Megan Brooks earned 500 total points
ID: 41822786
If the website hosts a web service then you may be able to query it using a Web Service Task.

Otherwise, you might be able to read from an Excel file that performs the web query for you. I have not found a good example for doing that, and I would be concerned about reliability.

I have written "scrapers" that open a website as HTML, parse it, and extract what they need. This is essentially the equivalent of Web Query, but it can be a lot more work. If I remember correctly, I was able to use the Internet Explorer API to do this from an SSIS script task, so that I could look at the DOM data and not have to actually parse the HTML myself. It was a lot more work than Web Query, and there were hangups (literally) that I had to work out, but whatever API I ended up using, it worked reliably for several years. Fortunately, the website itself did not change significantly over that period of time.
0
 

Author Closing Comment

by:vbnetcoder
ID: 41823308
ty
0

Featured Post

Is Your Active Directory as Secure as You Think?

More than 75% of all records are compromised because of the loss or theft of a privileged credential. Experts have been exploring Active Directory infrastructure to identify key threats and establish best practices for keeping data safe. Attend this month’s webinar to learn more.

Question has a verified solution.

If you are experiencing a similar issue, please ask a related question

Suggested Solutions

Introduction In my previous article (http://www.experts-exchange.com/Microsoft/Development/MS-SQL-Server/SSIS/A_9150-Loading-XML-Using-SSIS.html) I showed you how the XML Source component can be used to load XML files into a SQL Server database, us…
My client has a dictionary table. They're defining a list of standard naming convention. Now, they are requiring my team to provide us a mechanism how to match new incoming data with existing data in their system.
Internet Business Fax to Email Made Easy - With  eFax Corporate (http://www.enterprise.efax.com), you'll receive a dedicated online fax number, which is used the same way as a typical analog fax number. You'll receive secure faxes in your email, f…
Many functions in Excel can make decisions. The most simple of these is the IF function: it returns a value depending on whether a condition you describe is true or false. Once you get the hang of using the IF function, you will find it easier to us…

895 members asked questions and received personalized solutions in the past 7 days.

Join the community of 500,000 technology professionals and ask your questions.

Join & Ask a Question

Need Help in Real-Time?

Connect with top rated Experts

14 Experts available now in Live!

Get 1:1 Help Now