Solved

downloading data using a webquery in SSIS.

Posted on 2016-08-15
2
26 Views
Last Modified: 2016-09-30
In MS Excel, the ability exists to run a "web query." This function is accessed via the data menu's import external data option. The web
query wizard accepts a URL address, and then is able to import the data from that address into an excel worksheet.

Is there any way to launch this using SSIS
0
Comment
Question by:vbnetcoder
2 Comments
 
LVL 13

Accepted Solution

by:
Megan Brooks earned 500 total points
ID: 41822786
If the website hosts a web service then you may be able to query it using a Web Service Task.

Otherwise, you might be able to read from an Excel file that performs the web query for you. I have not found a good example for doing that, and I would be concerned about reliability.

I have written "scrapers" that open a website as HTML, parse it, and extract what they need. This is essentially the equivalent of Web Query, but it can be a lot more work. If I remember correctly, I was able to use the Internet Explorer API to do this from an SSIS script task, so that I could look at the DOM data and not have to actually parse the HTML myself. It was a lot more work than Web Query, and there were hangups (literally) that I had to work out, but whatever API I ended up using, it worked reliably for several years. Fortunately, the website itself did not change significantly over that period of time.
0
 

Author Closing Comment

by:vbnetcoder
ID: 41823308
ty
0

Featured Post

What Security Threats Are You Missing?

Enhance your security with threat intelligence from the web. Get trending threat insights on hackers, exploits, and suspicious IP addresses delivered to your inbox with our free Cyber Daily.

Join & Write a Comment

My client sends data in an Excel file to me to load them into Staging database. The file contains many sheets that they have same structure. In this article, I would like to share the simple way to load data of multiple sheets by using SSIS.
Here's a requirements document template for an integration project (also known as Extract-Transform-Load or ETL) based on my development experience as an SQL Server Information Services (SSIS) developer over the years.
It is a freely distributed piece of software for such tasks as photo retouching, image composition and image authoring. It works on many operating systems, in many languages.
This video explains how to create simple products associated to Magento configurable product and offers fast way of their generation with Store Manager for Magento tool.

747 members asked questions and received personalized solutions in the past 7 days.

Join the community of 500,000 technology professionals and ask your questions.

Join & Ask a Question

Need Help in Real-Time?

Connect with top rated Experts

12 Experts available now in Live!

Get 1:1 Help Now