Want to protect your cyber security and still get fast solutions? Ask a secure question today.Go Premium

x
?
Solved

downloading data using a webquery in SSIS.

Posted on 2016-08-15
2
Medium Priority
?
137 Views
Last Modified: 2016-09-30
In MS Excel, the ability exists to run a "web query." This function is accessed via the data menu's import external data option. The web
query wizard accepts a URL address, and then is able to import the data from that address into an excel worksheet.

Is there any way to launch this using SSIS
0
Comment
Question by:vbnetcoder
2 Comments
 
LVL 16

Accepted Solution

by:
Megan Brooks earned 2000 total points
ID: 41822786
If the website hosts a web service then you may be able to query it using a Web Service Task.

Otherwise, you might be able to read from an Excel file that performs the web query for you. I have not found a good example for doing that, and I would be concerned about reliability.

I have written "scrapers" that open a website as HTML, parse it, and extract what they need. This is essentially the equivalent of Web Query, but it can be a lot more work. If I remember correctly, I was able to use the Internet Explorer API to do this from an SSIS script task, so that I could look at the DOM data and not have to actually parse the HTML myself. It was a lot more work than Web Query, and there were hangups (literally) that I had to work out, but whatever API I ended up using, it worked reliably for several years. Fortunately, the website itself did not change significantly over that period of time.
0
 

Author Closing Comment

by:vbnetcoder
ID: 41823308
ty
0

Featured Post

Receive 1:1 tech help

Solve your biggest tech problems alongside global tech experts with 1:1 help.

Question has a verified solution.

If you are experiencing a similar issue, please ask a related question

Introduction In my previous article (http://www.experts-exchange.com/Microsoft/Development/MS-SQL-Server/SSIS/A_9150-Loading-XML-Using-SSIS.html) I showed you how the XML Source component can be used to load XML files into a SQL Server database, us…
Lessons learned during ten years of interviewing for SQL Server Integration Services (SSIS) and other Extract-Transform-Load (ETL) contract roles and two years of staff manager interviewing contractors.
Is your OST file inaccessible, Need to transfer OST file from one computer to another? Want to convert OST file to PST? If the answer to any of the above question is yes, then look no further. With the help of Stellar OST to PST Converter, you can e…
How can you see what you are working on when you want to see it while you to save a copy? Add a "Save As" icon to the Quick Access Toolbar, or QAT. That way, when you save a copy of a query, form, report, or other object you are modifying, you…

564 members asked questions and received personalized solutions in the past 7 days.

Join the community of 500,000 technology professionals and ask your questions.

Join & Ask a Question