I need to retrieve information in xml from multiple websites using POST/GET methods as required

I need to retrieve information from multiple websites accordingly and save information into sql server. Based on carriers, we need to retrieve information from an xml/webservice/as parametrized string using POST/GET methods.

I am a beginner and would like to know what would be the best approach..

I will be working with a third party application which has a "get least freight" button and once clicked we need to get the least possible freight from the list of carries.
Who is Participating?

[Product update] Infrastructure Analysis Tool is now available with Business Accounts.Learn More

I wear a lot of hats...

"The solutions and answers provided on Experts Exchange have been extremely helpful to me over the last few years. I wear a lot of hats - Developer, Database Administrator, Help Desk, etc., so I know a lot of things but not a lot about one thing. Experts Exchange gives me answers from people who do know a lot about one thing, in a easy to use platform." -Todd S.

Bob LearnedCommented:
Wow, it sounds like you are going to have fun, since that is not really an easy process, and you will have a lot to learn.  As with anything like this, you gotta start somewhere.  This appears to be a mix of different technologies, and deciding on the "best" course of action is difficult without knowing what is involved.

I believe that you need to look into creating and using web service references, parsing XML, and using the System.Net.HttpWebRequest, since the System.Net.WebClient is just a wrapper for an HttpWebRequest, and is only a subset of the HttpWebRequest class.  

The details for your requirement are going to come in time.
KishNovoiceAuthor Commented:
Thanks for the suggestion TheLearnedOne. So do you suggest me following this path..

click triggers a event -> function gets the input like To and From zip codes -> queries each website url one after other -> based on the method, validates the response and gets the Rate and Days information and Save it to database.

My question would also be how would I convert the document to XMLformat so that I could read the nodes from HttpWebResponse..

Thanks a lot..


Bob LearnedCommented:

It is hard to know what I am really going to suggest.  Like I said before, that depends on what type of web site/web service you are pulling information from.  If you can provide a little more detail, I might be able to suggest a "better" course of action.

Learn SQL Server Core 2016

This course will introduce you to SQL Server Core 2016, as well as teach you about SSMS, data tools, installation, server configuration, using Management Studio, and writing and executing queries.

Bob LearnedCommented:
Creating an XmlDocument is pretty easy, and can take different forms:

Simple example:

using System.Xml;

XmlDocument document = new XmlDocument();

foreach (XmlNode node in document.SelectNodes("//node")
    string name = node.Name;
    string innerText = node.InnerText;

The SelectNodes method, along with SelectSingleNode, takes a valid XPath expression, so you could get the full power of XPath to parse an XML document.
Bob LearnedCommented:
Bob LearnedCommented:
You can also create an XmlDocument instance, and load the document from a string:


Experts Exchange Solution brought to you by

Your issues matter to us.

Facing a tech roadblock? Get the help and guidance you need from experienced professionals who care. Ask your question anytime, anywhere, with no hassle.

Start your 7-day free trial
KishNovoiceAuthor Commented:
Thanks LearnedOne you answered my question..
It's more than this solution.Get answers and train to solve all your tech problems - anytime, anywhere.Try it for free Edge Out The Competitionfor your dream job with proven skills and certifications.Get started today Stand Outas the employee with proven skills.Start learning today for free Move Your Career Forwardwith certification training in the latest technologies.Start your trial today
.NET Programming

From novice to tech pro — start learning today.