What is Best for Backup: Amazon Drive, Google Drive or MS OneDrive? In this free whitepaper we look at their performance, pricing, and platform availability to help you decide which cloud drive is right for your situation. Download and read the results of our testing for free!
Course Of The Month
5 days, 2 hours left to enrollBecome a Premium Member and unlock a new, free course in leading technologies each month.
Solved
Best approach to convert XML to SQL 2008 Tables/Fields using C#
Posted on 2011-09-19
I’m looking for the best approach to convert a XML data stream (see attached sample) into records for various SQL 2008 tables using C#. This XML stream will be provided as a web service, and will be the result of calling the service with a start date and end date. All orders modified during that time window will be included in the XML stream. Attached please find the WSDL for this XML data.
Due to the structure of the XML, I’ve created a number of tables in SQL with the following 'rules':
- For the Order Header portion, the quote number will be OrderKey.
- For the Order Detail, in addition to the OrderKey, the line number will be LineKey.
- For two of the Detail files, I’ve added IndexKey which will be a sequential number starting at 1 for each line.
- The Order Header also contains two ‘sub elements’. These are Address and Contact as each of these items are applied EndCustomer, JobSite etc. So, for these two tables, I’ve added a field called ElementKey to identify what the record references.
The expectation is that this data will remain in the SQL tables, and various data will be copied to other Business systems like Great Plains. Is the best approach to ‘pull’ field values from the XML, and write records to SQL, or can some type of ‘translation’ be created to map XML to tables/fields? If so, please provide the C# code needed for a few of these fields.
Thanks in advance for your suggestions.
Orders-Single.xml orderservice.xml Order-Header-Diagram.pdf
Order-Detail-Diagram.pdf
Due to the structure of the XML, I’ve created a number of tables in SQL with the following 'rules':
- For the Order Header portion, the quote number will be OrderKey.
- For the Order Detail, in addition to the OrderKey, the line number will be LineKey.
- For two of the Detail files, I’ve added IndexKey which will be a sequential number starting at 1 for each line.
- The Order Header also contains two ‘sub elements’. These are Address and Contact as each of these items are applied EndCustomer, JobSite etc. So, for these two tables, I’ve added a field called ElementKey to identify what the record references.
The expectation is that this data will remain in the SQL tables, and various data will be copied to other Business systems like Great Plains. Is the best approach to ‘pull’ field values from the XML, and write records to SQL, or can some type of ‘translation’ be created to map XML to tables/fields? If so, please provide the C# code needed for a few of these fields.
Thanks in advance for your suggestions.
Orders-Single.xml orderservice.xml Order-Header-Diagram.pdf
Order-Detail-Diagram.pdf
[X]
Welcome to Experts Exchange
Add your voice to the tech community where 5M+ people just like you are talking about what matters.
- Help others & share knowledge
- Earn cash & points
- Learn & ask questions
-
3
4 Comments
You can load your XML data into DataTables then use the SqlBulkCopy class to copy the data into the SQL tables.
SqlBulkCopy Class (System.Data.SqlClient)
http://msdn.microsoft.com/en-us/library/system.data.sqlclient.sqlbulkcopy.aspx
I hope this helps.
SqlBulkCopy Class (System.Data.SqlClient)
http://msdn.microsoft.com/en-us/library/system.data.sqlclient.sqlbulkcopy.aspx
I hope this helps.
What are the advantages of using SqlBulkCopy compare to using XMLreader or the DataSet approach.
How would SqlBulkCopy be used to:
- Populate 1 record per Order_Id from the XML into the multiple tables, and then 'n' records per Order_Id in tables like Order_LineItem and Order_LineItem_TextDetails
- Assign values to the key fields in each table (ie OrderKey in table Order_Header will use QuoteNumber from the XML)?
- Handle exceptions like the OrderKey already existing?
How would SqlBulkCopy be used to:
- Populate 1 record per Order_Id from the XML into the multiple tables, and then 'n' records per Order_Id in tables like Order_LineItem and Order_LineItem_TextDetails
- Assign values to the key fields in each table (ie OrderKey in table Order_Header will use QuoteNumber from the XML)?
- Handle exceptions like the OrderKey already existing?
I'm focusing my efforts on using Datasets based on the XML scheme.
I will close this question since the low response may be due to an overly broad question.
I will close this question since the low response may be due to an overly broad question.
Featured Post
Question has a verified solution.
If you are experiencing a similar issue, please ask a related question
Real-time is more about the business, not the technology. In day-to-day life, to make real-time decisions like buying or investing, business needs the latest information(e.g. Gold Rate/Stock Rate). Unlike traditional days, you need not wait for a fe…
This article aims to explain the working of CircularLogArchiver. This tool was designed to solve the buildup of log file in cases where systems do not support circular logging or where circular logging is not enabled
In this video, viewers will be given step by step instructions on adjusting mouse, pointer and cursor visibility in Microsoft Windows 10. The video seeks to educate those who are struggling with the new Windows 10 Graphical User Interface.
Change Cu…
Monitoring a network: how to monitor network services and why? Michael Kulchisky, MCSE, MCSA, MCP, VTSP, VSP, CCSP outlines the philosophy behind service monitoring and why a handshake validation is critical in network monitoring. Software utilized …
Suggested Courses
Course of the Month5 days, 2 hours left to enroll
Earn Certification
Administering Microsoft SQL Server 2012 Databases (Exam 70-462)
$79.00$71.10
688 members asked questions and received personalized solutions in the past 7 days.
Join the community of 500,000 technology professionals and ask your questions.