Submit an article about your scariest tech experience—and the solution—and you’ll be automatically entered to win one of 4 fantastic tech gadgets.
Solved
Best approach to convert XML to SQL 2008 Tables/Fields using C#
Posted on 2011-09-19
I’m looking for the best approach to convert a XML data stream (see attached sample) into records for various SQL 2008 tables using C#. This XML stream will be provided as a web service, and will be the result of calling the service with a start date and end date. All orders modified during that time window will be included in the XML stream. Attached please find the WSDL for this XML data.
Due to the structure of the XML, I’ve created a number of tables in SQL with the following 'rules':
- For the Order Header portion, the quote number will be OrderKey.
- For the Order Detail, in addition to the OrderKey, the line number will be LineKey.
- For two of the Detail files, I’ve added IndexKey which will be a sequential number starting at 1 for each line.
- The Order Header also contains two ‘sub elements’. These are Address and Contact as each of these items are applied EndCustomer, JobSite etc. So, for these two tables, I’ve added a field called ElementKey to identify what the record references.
The expectation is that this data will remain in the SQL tables, and various data will be copied to other Business systems like Great Plains. Is the best approach to ‘pull’ field values from the XML, and write records to SQL, or can some type of ‘translation’ be created to map XML to tables/fields? If so, please provide the C# code needed for a few of these fields.
Thanks in advance for your suggestions.
Orders-Single.xml orderservice.xml Order-Header-Diagram.pdf
Order-Detail-Diagram.pdf
Due to the structure of the XML, I’ve created a number of tables in SQL with the following 'rules':
- For the Order Header portion, the quote number will be OrderKey.
- For the Order Detail, in addition to the OrderKey, the line number will be LineKey.
- For two of the Detail files, I’ve added IndexKey which will be a sequential number starting at 1 for each line.
- The Order Header also contains two ‘sub elements’. These are Address and Contact as each of these items are applied EndCustomer, JobSite etc. So, for these two tables, I’ve added a field called ElementKey to identify what the record references.
The expectation is that this data will remain in the SQL tables, and various data will be copied to other Business systems like Great Plains. Is the best approach to ‘pull’ field values from the XML, and write records to SQL, or can some type of ‘translation’ be created to map XML to tables/fields? If so, please provide the C# code needed for a few of these fields.
Thanks in advance for your suggestions.
Orders-Single.xml orderservice.xml Order-Header-Diagram.pdf
Order-Detail-Diagram.pdf
[X]
Welcome to Experts Exchange
Add your voice to the tech community where 5M+ people just like you are talking about what matters.
- Help others & share knowledge
- Earn cash & points
- Learn & ask questions
-
3
4 Comments
You can load your XML data into DataTables then use the SqlBulkCopy class to copy the data into the SQL tables.
SqlBulkCopy Class (System.Data.SqlClient)
http://msdn.microsoft.com/en-us/library/system.data.sqlclient.sqlbulkcopy.aspx
I hope this helps.
SqlBulkCopy Class (System.Data.SqlClient)
http://msdn.microsoft.com/en-us/library/system.data.sqlclient.sqlbulkcopy.aspx
I hope this helps.
What are the advantages of using SqlBulkCopy compare to using XMLreader or the DataSet approach.
How would SqlBulkCopy be used to:
- Populate 1 record per Order_Id from the XML into the multiple tables, and then 'n' records per Order_Id in tables like Order_LineItem and Order_LineItem_TextDetails
- Assign values to the key fields in each table (ie OrderKey in table Order_Header will use QuoteNumber from the XML)?
- Handle exceptions like the OrderKey already existing?
How would SqlBulkCopy be used to:
- Populate 1 record per Order_Id from the XML into the multiple tables, and then 'n' records per Order_Id in tables like Order_LineItem and Order_LineItem_TextDetails
- Assign values to the key fields in each table (ie OrderKey in table Order_Header will use QuoteNumber from the XML)?
- Handle exceptions like the OrderKey already existing?
I'm focusing my efforts on using Datasets based on the XML scheme.
I will close this question since the low response may be due to an overly broad question.
I will close this question since the low response may be due to an overly broad question.
Featured Post
Question has a verified solution.
If you are experiencing a similar issue, please ask a related question
Hi all,
It is important and often overlooked to understand “Database properties”. Often we see questions about "log files" or "where is the database" and one of the easiest ways to get general information about your database is to use “Database p…
Use this article to create a batch file to backup a Microsoft SQL Server database to a Windows folder. The folder can be on the local hard drive or on a network share. This batch file will query the SQL server to get the current date & time and wi…
In this video you will find out how to export Office 365 mailboxes using the built in eDiscovery tool. Bear in mind that although this method might be useful in some cases, using PST files as Office 365 backup is troublesome in a long run (more on t…
Have you created a query with information for a calendar? ... and then, abra-cadabra, the calendar is done?! I am going to show you how to make that happen.
Visualize your data! ... really see it
To use the code to create a calendar from a q…
Suggested Courses
Course of the Month10 days, 10 hours left to enroll
618 members asked questions and received personalized solutions in the past 7 days.
Join the community of 500,000 technology professionals and ask your questions.