Solved

Import Rows between 2 datasets for all tables with matching columns

Posted on 2014-01-23
13
745 Views
Last Modified: 2014-02-12
Hi there,

I have a rather unusual situation of which I would greatly appreciate some help on. Basically I have a typed ADO.Net Dataset that does not contain any data just a schema with relations and all. We can call this CurrentDataSet, it has about 56 tables in it..(I know right not very clever).

Anyway, I use this dataset to bind data to controls on a specific form with tabs. OK hope that is clear. Now I am getting the data from an API call which returns XML Data of which I then read and create a new Dataset from this using the below method:

  Dim web As New WebClient()
            Dim url As String = String.Format("https://test.co.uk/api/company?id=12345&apiKey=xxxx")
            Dim response As String = web.DownloadString(url)

            Dim ds As New DataSet()
          
            Using stringReader As New StringReader(response)
                ds = New DataSet
                ds.ReadXml(stringReader)
            End Using

Open in new window


I then can get the datatables from this new Dataset using ds.Tables("TableName"). However what I would like to do is populate CurrentDataSet with the data that comes from ds, so that it would be easier for me to use the bindingsource from CurrentDataset to bind to my controls. I know you can use the importrow method to import rows into CurrentDataSet...but there is a major caveat.

The problem is that the returned datatables from the API call aren't always present if there is no information in them. The API only returns datatables and fields from the relevant datatables if there are rows or data in them.

CurrentDataSet contains all possible fields and tables that the API could possibly return, now I want to know how I can update CurrentDataSet with row items only where table and field names exist between ds and CurrentDataSet? Ideally if I could merge the new dataset(ds) into matching tables/field in one go rather than looping through each datatable and columns, that would be great

I am putting maxmimum points on this because I think it is really difficult, thanks in advance.
0
Comment
Question by:databarracks
[X]
Welcome to Experts Exchange

Add your voice to the tech community where 5M+ people just like you are talking about what matters.

  • Help others & share knowledge
  • Earn cash & points
  • Learn & ask questions
  • 7
  • 6
13 Comments
 
LVL 83

Expert Comment

by:CodeCruiser
ID: 39806161
DataTable.Merge method does not require the schema of two datatables to be same. It can merge the columns that exist in both datatables. You can also control how it deals with additional columns that exist in source table but not in target table.

http://msdn.microsoft.com/en-us/library/wtk78t63(v=vs.110).aspx

Give it a try.
0
 

Author Comment

by:databarracks
ID: 39806207
I have tried this in code but it  didn't work as it kept saying that the column already exists or datatype integer keys already exist etc.
0
 
LVL 83

Expert Comment

by:CodeCruiser
ID: 39806266
Can you show the code?
0
Congratulations! You’re Certified – Now What?

Starting a new career can be overwhelming. Becoming certified in your field of expertise is a great start, but where do you go from here?  Here are some tips to help you on your career journey.

 

Author Comment

by:databarracks
ID: 39806282
  Dim web As New WebClient()
            Dim url As String = String.Format("https://test.co.uk/api/company?id=12345&apiKey=xxxx")
            Dim response As String = web.DownloadString(url)

            Dim ds As New DataSet()
          
            Using stringReader As New StringReader(response)
                ds = New DataSet
                ds.ReadXml(stringReader)
            End Using

CurrentDataSet.Merge(ds,True,MissingMappingAction.Add)

Open in new window


So I have tries MissingMappingAction.Ignore and still breaks. THe CurrentDataSet is placed on my form at design time
0
 
LVL 83

Expert Comment

by:CodeCruiser
ID: 39806931
I would recommend merging datatables instead of datasets.

Also, you need an instance of the CurrentDataSet to merge with.
0
 

Author Comment

by:databarracks
ID: 39807106
Ok could you show me a code snippet of your plan?
0
 
LVL 83

Accepted Solution

by:
CodeCruiser earned 500 total points
ID: 39809386
Create an populate an instance of CurrentDataSet

Dim OriginalDataSet As New CurrentDataSet
MyTableAdapter.Fill(OriginalDataSet)

Dim NewDataSet As New DataSet
MyNewTableAdapter.Fill(NewDataSet)

OriginalDataSet.Tables(0).Merge(NewDataSet.Tables(0))


Notice that above line assumes that Tables(0) of OriginalDataSet and Tables(0) of NewDataSet are corresponding tables that you want to merge.
0
 

Author Comment

by:databarracks
ID: 39811217
Hi CodeCruiser,

I have tried your approach and I get the below error

<target>.id and <source>.id have conflicting properties: DataType property mismatch.

Open in new window


Also please be aware that I don't have any TableAdapter's for my datasets due to the nature of the returned api
0
 
LVL 83

Expert Comment

by:CodeCruiser
ID: 39813538
So you have same columns in both tables but these columns have different datatype in each table. Can you confirm which column it is and why it has different datatypes?
0
 

Author Comment

by:databarracks
ID: 39814253
HI there it is saying that the primary key field has different data types but they both have Int32 data types. To be honest because of the nature of the api I just don't see a way that I am going to get this to work as it doesn't always return all the fields from the table if there is no information in the column.

It is really annoying but I might just bind the new dataset from the api directly onto my forms instead of using my permanent dataset. I built the dataset using an XML to XSD converter in VS2012 if that helps.
0
 
LVL 83

Expert Comment

by:CodeCruiser
ID: 39814719
Can you show code that you use to populate the permanent dataset, the new dataset and the merge code?
0
 

Author Comment

by:databarracks
ID: 39852857
Hi there,

Apologies for abandoning this question. I worked around this by simply trapping loads of possible scenarios as it just wasn't feasible any other way.

Thanks for the guidance as always CodeCruiser
0
 

Author Closing Comment

by:databarracks
ID: 39852859
Very helpful as always
0

Featured Post

Get your Disaster Recovery as a Service basics

Disaster Recovery as a Service is one go-to solution that revolutionizes DR planning. Implementing DRaaS could be an efficient process, easily accessible to non-DR experts. Learn about monitoring, testing, executing failovers and failbacks to ensure a "healthy" DR environment.

Question has a verified solution.

If you are experiencing a similar issue, please ask a related question

Here I am going to explain creating proxies at runtime for WCF Service. So basically we use to generate proxies using Add Service Reference and then giving the Url of the WCF service then generate proxy files at client side. Ok, what if something ge…
The ECB site provides FX rates for major currencies since its inception in 1999 in the form of an XML feed. The files have the following format (reducted for brevity) (CODE) There are three files available HERE (http://www.ecb.europa.eu/stats/exch…
There are cases when e.g. an IT administrator wants to have full access and view into selected mailboxes on Exchange server, directly from his own email account in Outlook or Outlook Web Access. This proves useful when for example administrator want…
In this video you will find out how to export Office 365 mailboxes using the built in eDiscovery tool. Bear in mind that although this method might be useful in some cases, using PST files as Office 365 backup is troublesome in a long run (more on t…

626 members asked questions and received personalized solutions in the past 7 days.

Join the community of 500,000 technology professionals and ask your questions.

Join & Ask a Question