Solved

SQL query question

Posted on 2015-02-12
12
77 Views
Last Modified: 2015-02-17
I ran across a problem I cannot figure out how to solve. I have to consolidate data from 4 temporary tables to one permanent. I am using INNER JOIN for three temp tables and LEFT OUTER JOIN for fourth one. The problem is in data. Some records have duplicate IDs. So when I perform INSERT INTO instead of two records in perm table I got four. This happened so far twice but there is no guarantee that it would not happen again. Any suggestions how to solve it?
0
Comment
Question by:Burzhuin
  • 4
  • 4
  • 3
  • +1
12 Comments
 
LVL 65

Expert Comment

by:Jim Horn
ID: 40606570
Do all four of these tables have the same schema?  If yes, better to do a UNION ALL if you want to make sure that the row counts in 1+2+3+4 = what is inserted into the target_table, and just UNION if you want to eliminate duplicates between 1, 2, 3, and 3.

INSERT INTO target_table(id, a, b, c)
SELECT id, a, b, c
FROM temp_1
UNION ALL
SELECT id, a, b, c
FROM temp_2
UNION ALL
SELECT id, a, b, c
FROM temp_3
UNION ALL
SELECT id, a, b, c
FROM temp_4

Open in new window

0
 
LVL 48

Expert Comment

by:PortletPaul
ID: 40606723
Without sample data and expected result I would be guessing my way through an answer to this broad question.

Maybe Jim has guessed right?
0
 
LVL 45

Expert Comment

by:Vitor Montalvão
ID: 40607458
Sample data and table schemas are needed to we can provide a better solution.
0
 

Author Comment

by:Burzhuin
ID: 40607729
My apologies for being not clear. I have four tables. Each tables have only one column common: ProductID. Each temp table  contains only part of data (usually 6 columns) that should contain Perm table. The all tables belong to the same schema. My Insert query looks somewhat like this:

INSERT INTO PermTable (ProductID, value1, value2, value3, value4) SELECT t1.ProductID, t1.Value1, t2.Value2, t3.Value3, t4.Value4 FROM Temp1 t1 INNER JOIN Temp2 t2 ON t1.ProductID = t2.ProductID INNER JOIN Temp3 t3 ON t1.ProductID = t3.ProductID LEFT OUTER JOIN Temp4 t4 ON t1.ProductID = t4.ProductID

It works when ProductID is unique but if there is 2 records with the same ProductID in Temp Tables I will get four records in Perm table.
0
 
LVL 48

Expert Comment

by:PortletPaul
ID: 40607761
If the is a repeated product id in one of the temp tables, what is supposed to happen?

for example, let's say it is

table2
productid value2
12345        12345.6
12345         23456.7

i.e. if there is a difference in value2 (as shown) what would you expect to happen?
0
 
LVL 45

Expert Comment

by:Vitor Montalvão
ID: 40607774
I wanted to ask a similar question;
- What's a duplicate record? Rows with same ProductID and Value? Or only same ProductID?
- If it's only same ProductID, which value need to be selected? MIN? MAX? AVG? Other?
0
How to run any project with ease

Manage projects of all sizes how you want. Great for personal to-do lists, project milestones, team priorities and launch plans.
- Combine task lists, docs, spreadsheets, and chat in one
- View and edit from mobile/offline
- Cut down on emails

 

Author Comment

by:Burzhuin
ID: 40607821
In my cases I have two records with the same ProductID in Temp1, Temp2 tables. One record in Temp3 and none in Temp4. When I executed my query it inserted into Perm table not two but four records. So Perm table looks like that:

Perm
productid value2
12345        12345.6
12345         23456.7
12345        12345.6
12345         23456.7
0
 
LVL 45

Expert Comment

by:Vitor Montalvão
ID: 40607831
As been asked above:
i.e. if there is a difference in value2 (as shown) what would you expect to happen?
- If it's only same ProductID, which value need to be selected?
0
 

Author Comment

by:Burzhuin
ID: 40607865
I need both values. But I need TWO records which is correct NOT FOUR records I am getting that is wrong.
0
 
LVL 45

Accepted Solution

by:
Vitor Montalvão earned 500 total points
ID: 40607870
What are the values that you are getting for the rest of the fields? If they are all the same you can use the DISTINCT keyword:
INSERT INTO PermTable (ProductID, value1, value2, value3, value4) 
SELECT DISTINCT t1.ProductID, t1.Value1, t2.Value2, t3.Value3, t4.Value4 
FROM Temp1 t1 
INNER JOIN Temp2 t2 ON t1.ProductID = t2.ProductID 
INNER JOIN Temp3 t3 ON t1.ProductID = t3.ProductID 
LEFT OUTER JOIN Temp4 t4 ON t1.ProductID = t4.ProductID

Open in new window

0
 

Author Comment

by:Burzhuin
ID: 40608474
I tried it but I got only one record but I have to get two.
0
 
LVL 48

Expert Comment

by:PortletPaul
ID: 40608925
Please provide samples for the 4 tables.
and the expected result.

This truly is the fastest way to resolution.
0

Featured Post

What Should I Do With This Threat Intelligence?

Are you wondering if you actually need threat intelligence? The answer is yes. We explain the basics for creating useful threat intelligence.

Join & Write a Comment

Suggested Solutions

Everyone has problem when going to load data into Data warehouse (EDW). They all need to confirm that data quality is good but they don't no how to proceed. Microsoft has provided new task within SSIS 2008 called "Data Profiler Task". It solve th…
JSON is being used more and more, besides XML, and you surely wanted to parse the data out into SQL instead of doing it in some Javascript. The below function in SQL Server can do the job for you, returning a quick table with the parsed data.
Viewers will learn how to use the SELECT statement in SQL to return specific rows and columns, with various degrees of sorting and limits in place.
Viewers will learn how to use the UPDATE and DELETE statements to change or remove existing data from their tables. Make a table: Update a specific column given a specific row using the UPDATE statement: Remove a set of values using the DELETE s…

708 members asked questions and received personalized solutions in the past 7 days.

Join the community of 500,000 technology professionals and ask your questions.

Join & Ask a Question

Need Help in Real-Time?

Connect with top rated Experts

12 Experts available now in Live!

Get 1:1 Help Now