Drastically shorten your training time with WalkMe's advanced online training solution that Guides your trainees to action.
Course Of The Month
3 days, 21 hours left to enrollBecome a Premium Member and unlock a new, free course in leading technologies each month.
Solved
SQL query subselect
Posted on 2014-02-10
I have a staging table with data that gets fed in from flat files. I need to insert that data into another table, but my query is not working. It works, it just doesn't insert all the coorect records, so I need to fix the query.
The staging table gets records inserted and then updated data causes duplicate records to be inserted. I need the most current records. Here is a sample of data to help illustrate my issue. For this sample data I will need records 2 and 4 inserted, however, my query is now only selecting record 4. Please help. Thank you. Here is my query.
INSERT INTO MY_TBL2
SELECT * FROM MY_TBL1 W
WHERE LOADDATE = (SELECT MAX(LOADDATE)
FROM MY_TBL2 V
WHERE W.BCODE = V.BCODE)
order by BCODE
BCODE SAMPLEID ACTIVITY MEASUREMENT ITEMNAME LOADDATE
99999 1 act1 meas1 Item1 10/3/2012
99999 1 act1 meas1 Item1 10/4/2012
99999 2 act2 meas2 Item2 10/3/2012
99999 2 act2 meas2 Item2 10/4/2012
The staging table gets records inserted and then updated data causes duplicate records to be inserted. I need the most current records. Here is a sample of data to help illustrate my issue. For this sample data I will need records 2 and 4 inserted, however, my query is now only selecting record 4. Please help. Thank you. Here is my query.
INSERT INTO MY_TBL2
SELECT * FROM MY_TBL1 W
WHERE LOADDATE = (SELECT MAX(LOADDATE)
FROM MY_TBL2 V
WHERE W.BCODE = V.BCODE)
order by BCODE
BCODE SAMPLEID ACTIVITY MEASUREMENT ITEMNAME LOADDATE
99999 1 act1 meas1 Item1 10/3/2012
99999 1 act1 meas1 Item1 10/4/2012
99999 2 act2 meas2 Item2 10/3/2012
99999 2 act2 meas2 Item2 10/4/2012
[X]
Welcome to Experts Exchange
Add your voice to the tech community where 5M+ people just like you are talking about what matters.
- Help others & share knowledge
- Earn cash & points
- Learn & ask questions
2-
2
5 Comments
Active today
I'm not sure why your subquery was against tbl2. That seems to ensure that each time you load data, you'll reinsert the same data you already read before.
Instead, just read table1 one time and sort it to pick out the rows you need
INSERT INTO my_tbl2
SELECT bcode,
sampleid,
activity,
measurement,
itemname,
loaddate
FROM (SELECT t.*, ROW_NUMBER() OVER(PARTITION BY bcode,sampleid ORDER BY loaddate DESC) rn
FROM my_tbl1 t)
WHERE rn = 1
order by bcode
Instead, just read table1 one time and sort it to pick out the rows you need
INSERT INTO my_tbl2
SELECT bcode,
sampleid,
activity,
measurement,
itemname,
loaddate
FROM (SELECT t.*, ROW_NUMBER() OVER(PARTITION BY bcode,sampleid ORDER BY loaddate DESC) rn
FROM my_tbl1 t)
WHERE rn = 1
order by bcode
Hi, that was a typo, it should have said tbl1, but that doesn't matter anymore, because the query you supplied worked great. Can you explain the query, though, what it does, because I spent many hours trying to find a query that would obtain the desired results, that is, the rows that were the most recently updated for the bcode and sampleid, but couldn't come up with one. If I understand the query, I can apply that knowledge I just learned to subsequent sql tasks.
Thanks very much.
Thanks very much.
Active 1 day ago
I think you already identified the problem: "the rows that were the most recently updated for the bcode and sampleid", but your query only looked at: bcode.
If you adjust your original query like this, I think that will also work:
INSERT INTO MY_TBL2
SELECT * FROM MY_TBL1 W
WHERE LOADDATE = (SELECT MAX(LOADDATE)
FROM MY_TBL1 V
WHERE V.BCODE = W.BCODE
AND V.SAMPLID = W.SAMPLEID)
order by BCODE
If you adjust your original query like this, I think that will also work:
INSERT INTO MY_TBL2
SELECT * FROM MY_TBL1 W
WHERE LOADDATE = (SELECT MAX(LOADDATE)
FROM MY_TBL1 V
WHERE V.BCODE = W.BCODE
AND V.SAMPLID = W.SAMPLEID)
order by BCODE
Active today
>>>> Can you explain the query, though, what it does, because I spent many hours trying to find a query
work it from the inside out..
This is the inner most query...
(SELECT t.*, ROW_NUMBER() OVER(PARTITION BY bcode,sampleid ORDER BY loaddate DESC) rn
FROM my_tbl1 t)
this pulls everything from your table, but adds one new column to the results.
This numbers your data in groups (partitions)
each bcode/sampleid is taken as one group.
The rows within each group are numbered by date in descending order (so the latest is 1, next is 2 and so on)
BCODE SAMPLEID ACTIVITY MEASUREMENT ITEMNAME LOADDATE RN
99999 1 act1 meas1 Item1 10/3/2012 2
99999 1 act1 meas1 Item1 10/4/2012 1
99999 2 act2 meas2 Item2 10/3/2012 2
99999 2 act2 meas2 Item2 10/4/2012 1
Then, in the outer query, I keep only the rows that have rn=1, so that's the latest for each group/partition.
work it from the inside out..
This is the inner most query...
(SELECT t.*, ROW_NUMBER() OVER(PARTITION BY bcode,sampleid ORDER BY loaddate DESC) rn
FROM my_tbl1 t)
this pulls everything from your table, but adds one new column to the results.
This numbers your data in groups (partitions)
each bcode/sampleid is taken as one group.
The rows within each group are numbered by date in descending order (so the latest is 1, next is 2 and so on)
BCODE SAMPLEID ACTIVITY MEASUREMENT ITEMNAME LOADDATE RN
99999 1 act1 meas1 Item1 10/3/2012 2
99999 1 act1 meas1 Item1 10/4/2012 1
99999 2 act2 meas2 Item2 10/3/2012 2
99999 2 act2 meas2 Item2 10/4/2012 1
Then, in the outer query, I keep only the rows that have rn=1, so that's the latest for each group/partition.
Featured Post
Question has a verified solution.
If you are experiencing a similar issue, please ask a related question
Suggested Solutions
| Title | # Comments | Views | Activity |
|---|---|---|---|
| Creation date for a PDB | 5 | 86 | |
| error starting database services | 3 | 20 | |
| return value based on substr | 10 | 73 | |
| Need to Implment Subset of Oracle Schema to Read-Only version | 7 | 37 |
Introduction
A previously published article on Experts Exchange ("Joins in Oracle", http://www.experts-exchange.com/Database/Oracle/A_8249-Joins-in-Oracle.html) makes a statement about "Oracle proprietary" joins and mixes the join syntax with gen…
From implementing a password expiration date, to datatype conversions and file export options, these are some useful settings I've found in Jasper Server.
This video shows how to configure and send email from and Oracle database using both UTL_SMTP and UTL_MAIL, as well as comparing UTL_SMTP to a manual SMTP conversation with a mail server.
This video explains what a user managed backup is and shows how to take one, providing a couple of simple example scripts.
Suggested Courses
Course of the Month3 days, 21 hours left to enroll
751 members asked questions and received personalized solutions in the past 7 days.
Join the community of 500,000 technology professionals and ask your questions.