Putoch
asked on
ETL insert into new table loading taking forever using SSIS -2005
Hi there,
I am trying to load info from one table directly into a new table (replicated in the same way), so I can keep an archive , since the org table clears out every 30 days.
I setup a simple ETL flow, but it just hung for hours.
So I wrote an insert statement inT-sql and this took some time, but after hours did run.
so I rewrote another insert statement using top 150k entries per load and this seems to run faster.
so I thought I would use a query insert on SSIS and tried this, but the same query still hangs for hours rather than running in seconds as it did on management studios.
I'm not sure what to look for her, can anyone please advise?
thank you,
Elaine.
I am trying to load info from one table directly into a new table (replicated in the same way), so I can keep an archive , since the org table clears out every 30 days.
I setup a simple ETL flow, but it just hung for hours.
So I wrote an insert statement inT-sql and this took some time, but after hours did run.
so I rewrote another insert statement using top 150k entries per load and this seems to run faster.
so I thought I would use a query insert on SSIS and tried this, but the same query still hangs for hours rather than running in seconds as it did on management studios.
I'm not sure what to look for her, can anyone please advise?
thank you,
Elaine.
SOLUTION
membership
This solution is only available to members.
To access this solution, you must be a member of Experts Exchange.
ASKER CERTIFIED SOLUTION
membership
This solution is only available to members.
To access this solution, you must be a member of Experts Exchange.
SOLUTION
membership
This solution is only available to members.
To access this solution, you must be a member of Experts Exchange.
Curiosity overwhelms me how there would be an expectation experts here could answer this question without seeing T-SQL, the schemas of the source and target data, and some screen shots of the current SSIS process.