Solved

Cannot drop or truncate tables in replication

Posted on 2013-01-09
3
946 Views
Last Modified: 2013-01-11
Hi,

We have a full load job running every night which drops and recreates tables
and load data in the olap database..and an incremental job which runs
every hour during day..
We require to implement transactional replication to this database on
another server for reporting purpose, however when replicated..
the full load job fails since the tables are used in replication and cannot be dropped.
Tried truncating instead of dropping tables, however even that does not seem to work
Can we use  sp_droparticle and sp_addarticle before dropping and after creating tables
for full load job to work.
Please advise a workaround to this problem?

Thanks
0
Comment
Question by:isonali
  • 2
3 Comments
 
LVL 8

Expert Comment

by:virtuadept
ID: 38760375
Couple of possibilities. If the tables don't have that many rows per hour (few thousand) you can just use DELETEs and let them rep over. If its over say 5000 but under 50,000, maybe put some deletes in a loop so it will only rep over a few thousand deletes at a time in each delete. The exact number of "too many" will depend on your network speeds.

We had a similar problem before in an environment where we were running a BCP in and truncate ever 5 minutes for about 20K rows per 5 min and that was killing replication, so we changed our process to use a different database for staging and write the end results to the perm, replicated database. The staging database was not replicated. So we'd do our trunc and BCP on a database lets call it STAGE and the script or procedure did its thing and put the perm results (or you might could use a view) to the perm database that DID get replication.  In our situation, we ALSO needed this data on both the "hot" and the "warm-standby" databases, so we actually had our scripts doing it on both sides to the non-rep database on each server.
0
 

Author Comment

by:isonali
ID: 38760510
Well..the incremental load is not a problem since it does not drop tables,
 the only issue is with full load where it requires to drop and recreate hem.

Please could you give an example for a table which needs to be dropped and recreate it
If we have staging table where there is no replication and perform the drop and recreate
operation
How do we propogate those changes to perm  database which is getting replicated.
The view which you suggest would also  truncate and repopulate the data which is
not supported in replication.?
0
 
LVL 8

Accepted Solution

by:
virtuadept earned 500 total points
ID: 38760762
If you have some of the data that is incremental and needs to be replicated then the staging non-rep database idea isn't going to work. I guess what is the reason for dropping and full loading the entire table, ever?  And again, how big of tables are we talking about?  If this can not be done with DELETE (instead of truncate) because of too many transactions for the full load delete and inserts, and if there is a true need to do a full load on it all the time because of radical shifts in the data possibly (just guessing here since I have no idea what the data is about), then maybe this specific table(s) need to be on a non-replicated database and code the application to look at it instead of the main database and then have the process to keep it in sync by running separately on both servers. You might could get by with not recoding some of the stuff by having a view into the non-rep database from the rep database that could be used for reading at least.

So lets say right now you have table BIG_ONE with tons of data in it, say, 250K rows minimum. And that gets loaded incrementally 5k per hour, but the whole table is reloaded once a day 250k rows.

You would have to create a new table BIG_ONE on a new non-rep database STAGE, then drop the table (you'll have to turn off rep for this) and create a VIEW on the rep server named BIG_ONE that SELECT columns FROM STAGE.dbo.BIG_ONE.  That view, with the same name as the old table, will allow things that read from the table to still work. But anything that writes will have to be recoded to point at the STAGE database now, including the incremental process that runs hourly and the nightly drop and reload process.

EDIT, oh and the processes that populate BIG_ONE have to be changed to run on both of the servers now, since BIG_ONE isn't replicated anymore.
0

Featured Post

PRTG Network Monitor: Intuitive Network Monitoring

Network Monitoring is essential to ensure that computer systems and network devices are running. Use PRTG to monitor LANs, servers, websites, applications and devices, bandwidth, virtual environments, remote systems, IoT, and many more. PRTG is easy to set up & use.

Join & Write a Comment

If you have heard of RFC822 date formats, they can be quite a challenge in SQL Server. RFC822 is an Internet standard format for email message headers, including all dates within those headers. The RFC822 protocols are available in detail at:   ht…
This article explains how to reset the password of the sa account on a Microsoft SQL Server.  The steps in this article work in SQL 2005, 2008, 2008 R2, 2012, 2014 and 2016.
This is Part 3 in a 3-part series on Experts Exchange to discuss error handling in VBA code written for Excel. Part 1 of this series discussed basic error handling code using VBA. http://www.experts-exchange.com/videos/1478/Excel-Error-Handlin…
Sending a Secure fax is easy with eFax Corporate (http://www.enterprise.efax.com). First, Just open a new email message.  In the To field, type your recipient's fax number @efaxsend.com. You can even send a secure international fax — just include t…

758 members asked questions and received personalized solutions in the past 7 days.

Join the community of 500,000 technology professionals and ask your questions.

Join & Ask a Question

Need Help in Real-Time?

Connect with top rated Experts

25 Experts available now in Live!

Get 1:1 Help Now