?
Solved

SSIS package: Import and Export data through flat files

Posted on 2011-09-22
7
Medium Priority
?
364 Views
Last Modified: 2013-11-10
Hello,

I need to make packages on two different servers.

From one server, I need to export data on daily basis in to flat files and another package will import data from those flat files to database.

But I need to make package in systematic way as below:

1. Configuration manager (so that manage at run time at deployment). FYI, i can manage it through XML configuration.

2. Logging i.e. how many insert count and update count from a particular table at destination server when import from flat files will be occur.

3. If session break in mid either import/export then all transaction should be rollback. Also, need to give option to user in XML configuration to execute package on date range basis.

4. How can i manage packages like first master records should be inserted and after that transaction records will be inserted so that Foreign Key constraints should not be violated?

4. The package should be executed by SQL Server Agent on daily basis.

Kindly give answers as gradually aforesaid questions.

Best Regards,
MohitPandit
0
Comment
Question by:MohitPandit
[X]
Welcome to Experts Exchange

Add your voice to the tech community where 5M+ people just like you are talking about what matters.

  • Help others & share knowledge
  • Earn cash & points
  • Learn & ask questions
  • 3
7 Comments
 
LVL 5

Author Comment

by:MohitPandit
ID: 36585040
0
 
LVL 5

Author Comment

by:MohitPandit
ID: 36586303
Can anyone assist on it?
0
 
LVL 21

Accepted Solution

by:
Jason Yousef, MS earned 1500 total points
ID: 36892337
Hi,
You're actually asking for too much here.
You'll need to research each of your points and break it down .

1-read about ssis package configuration
http://www.sql-server-performance.com/2007/package-configuration-2005/

2-ssis custom logging
http://pragmaticworks.com/Products/Business-Intelligence/BIxPress/ssis-logging-auditing-monitoring.aspx

3-ssis checkpoints
http://www.mssqltips.com/sqlservertip/1408/integration-services-checkpoints-to-restart-package-from-failure/

4-you could use your own logic in sql query or lookup task in ssis
http://consultingblogs.emc.com/jamiethomson/archive/2005/10/21/2289.aspx

5-schedule ssis packages using SQL agent
http://decipherinfosys.wordpress.com/2008/09/17/scheduling-ssis-packages-with-sql-server-agent/

Hope that helps answer all your questions.

Regards,
Jason
0
 
LVL 5

Author Closing Comment

by:MohitPandit
ID: 36908864
Thank you.
0

Featured Post

On Demand Webinar - Networking for the Cloud Era

This webinar discusses:
-Common barriers companies experience when moving to the cloud
-How SD-WAN changes the way we look at networks
-Best practices customers should employ moving forward with cloud migration
-What happens behind the scenes of SteelConnect’s one-click button

Question has a verified solution.

If you are experiencing a similar issue, please ask a related question

Why is this different from all of the other step by step guides?  Because I make a living as a DBA and not as a writer and I lived through this experience. Defining the name: When I talk to people they say different names on this subject stuff l…
Ever needed a SQL 2008 Database replicated/mirrored/log shipped on another server but you can't take the downtime inflicted by initial snapshot or disconnect while T-logs are restored or mirror applied? You can use SQL Server Initialize from Backup…
Via a live example, show how to backup a database, simulate a failure backup the tail of the database transaction log and perform the restore.
Via a live example, show how to set up a backup for SQL Server using a Maintenance Plan and how to schedule the job into SQL Server Agent.
Suggested Courses

801 members asked questions and received personalized solutions in the past 7 days.

Join the community of 500,000 technology professionals and ask your questions.

Join & Ask a Question