Solved

SSIS package: Import and Export data through flat files

Posted on 2011-09-22
7
354 Views
Last Modified: 2013-11-10
Hello,

I need to make packages on two different servers.

From one server, I need to export data on daily basis in to flat files and another package will import data from those flat files to database.

But I need to make package in systematic way as below:

1. Configuration manager (so that manage at run time at deployment). FYI, i can manage it through XML configuration.

2. Logging i.e. how many insert count and update count from a particular table at destination server when import from flat files will be occur.

3. If session break in mid either import/export then all transaction should be rollback. Also, need to give option to user in XML configuration to execute package on date range basis.

4. How can i manage packages like first master records should be inserted and after that transaction records will be inserted so that Foreign Key constraints should not be violated?

4. The package should be executed by SQL Server Agent on daily basis.

Kindly give answers as gradually aforesaid questions.

Best Regards,
MohitPandit
0
Comment
Question by:MohitPandit
  • 3
7 Comments
 
LVL 5

Author Comment

by:MohitPandit
ID: 36585040
0
 
LVL 5

Author Comment

by:MohitPandit
ID: 36586303
Can anyone assist on it?
0
 
LVL 21

Accepted Solution

by:
huslayer earned 500 total points
ID: 36892337
Hi,
You're actually asking for too much here.
You'll need to research each of your points and break it down .

1-read about ssis package configuration
http://www.sql-server-performance.com/2007/package-configuration-2005/

2-ssis custom logging
http://pragmaticworks.com/Products/Business-Intelligence/BIxPress/ssis-logging-auditing-monitoring.aspx

3-ssis checkpoints
http://www.mssqltips.com/sqlservertip/1408/integration-services-checkpoints-to-restart-package-from-failure/

4-you could use your own logic in sql query or lookup task in ssis
http://consultingblogs.emc.com/jamiethomson/archive/2005/10/21/2289.aspx

5-schedule ssis packages using SQL agent
http://decipherinfosys.wordpress.com/2008/09/17/scheduling-ssis-packages-with-sql-server-agent/

Hope that helps answer all your questions.

Regards,
Jason
0
 
LVL 5

Author Closing Comment

by:MohitPandit
ID: 36908864
Thank you.
0

Featured Post

How to run any project with ease

Manage projects of all sizes how you want. Great for personal to-do lists, project milestones, team priorities and launch plans.
- Combine task lists, docs, spreadsheets, and chat in one
- View and edit from mobile/offline
- Cut down on emails

Join & Write a Comment

This article explains how to reset the password of the sa account on a Microsoft SQL Server.  The steps in this article work in SQL 2005, 2008, 2008 R2, 2012, 2014 and 2016.
Slowly Changing Dimension Transformation component in data task flow is very useful for us to manage and control how data changes in SSIS.
This video shows, step by step, how to configure Oracle Heterogeneous Services via the Generic Gateway Agent in order to make a connection from an Oracle session and access a remote SQL Server database table.
Via a live example, show how to shrink a transaction log file down to a reasonable size.

759 members asked questions and received personalized solutions in the past 7 days.

Join the community of 500,000 technology professionals and ask your questions.

Join & Ask a Question

Need Help in Real-Time?

Connect with top rated Experts

20 Experts available now in Live!

Get 1:1 Help Now