Solved

SSIS package: Import and Export data through flat files

Posted on 2011-09-22
7
361 Views
Last Modified: 2013-11-10
Hello,

I need to make packages on two different servers.

From one server, I need to export data on daily basis in to flat files and another package will import data from those flat files to database.

But I need to make package in systematic way as below:

1. Configuration manager (so that manage at run time at deployment). FYI, i can manage it through XML configuration.

2. Logging i.e. how many insert count and update count from a particular table at destination server when import from flat files will be occur.

3. If session break in mid either import/export then all transaction should be rollback. Also, need to give option to user in XML configuration to execute package on date range basis.

4. How can i manage packages like first master records should be inserted and after that transaction records will be inserted so that Foreign Key constraints should not be violated?

4. The package should be executed by SQL Server Agent on daily basis.

Kindly give answers as gradually aforesaid questions.

Best Regards,
MohitPandit
0
Comment
Question by:MohitPandit
[X]
Welcome to Experts Exchange

Add your voice to the tech community where 5M+ people just like you are talking about what matters.

  • Help others & share knowledge
  • Earn cash & points
  • Learn & ask questions
  • 3
7 Comments
 
LVL 5

Author Comment

by:MohitPandit
ID: 36585040
0
 
LVL 5

Author Comment

by:MohitPandit
ID: 36586303
Can anyone assist on it?
0
 
LVL 21

Accepted Solution

by:
Jason Yousef, MS earned 500 total points
ID: 36892337
Hi,
You're actually asking for too much here.
You'll need to research each of your points and break it down .

1-read about ssis package configuration
http://www.sql-server-performance.com/2007/package-configuration-2005/

2-ssis custom logging
http://pragmaticworks.com/Products/Business-Intelligence/BIxPress/ssis-logging-auditing-monitoring.aspx

3-ssis checkpoints
http://www.mssqltips.com/sqlservertip/1408/integration-services-checkpoints-to-restart-package-from-failure/

4-you could use your own logic in sql query or lookup task in ssis
http://consultingblogs.emc.com/jamiethomson/archive/2005/10/21/2289.aspx

5-schedule ssis packages using SQL agent
http://decipherinfosys.wordpress.com/2008/09/17/scheduling-ssis-packages-with-sql-server-agent/

Hope that helps answer all your questions.

Regards,
Jason
0
 
LVL 5

Author Closing Comment

by:MohitPandit
ID: 36908864
Thank you.
0

Featured Post

Independent Software Vendors: We Want Your Opinion

We value your feedback.

Take our survey and automatically be enter to win anyone of the following:
Yeti Cooler, Amazon eGift Card, and Movie eGift Card!

Question has a verified solution.

If you are experiencing a similar issue, please ask a related question

In this article we will get to know that how can we recover deleted data if it happens accidently. We really can recover deleted rows if we know the time when data is deleted by using the transaction log.
The Delta outage: 650 cancelled flights, more than 1200 delayed flights, thousands of frustrated customers, tens of millions of dollars in damages – plus untold reputational damage to one of the world’s most trusted airlines. All due to a catastroph…
This videos aims to give the viewer a basic demonstration of how a user can query current session information by using the SYS_CONTEXT function
Viewers will learn how to use the UPDATE and DELETE statements to change or remove existing data from their tables. Make a table: Update a specific column given a specific row using the UPDATE statement: Remove a set of values using the DELETE s…

726 members asked questions and received personalized solutions in the past 7 days.

Join the community of 500,000 technology professionals and ask your questions.

Join & Ask a Question