Solved

SSIS package: Import and Export data through flat files

Posted on 2011-09-22
7
356 Views
Last Modified: 2013-11-10
Hello,

I need to make packages on two different servers.

From one server, I need to export data on daily basis in to flat files and another package will import data from those flat files to database.

But I need to make package in systematic way as below:

1. Configuration manager (so that manage at run time at deployment). FYI, i can manage it through XML configuration.

2. Logging i.e. how many insert count and update count from a particular table at destination server when import from flat files will be occur.

3. If session break in mid either import/export then all transaction should be rollback. Also, need to give option to user in XML configuration to execute package on date range basis.

4. How can i manage packages like first master records should be inserted and after that transaction records will be inserted so that Foreign Key constraints should not be violated?

4. The package should be executed by SQL Server Agent on daily basis.

Kindly give answers as gradually aforesaid questions.

Best Regards,
MohitPandit
0
Comment
Question by:MohitPandit
  • 3
7 Comments
 
LVL 5

Author Comment

by:MohitPandit
ID: 36585040
0
 
LVL 5

Author Comment

by:MohitPandit
ID: 36586303
Can anyone assist on it?
0
 
LVL 21

Accepted Solution

by:
Jason Yousef, MS earned 500 total points
ID: 36892337
Hi,
You're actually asking for too much here.
You'll need to research each of your points and break it down .

1-read about ssis package configuration
http://www.sql-server-performance.com/2007/package-configuration-2005/

2-ssis custom logging
http://pragmaticworks.com/Products/Business-Intelligence/BIxPress/ssis-logging-auditing-monitoring.aspx

3-ssis checkpoints
http://www.mssqltips.com/sqlservertip/1408/integration-services-checkpoints-to-restart-package-from-failure/

4-you could use your own logic in sql query or lookup task in ssis
http://consultingblogs.emc.com/jamiethomson/archive/2005/10/21/2289.aspx

5-schedule ssis packages using SQL agent
http://decipherinfosys.wordpress.com/2008/09/17/scheduling-ssis-packages-with-sql-server-agent/

Hope that helps answer all your questions.

Regards,
Jason
0
 
LVL 5

Author Closing Comment

by:MohitPandit
ID: 36908864
Thank you.
0

Featured Post

PRTG Network Monitor: Intuitive Network Monitoring

Network Monitoring is essential to ensure that computer systems and network devices are running. Use PRTG to monitor LANs, servers, websites, applications and devices, bandwidth, virtual environments, remote systems, IoT, and many more. PRTG is easy to set up & use.

Question has a verified solution.

If you are experiencing a similar issue, please ask a related question

Suggested Solutions

Title # Comments Views Activity
Sql server function help 15 30
Find SQL query used by application 3 19
Sql server, import complete table, using vb.net 9 34
access query to sql server 3 19
Use this article to create a batch file to backup a Microsoft SQL Server database to a Windows folder.  The folder can be on the local hard drive or on a network share.  This batch file will query the SQL server to get the current date & time and wi…
This article shows gives you an overview on SQL Server 2016 row level security. You will also get to know the usages of row-level-security and how it works
Viewers will learn how to use the INSERT statement to insert data into their tables. It will also introduce the NULL statement, to show them what happens when no value is giving for any given column.
Viewers will learn how to use the UPDATE and DELETE statements to change or remove existing data from their tables. Make a table: Update a specific column given a specific row using the UPDATE statement: Remove a set of values using the DELETE s…

770 members asked questions and received personalized solutions in the past 7 days.

Join the community of 500,000 technology professionals and ask your questions.

Join & Ask a Question