[x]
Posted via EE Mobile

Search, ask, and monitor your questions on the go with EE Mobile. Visit Experts Exchange from your mobile device and never be out of touch again.
Question
[x]
Attachment Details
[x]
The Solution Rating System

With so many solutions, how can you tell which solutions are most likely to help you and which ones are not? To provide you with a tool to use, we rate our solutions based on various elements that most accurately determine if a solution is a quality solution. To explain what factors affect the solution rating, here are the elements we take into consideration when formulating our solution rating.

  • The Grade of the Solution
  • The Zone Rank of the Expert Providing the Solution
  • The Number of Author and Expert Comments
  • The Number of Experts Contributing
  • The Feedback of the Community

Your Input Matters
Because of the way the system is set up, the most important variable in this equation is you. As a member of Experts Exchange, you are able to cast your vote on the quality of the solutions in regard to how complete, accurate, helpful and easy to understand each solution is. When you provide your feedback, each rating is adjusted accordingly. So, if you see a solution that has a poor rating that you think is a good solution, let us know by rating it. As you do, the rating will be adjusted and will become more accurate for other members of our site.

If you have any suggestions that you would like to make for our rating system, please ask a question in the Suggestions Zone of Community Support.

Thank you!
9.2

Scheduled importing of CSV file using DTS or SSIS

Asked by newknew in MS SQL DTS, MS SQL Server, SSIS

Tags: MS SQL SERVER, DTS, SSIS, CSV, IMPORT

I have a business partner with FTP access to our server.  He has his system set to automatically FTP a CSV data file to our server.  I need to read this file periodically and import or update his existing records per the CSV file.  New files will be FTP'd every day for example and will have a unique name of some sort.  I don't think this is a complicated project as the application is very much just a web based (dotnet),  15 field data storage and recall application.

The most complicated part (for me anyway) may be trying to figure out whether I should be updating or adding new records based on the clients CSV.  Client will be sending their PrimaryKey with their records so I will know if their records already exist, will just need to write the code for that (is this where the DTS/SSIS part comes in?)

... so, after thinking out loud :) I need:

1) more education on implementing DTS or SSIS for use with CSV files (we have MS SQL Server 2000).
2) scheduling DTS/SSIS packages for execution as SQL Agent job.
3) a way to know which CSV files should be read next at the next scan
4) how to delete the CSVs after they are imported (or at some later date if a recommended)
5) a way to distinguish which records need to be imported and which ones need to be updated
6) how to execute the importing/updating after records are identified
** sounds like the DTS/SSIS "package" may take care of 5 & 6.

I know there are many existing questions about DTS and importing, but the information is scattered.  I wouldnt mind if part of the solution points to other quality solutions, articles, websites and best practices for solving this project.
[+][-]03/30/09 10:12 PM, ID: 24025879Accepted Solution

View this solution now by starting your 30-day free trial. Setting up your free trial is quick, easy, and secure. We will return you to this solution, unlocked, when you're done.

About this solution

Zones: MS SQL DTS, MS SQL Server, SSIS
Tags: MS SQL SERVER, DTS, SSIS, CSV, IMPORT
Sign Up Now!
Solution Provided By: nmcdermaid
Participating Experts: 2
Solution Grade: A
 
[+][-]03/30/09 07:48 PM, ID: 24025356Expert Comment

At Experts Exchange, members can ask their questions to thousands of technology professionals, also known as Experts. Experts compete and collaborate to answer those questions by leaving comments like this one.

Start your 30-day free trial to view this Expert Comment or ask the Experts your question.

 
[+][-]10/13/09 01:32 PM, ID: 25564219Administrative Comment

Experts Exchange has a courteous staff of administrators who help members get the most out of the website by means of administrative comments like this one.

Start your 30-day free trial to view this Administrative Comment or ask the Experts your question.

 
 
Loading Advertisement...
20091111-EE-VQP-92 - Hierarchy / EE_QW_3_20080625