Question

SQL 2005 SSIS: Runs in design fine, Not so good after Installation

Asked by: moosetracker

Ok I got an SSIS package.
in the control flow..
1)  I have a data flow and the dataflow does a DataRead on a crappy 3rd party Database that must be pulled through ODBC and is limited. This only pulls one record then uses all sorts of derived tasks to manipulate data.
2) I have a loop that reads all the fields from DataFlow #1 and puts in variables. No tasks run in the loop though.
3)I have another loop that looks for some txt files in a folder to delete them. but except for the "file System task" to delete the txt files nothing else is in the loop.
4) I call another Data flow which is the main process. This is the one with the errors. the first task a DataRead to THE SAME crappy ODBC database that the first Data flow did.. But now it is pulling lots of records.  (One thing to mention is that even during the "design time" runs this DataRead had to be fixed from errors in an odd way.. I had to create a text file Redirected the row on error for any string variable.. No Rows ever went in it.. All Rows processed.. But without this bypass piece I did have errors..

Now for the errors from the run of the Installed package from SQL Server.. This is abbrevated as the errors won't let you cut an paste.

Main Processing
  Validation Has Started
  Info: Validation phase Beginning
  Progress Validating - 0% complete
                                     20% complete
                                     40% complete
  error: system.Data.Odbc.ODBC exception: Error Microsoft ODBC Driver manager Data source
            name not found & no Default Dreiver specified..
  (some other errors.. but I did not see anything worth writting it down.
 error:  component "DR for Dunbrad" (31) failed validation and returned error code 0 X
            80131937
      progress validation - 60% complete
     validation is complete..

At this point it seems to run the same set list of info a 2nd time exactly the same from validation beginning to validation complete..

DR for DunBrad is my first task.. But it seems to be processing the records with the progress percentage. and it seems to say only 31 records failed.. So why oh why would it state an error it can't find the driver.. Especially when some other process successfully connected with it.

(Also I checked the .txt file that the errors records that were redirected should have gone to.. It is empty.)

   

This Question has been solved and asker verified All Experts Exchange premium technology solutions are available to subscription members.

Subscribe now for full access to Experts Exchange and get

Instant Access to this Solution

  • Plus...
  • 30 Day FREE access, no risk, no obligation
  • Collaborate with the world's top tech experts
  • Unlimited access to our exclusive solution database
  • Never be left without tech help again

Subscribe Now

Asked On
2009-11-04 at 13:11:08ID24872526
Topics

SSIS

,

SQL Server 2005

,

SQL Server 2008

Participating Experts
3
Points
500
Comments
14

Trusted by hundreds of thousands everyday for fast, accurate and reliable tech support.

  • "The time we save is the biggest benefit of Experts Exchange to Warner Bros. What could take multiple guys 2 hours or more each to find is accessed in around 15 minutes on Experts Exchange." Mike Kapnisakis, Warner Bros.
  • "Our team likes having a resource that is more secure than just using Google and most experts using this service really know their stuff. It's nice to look here first versus using Google." Dayna Sellner, Lockheed Martin
  • "Anytime that I've been stumped with a problem, 9 out of 10 times Experts Exchange has either the accepted solution or an open discussion of the potential solution to the problem." Kenny Red, eBay Inc.

See what Experts Exchange can do for you.

Got a question?

We've got the answer.

Experts Exchange has been collecting answers to technology questions since 1996…3 million and counting! If you have a question, chances are we already have your answer.

Screenshot of Experts Exchange Knowledgebase

Need individual assistance?

Our experts are ready to help.

If you can't find the exact answer you're looking for, ask our exclusive community of 50,000 experts. You’ll get a personalized answer from a trusted professional.

Screenshot of Experts Exchange Knowledgebase

Want to learn from the best?

Read articles from industry experts.

Thousands of free tech tips, tricks, how-to’s and tutorials are available in our peer reviewed articles section. See for yourself how smart our experts are, no login required.

Screenshot of an Article

Working on a long term project?

Store your work and research.

Save solutions to your questions, answers you’ve discovered through searching plus helpful articles in your personal knowledgebase for easy future access.

Screenshot of Experts Exchange Knowledgebase

Access the answers to your technology questions today.

Subscribe Now

30-day free trial. Register in 60 seconds.

What Makes Experts Exchange Unique?

Members of the expert community talk about why the experience at Experts Exchange is different than what you will find anywhere else.

Trusted by the world's most respected brands.

image of each brand's logo

Faithfully serving IT professionals since 1996.

Experts Exchange Logo

Try it out and discover for yourself.

Subscribe Now

30-day free trial. Register in 60 seconds.

Related Solutions

  1. SSIS Derived Column
    Experts: I have a DTS package that I’m trying to rewrite in SSIS, In my DTS package on one of my transformation were I’m mapping source to destination I have a field that gets populated by a global variable, I use a simple active x script to determine witch variable to use, t...
  2. Whats quicker; SQL or SSIS?
    Hi all, I'm a bit short of time for a project so can't really do both and compare (but will at some point), so therefore; What is quicker; an SQL statement or using the objects in SSIS? i.e. If I can do a lookup by joined table or sub-query, is that quicker than the lookup ...
  3. SSIS - Dynamic Derived Column?
    I can use a Derived Column transformation to add a column to my data set (Please see the attached image file). Currently, the value of the testColumn is always 5. But I want to be able to populate this value dynamically from the database using a select statement. For instance...
  4. SSIS DERIVED COLUMN EXPRESSION
    Hi Guys , I have a problem with creating an expressions in SSIS Derived Column i have an Column coming from a flat file as string actually its date time some thing like 1/2/2009:12:00:00AM but i need to change it to 20090201 and send to database again as a string 1/2/2...
  5. ssis
    What could you use SSIS for?

Free Tech Articles

  1. WARNING: 5 Reasons why you should NEVER fix a computer for free.
    It is in our nature to love the puzzle. We are obsessed. The lot of us. We love puzzles. We love the challenge. We thrive on finding the answer. We hate disarray. It bothers us deep in our soul. W...
  2. SCCM OSD Basic troubleshooting
    SCCM 2007 OSD is a fantastic way to deploy operating systems, however, like most things SCCM issues can sometimes be difficult to resolve due to the sheer volume of logs to sift through and the dispe...
  3. Migrate Small Business Server 2003 to Exchange 2010 and Windows 2008 R2
    This guide is intended to provide step by step instructions on how to migrate from Small Business Server 2003 to Windows 2008 R2 with Exchange 2010. For this migration to work you will need the fo...
  4. Create a Win7 Gadget
    This article shows you how to create a simple "Gadget" -- a sort of mini-application supported by Windows 7 and Vista. Gadgets can be dropped anywhere on the desktop to provide instant information, ...
  5. Outlook continually prompting for username and password
    There have been a lot of questions recently regarding Outlook prompting for a username and password whilst using Exchange 2007. There are a few reasons why this would happen and I will try to cover t...
  6. Backup Exchange 2010 Information Store using Windows Backup
    There seems to be quite a lot of confusion around the ability to backup Exchange 2010 using the built in Windows Backup feature. This stems from the omission of this feature prior to Exchange 2007 s...

Cloud Class Webinars

  1. Avoiding Bugs in Microsoft Access
    Alison Balter takes and in-depth look at avoiding bugs in Access. In this webinar you will learn about using the immediate window to debug your applications, invoking the debugger, using breakpoints to troubleshoot, stepping through code, setting the next statement to execute, ...
  2. Top 10 Best New Features in Visio 2010
    Scott Helmers gives live demonstrations of the top 10 new features in Visio 2010. This webinar will teach you how to create compelling diagrams by adding shapes to the page with a single click, linking the shapes in a diagram to data in Excel (or SQL Server, or SharePoint), ...
  3. IT Consultant Business Secrets Revealed
    Michael Munger, Experts Exchange tech pro and IT consultant, pulls back the curtain on his very successful businesses and answers question on every IT consultant and business owner should know about. He shares secrets on what he did to solve the 5 most common problems in IT, ...
  4. Disaster Recovery and Business Continuity
    Quest CTO, Mike Billon, gives an overview of the steps involved in building a dunamic disaster recovery plan. Through case studies and an examination of software/hardware tooles for monitoring and testing, you'll gain a better understandin of where you are, where you want ...
  5. Organize Your Visio Diagrams with Containers and Lists
    Scott Helmers uses cross functional flowcharts, wireframe diagrams, data graphic legends and seating charts to teach you: how to ustilize all three new structured diagram components in Visio 2010, the best practices for organizeing shapes in previous version of Visio, how to organize ...
  6. How to Us Objects, Properties, Events and Methods in Microsoft Access
    Alison Dalter gives an in-depbth look at objects, properties, events and methods in Microsoft Access. In this webinar you will learn about using the object browser, referring to objects, working with properties and methods, working with object variables, understanding the ...

Join the Community

Give a Little. Get a Lot.

Join the community of experts here and help other tech pros by answering question in your area of expertise. You can earn FREE access to all Experts Exchange's premium features and resources.

Join the Community

Answers

 

by: pettmansPosted on 2009-11-04 at 19:14:43ID: 25746467

Looks like it can't find the DSN for the data source when run in production. Check that the Data Source  is set up a a System DSN on the server so it is available to the service account that runs the package.

 

by: nmcdermaidPosted on 2009-11-04 at 21:55:33ID: 25747054

Is your SQL Server installation 64 bit?

 

by: moosetrackerPosted on 2009-11-05 at 07:58:00ID: 25750812

Ok.. Our SQL Server is 32 bit.. There is nothing running 64 bit in the whole company.

As for the DSN.. I double checked.. It was setup in the file rather then system.. So I added it to system too. But it didn't make a difference. Also Remember the exact same DSN connection is working fine for a 1 record pull in the first task..

So your right it Looks like the DSN is not connection by why would it connect for the 1 record pull and not for the other pull?

 

by: nmcdermaidPosted on 2009-11-05 at 12:57:07ID: 25753923

A couple of guesses:

1. Try setting DelayValidation = True
2. Maybe the account that the package is running under can't get to the file. Are you running this as a job?

 

by: moosetrackerPosted on 2009-11-06 at 10:45:35ID: 25761831

Ok.. I have to restate the problem.. IT IS NOT WORKING FOR EITHER DSN CONNECTION. I thought the validation was in order and it is not, therefore it validated "Main" under the other DataFlow task first, and never even tried to validate the other one.. disable the "Main" task and the other one failed also..

Delay Validation didn't work.. But I saw something freaky with my connection string, and decided to install BIDS on the Server to figure out if the connection string wanted something different.. It Sure does..  And it corrupts in a way, I don't know if I can fix it on the server side.. (and I can't sit at the server all day doing my design work to create packages..)

Lets say my connection string has a UID: stupid  Password: STUPID... So I put those in the connection. on my desktop, my grayed out string shows  UID:,Password:******     My Server when opened blows up with errors shown below.. But if you build a new connection, It shows up as UID:STUPID,Password:


So one has blank UID & the password, the other has UID & a blank password.. And neither likes the other at all.

The errors are in a file attachment..

 

by: moosetrackerPosted on 2009-11-06 at 10:47:53ID: 25761859

May be me, but I don't see the attachment.. So I am placing the errors here.

Error      1      Error loading DunBradtest.dtsx: Failed to decrypt protected XML node "DTS:Property" with error 0x8009000B "Key not valid for use in specified state.". You may not be authorized to access this information. This error occurs when there is a cryptographic error. Verify that the correct key is available.        Y:\SSISProjects\VisionDataProjects\VisionDataProjects\DunBradtest.dtsx      1      1

(3 MORE ERRORS SIMILAR TO ERROR 1)      

Error      5      Validation error. Main Processing: DR for DunnBrad [31]: System.Data.Odbc.OdbcException: ERROR [08001] [Unify][UnifyClient ODBC Driver][UnifyClient][UnifyLNA][Unify][Unify DataServer ODBC Driver][Unify DataServer]The user name or password is incorrect. (1284)  ERROR [IM006] [Microsoft][ODBC Driver Manager] Driver's SQLSetConnectAttr failed     at System.Data.Odbc.OdbcConnection.HandleError(OdbcHandle hrHandle, RetCode retcode)     at System.Data.Odbc.OdbcConnectionHandle..ctor(OdbcConnection connection, OdbcConnectionString constr, OdbcEnvironmentHandle environmentHandle)     at System.Data.Odbc.OdbcConnectionOpen..ctor(OdbcConnection outerConnection, OdbcConnectionString connectionOptions)     at System.Data.Odbc.OdbcConnectionFactory.CreateConnection(DbConnectionOptions options, Object poolGroupProviderInfo, DbConnectionPool pool, DbConnection owningObject)     at System.Data.ProviderBase.DbConnectionFactory.CreateNonPooledConnection(DbConnection owningConnection, DbConnectionPoolGroup poolGroup)     at System.Data.ProviderBase.DbConnectionFactory.GetConnection(DbConnection owningConnection)     at System.Data.ProviderBase.DbConnectionClosed.OpenConnection(DbConnection outerConnection, DbConnectionFactory connectionFactory)     at System.Data.Odbc.OdbcConnection.Open()     at Microsoft.SqlServer.Dts.Runtime.ManagedHelper.GetManagedConnection(String assemblyQualifiedName, String connStr, Object transaction)     at Microsoft.SqlServer.Dts.Runtime.Wrapper.IDTSConnectionManager90.AcquireConnection(Object pTransaction)     at Microsoft.SqlServer.Dts.Pipeline.DataReaderSourceAdapter.AcquireConnections(Object transaction)     at Microsoft.SqlServer.Dts.Pipeline.ManagedComponentHost.HostAcquireConnections(IDTSManagedComponentWrapper90 wrapper, Object transaction)      DunBradtest.dtsx      0      0      

 

by: moosetrackerPosted on 2009-11-06 at 12:19:15ID: 25762689

I found after getting through the problem with my ODBC 3rd party server, that my SQL Server connection had similar issues!!! What gives? your suppose to do program design at the server?

Here is my work around..
   I made the connectors to my ODBC DB and SQL DB global..
   On the Server I created another project. With the same global connectors built with the same name.
   When I want to build an install the package, I go to the Server and in the BIDS bring up the server package. I import the package into it. Since the global connectors out pulled from outside the package they will then use the Server connectors and are happy.
   I build from the Server project.
   I import into SSIS the Server builds.    


If anyone has a better way to rid myself of this problem, rather then live with a workaround. I am all ears. But for now when I run out of SSIS it is successful.

 

by: acperkinsPosted on 2009-11-06 at 17:12:53ID: 25764486

Perhaps you did not see nmcdermaid comment the first time, so here it goes again:
"Are you running this as a job?"

In otehr words does it only fail when it runs as a job?

 

by: moosetrackerPosted on 2009-11-07 at 05:36:34ID: 25766268

No, It would not run as a direct run from SSIS

Then I added BIDS to the server and when the package opened in BIDS It came up with  4 errors all having to do with the file connection and the password.

Now that I figured out how to create a new project and make the Connections for both the 3rd party DB and SQL Server global in both project have the same global connection but each projectcreated their connection from thier location. When I import a package from my desktop Bids project to my Server Bids project,my Bids program on the server does not have the errors. then Build the package from there and import that into SSIS.. My SSIS can run the project fine also..

I know I am hitting another error with the job scheduling.. Which I created a different thread for, and I think we are coming down to figuring that out.

I guess here I just feel I have solved the issue that it is something with the connections.. But since it is not only my 3rd party software, but SQL  and all tutorials say once you create a package you can just import it to any server.. I am hoping that someone can take the definate error, and tell me a better fix then my work-around 'cause I don't know the right way to fix it.

 

by: nmcdermaidPosted on 2009-11-07 at 06:44:37ID: 25766481

Packages have an en ryption method. You have chosen the method that does not save passwords. If you use 'encrypt with password' it will get around the issue, but you should really do some reading on encryption methods. The other three methods are encrypt with server key, encrypt with user key, don't save sensitive. I'm pretty sure you are using 'don't save sensitive'

 

by: moosetrackerPosted on 2009-11-07 at 12:34:56ID: 25767923

I will need to check on Monday. I believe it was encrypt with server or user key (what ever the default was..) but to try to get it into a scheduled job, I changed it to encrypt with password.. It will be interesting to see if that will solve this problem too..
I am excited to try it out, but am happy to wait for monday, and enjoy my weekend now.

 

by: moosetrackerPosted on 2009-11-10 at 15:00:32ID: 25790869

Sorry it has been hetci at work, and I did want to write a more thourogh answer to this, but tomorrow is a holi, and I am already home, so I will have to write this as well as I can remember.

The 'encrypt with password' did not work for me, In solving the issue with the data connections being specific to the .. But I am getting the feeling that different things work at different sites.

What worked for me was 'Rely on server storage for encryption' which could only be set when you were in the process of saving it to the SQL Server. The feature is under the 'file' tab in the top bar, and is one down from the normal 'save as' function but something like 'save copy of 'your packagename' as.. Once you get into it it is pretty self explanatory. You want to save it to sql server - give the Server login info.. enter what you want the package called on the Server.. And the very last question is to change the protection level. It looks grayed out, but you can change it. You have to have the SSIS set up on your SQL Server for this because it will go in there under (I believe) 'MSDN' folder.

This protection level solved this issue and another one to get the protection level to submit it to a job Schedule Agent.

 

by: nmcdermaidPosted on 2009-11-10 at 15:06:00ID: 25790923

Yes protection level (not encryption level as I incorrectly stated) is the issue. All types of protection levels work in different ways. For example server encryption will work as long as you only run the package on the server. User encryption will only work if the pckage designer and the executor are the same.

 

by: moosetrackerPosted on 2009-11-10 at 15:06:23ID: 31650229

Well both had parts of it.. And some of it I can see as working depending on the setup you have, but didn't work 100% for my situation.
My last comment shows what worked for me, which is different then both comments. But the advice about the protection level got me to playing with different things... And the DSN were not being read, but not for lack of correct setup.

20120131-EE-VQP-002

3 Ways to Join

30-Day Free Trial

The Experts

98% positive feedback on 31,087 answers since March 2000. angeliii is a Microsoft Most Valuable Professional for his work with MS SQL Server & Develoment.

He has also proven his knowledge of Visual Basic Programming, PHP Scripting and Oracle Databases.

The Experts

97% positive feedback on 10,752 answers since July 2000. lrmoore has more than 18 years experience in the networking industry.

The six-time Mircosoft MVPs specialties include firewalls, virtual private networking, and network management.

Testimonials

"...and excellent source for support... Kind of like having your very own IT dept." Electriciansnet

Testimonials

"I was apprehensive at signing up at first. However... it has already made my life as an IT administrator much easier." JaCrews

Testimonials

"WOW! You guys have great, active, and knowledgeable people on here." moore50

Business Clients

Business Clients

In the Press

"If you’ve got a question... Experts Exchange can supply an answer.”

In the Press

"...an invaluable aid for both IT professionals and those who require tech support."

In the Press

"where IT professionals provide quick answers on just about any topic"

Business Account Plans

Loading Advertisement...