Biztalk - is this a possible platform for standardizing file imports and business rules?

Hello all,

I am looking at some possible enterprise based solutions for handling file importing and trying to standardize one place to setup file imports and business logic / validations on the import and processing.   I know this is a very broad point and SSIS has been my ETL tool of choice when doing any of this except for any deep business rules.   Looking to see does BizTalk have better ways to handle that.  Some examples would be:

- Standard File Import file type filtering
- Checking for things such as file header etc. is there
- Validating data types possibly on columns prior to importing to a SQL database table for example.
- Applying business rules and then flagging things that need to be changed in the file for a visual the end user can change a field for example.

Not sure any one tool is feasible to do all of these things but looking even for the 90/10 rule that much of it can be done possibly.   But the idea of importing files into one portal where then the user can modify things and apply and retry is what I am looking for.
sbornstein2Asked:
Who is Participating?
I wear a lot of hats...

"The solutions and answers provided on Experts Exchange have been extremely helpful to me over the last few years. I wear a lot of hats - Developer, Database Administrator, Help Desk, etc., so I know a lot of things but not a lot about one thing. Experts Exchange gives me answers from people who do know a lot about one thing, in a easy to use platform." -Todd S.

Ryan McCauleyEnterprise Analytics ManagerCommented:
BizTalk definitely has the ability to handle that, but be careful that you're not chartering a bus to go pick up fast food, as BizTalk is a bit of a beast.

When it's configured and working properly, it requires very little care and is incredibly stable, but we've found that deployments and code updates are unnecessarily complicated. However, it does excel at converting every conceivable format into a central message exchange and then either sending that message on to another system or persisting it somewhere for you (like an MSSQL database). That's actually how we use BizTalk. It does also support some pretty complex transformations, transactional integrity, and a number of other features, but we're just using it to move files around to and from vendors, persist them when necessary, do some basic processing, and then send out summary emails.

If you're already using SSIS for ETL, why not look into doing custom C# coding there instead of BizTalk (which also uses C#, but could use any .NET language like VB.NET too)? You could do a custom scripting task if you had to parse an incoming file into some specific format, interpret XML, or do any other massaging of data, and then SSIS does an excellent job of moving it to where it needs to go. While BizTalk can be configured to fetch files from any location and send them pretty much anywhere, SSIS can handle many of the same locations (though BizTalk may be a bit more extensible here).

In the end, BizTalk definitely has more functionality, but it's also significantly more complex and is built handle very intensive communications between tiers in near-real-time - if you're just importing and parsing files and time isn't super-critical (as in they can be a few minutes late), I think you're better off leveraging SSIS and just extending the functionality you need using some .NET coding.
0

Experts Exchange Solution brought to you by

Your issues matter to us.

Facing a tech roadblock? Get the help and guidance you need from experienced professionals who care. Ask your question anytime, anywhere, with no hassle.

Start your 7-day free trial
sbornstein2Author Commented:
sorry for the late accept here.  great information thank you
0
It's more than this solution.Get answers and train to solve all your tech problems - anytime, anywhere.Try it for free Edge Out The Competitionfor your dream job with proven skills and certifications.Get started today Stand Outas the employee with proven skills.Start learning today for free Move Your Career Forwardwith certification training in the latest technologies.Start your trial today
Enterprise Software

From novice to tech pro — start learning today.