Solved

Inventory aggregation with csv files

Posted on 2014-01-11
6
399 Views
Last Modified: 2014-01-14
We have a drop-ship company and receive 15 inventory updates daily from our drop-ship vendors. Currently we are manually editing and uploading each and every one of these csv files that we receive to our inventory management system. We would like a solution that provides aggregation of the csvs and automatically processes these csvs with the needed formating to upload to our inventory management system. Hopefully this makes sense.

Any ideas?

Sincerely,

Completely Clueless
0
Comment
Question by:tbawarehouse
6 Comments
 
LVL 24

Expert Comment

by:mankowitz
ID: 39774195
Much of this depends on your inventory management system. If it is a common database, and you have access to it, I would probably set up a web site, ask the vendors to upload their files. I would parse them with php and then directly insert the new records into the existing database.

php has builtin str_getcsv to parse the csv and has adapters to all the common databases.

Of course, there are an infinite number of other languages that could do the same thing.
0
 

Author Comment

by:tbawarehouse
ID: 39774205
Sounds great but I worry if they have to upload to a website I may get some kick back. Seeing as now they are just ftping the file which is an automated process. Would this be as well?
0
 
LVL 24

Accepted Solution

by:
mankowitz earned 250 total points
ID: 39774211
Sure. Or you can use email. In order to do that you would periodically check for new items in the FTP directory or inbox. You'd have to have access to task scheduler (windowS) or cron (unix) in order to do that.
0
VMware Disaster Recovery and Data Protection

In this expert guide, you’ll learn about the components of a Modern Data Center. You will use cases for the value-added capabilities of Veeam®, including combining backup and replication for VMware disaster recovery and using replication for data center migration.

 
LVL 68

Expert Comment

by:Qlemo
ID: 39774935
This very much depends on input and output format, of course. Processing CSVs isn't difficult, in Windows you would e.g. use PowerShell or VBS with an FileSystemWatcher or WMI event monitoring script to kick-start the script, or start it on a regular base as stated abvove.
Do you want to insert that into a database (which DBMS?), or construct a web page (HTML table)?
0
 
LVL 16

Assisted Solution

by:AlexPace
AlexPace earned 250 total points
ID: 39776948
I solved a very similar problem by using MS SQL Server Integration Services.  You can make an SSIS task that imports directly from the CSV files into a database table.  In my situation there was a requirement to massage the data by combining and re-arranging some columns so my SSIS task first imported the CSVs into a raw format and then it launched a stored procedure that reformatted and inserted into a second table where it was actually used.  

At first I used a SQL Server Job to run it every hour but then they wanted it to run ASAP when a file was uploaded.  To accomplish this I switched the FTP software to Robo-FTP Server and associated a script with the UploadComplete event.  This script connected to the database and executed an SQL command that ran the job to import the newly uploaded CSV file so the files were processed instantly as soon as they were uploaded.
0
 
LVL 68

Expert Comment

by:Qlemo
ID: 39780892
Could you tell why you chose that two answers as solution?
0

Featured Post

Netscaler Common Configuration How To guides

If you use NetScaler you will want to see these guides. The NetScaler How To Guides show administrators how to get NetScaler up and configured by providing instructions for common scenarios and some not so common ones.

Question has a verified solution.

If you are experiencing a similar issue, please ask a related question

This article explains all about SQL Server Piecemeal Restore with examples in step by step manner.
This is about my first experience with programming Arduino.
Video by: Steve
Using examples as well as descriptions, step through each of the common simple join types, explaining differences in syntax, differences in expected outputs and showing how the queries run along with the actual outputs based upon a simple set of dem…
In this seventh video of the Xpdf series, we discuss and demonstrate the PDFfonts utility, which lists all the fonts used in a PDF file. It does this via a command line interface, making it suitable for use in programs, scripts, batch files — any pl…

929 members asked questions and received personalized solutions in the past 7 days.

Join the community of 500,000 technology professionals and ask your questions.

Join & Ask a Question

Need Help in Real-Time?

Connect with top rated Experts

12 Experts available now in Live!

Get 1:1 Help Now