Solved

Inventory aggregation with csv files

Posted on 2014-01-11
6
387 Views
Last Modified: 2014-01-14
We have a drop-ship company and receive 15 inventory updates daily from our drop-ship vendors. Currently we are manually editing and uploading each and every one of these csv files that we receive to our inventory management system. We would like a solution that provides aggregation of the csvs and automatically processes these csvs with the needed formating to upload to our inventory management system. Hopefully this makes sense.

Any ideas?

Sincerely,

Completely Clueless
0
Comment
Question by:tbawarehouse
6 Comments
 
LVL 24

Expert Comment

by:mankowitz
Comment Utility
Much of this depends on your inventory management system. If it is a common database, and you have access to it, I would probably set up a web site, ask the vendors to upload their files. I would parse them with php and then directly insert the new records into the existing database.

php has builtin str_getcsv to parse the csv and has adapters to all the common databases.

Of course, there are an infinite number of other languages that could do the same thing.
0
 

Author Comment

by:tbawarehouse
Comment Utility
Sounds great but I worry if they have to upload to a website I may get some kick back. Seeing as now they are just ftping the file which is an automated process. Would this be as well?
0
 
LVL 24

Accepted Solution

by:
mankowitz earned 250 total points
Comment Utility
Sure. Or you can use email. In order to do that you would periodically check for new items in the FTP directory or inbox. You'd have to have access to task scheduler (windowS) or cron (unix) in order to do that.
0
Top 6 Sources for Identifying Threat Actor TTPs

Understanding your enemy is essential. These six sources will help you identify the most popular threat actor tactics, techniques, and procedures (TTPs).

 
LVL 68

Expert Comment

by:Qlemo
Comment Utility
This very much depends on input and output format, of course. Processing CSVs isn't difficult, in Windows you would e.g. use PowerShell or VBS with an FileSystemWatcher or WMI event monitoring script to kick-start the script, or start it on a regular base as stated abvove.
Do you want to insert that into a database (which DBMS?), or construct a web page (HTML table)?
0
 
LVL 16

Assisted Solution

by:AlexPace
AlexPace earned 250 total points
Comment Utility
I solved a very similar problem by using MS SQL Server Integration Services.  You can make an SSIS task that imports directly from the CSV files into a database table.  In my situation there was a requirement to massage the data by combining and re-arranging some columns so my SSIS task first imported the CSVs into a raw format and then it launched a stored procedure that reformatted and inserted into a second table where it was actually used.  

At first I used a SQL Server Job to run it every hour but then they wanted it to run ASAP when a file was uploaded.  To accomplish this I switched the FTP software to Robo-FTP Server and associated a script with the UploadComplete event.  This script connected to the database and executed an SQL command that ran the job to import the newly uploaded CSV file so the files were processed instantly as soon as they were uploaded.
0
 
LVL 68

Expert Comment

by:Qlemo
Comment Utility
Could you tell why you chose that two answers as solution?
0

Featured Post

IT, Stop Being Called Into Every Meeting

Highfive is so simple that setting up every meeting room takes just minutes and every employee will be able to start or join a call from any room with ease. Never be called into a meeting just to get it started again. This is how video conferencing should work!

Join & Write a Comment

A short article about problems I had with the new location API and permissions in Marshmallow
Whether you’re a college noob or a soon-to-be pro, these tips are sure to help you in your journey to becoming a programming ninja and stand out from the crowd.
Viewers will learn how to properly install Eclipse with the necessary JDK, and will take a look at an introductory Java program. Download Eclipse installation zip file: Extract files from zip file: Download and install JDK 8: Open Eclipse and …
In this seventh video of the Xpdf series, we discuss and demonstrate the PDFfonts utility, which lists all the fonts used in a PDF file. It does this via a command line interface, making it suitable for use in programs, scripts, batch files — any pl…

762 members asked questions and received personalized solutions in the past 7 days.

Join the community of 500,000 technology professionals and ask your questions.

Join & Ask a Question

Need Help in Real-Time?

Connect with top rated Experts

6 Experts available now in Live!

Get 1:1 Help Now