Solved

Detecting if an FTP file is being written to before attempting download

Posted on 2008-10-02
5
252 Views
Last Modified: 2013-12-29
Hi,
I am polling an IIS FTP Server for files on a regular basis using Java.

Sometimes i am receiving an IOException, because the file is being written to while i am reading it.

Using a "ready" or trigger file is not an option at the moment with the vendor.

I am using Java SDK 1.4.2 and Apache Commons Net 1.4.1.

I am dealing with large files, in the code snippet i copy the stream to a ByteArrayOutputStream. The error occurs in the copyStream method while reading in the file.

Does anyone have any suggestions? i guess i could retry a few times...

Thanks

Mike


try {
 

            ftp = connect();
 

            ftp.setFileType(FTP.BINARY_FILE_TYPE);
 

            inputStream = new BufferedInputStream(ftp.retrieveFileStream(srcfilename));
 

            byteOutputStream = new ByteArrayOutputStream();
 

            /** Thread safe byte copy * */

            FTPUtil ecfu = new FTPUtil();

            ecfu.copyStream(inputStream, byteOutputStream);
 

            ftp.completePendingCommand();

            logger.debug("FTP: Byte transfer from server sucessful");
 

        } catch (IOException e) {

            throw new FTPServiceException("FTP: IOException downloading " + srcfilename, e);

        }

Open in new window

0
Comment
Question by:kwikksilva
  • 2
  • 2
5 Comments
 
LVL 9

Accepted Solution

by:
mbodewes earned 125 total points
Comment Utility
Not really, afaik there is no option in the FTP protocol that tells you it is done. I've had the same problem, but then with detecting it after delivery by FTP.

You could try and see if the server understands this command:


MDTM

Syntax: MDTM remote-filename

Returns the last-modified time of the given file on the remote host in the format "YYYYMMDDhhmmss": YYYY is the four-digit year, MM is the month from 01 to 12, DD is the day of the month from 01 to 31, hh is the hour from 00 to 23, mm is the minute from 00 to 59, and ss is the second from 00 to 59.


And wait during polling until it is hasn't been changed for some time.
0
 
LVL 23

Expert Comment

by:Ajay-Singh
Comment Utility
Whats the error you are getting? If the file is huge, keeping into memory is not a good idea.
0
 
LVL 9

Expert Comment

by:mbodewes
Comment Utility
kwikksilva, have you solved the problem? It might be interesting to post the error message so we can exclude other errors.
0
 

Author Closing Comment

by:kwikksilva
Comment Utility
This is the closest to the correct answer, i used the getTimestamp() method of FTPFile, and then set a parameter called timestamp-offset (in seconds) is my settings file. I don't touch the file unless it is older than the offset. This works for me in a production environment.
0
 

Author Comment

by:kwikksilva
Comment Utility
Thanks guys, sorry i did not want to post the Exception, as it was only a side effect of the file being in transit. I used a play on mbodewes solution to avoid the problem altogether.
0

Featured Post

How to improve team productivity

Quip adds documents, spreadsheets, and tasklists to your Slack experience
- Elevate ideas to Quip docs
- Share Quip docs in Slack
- Get notified of changes to your docs
- Available on iOS/Android/Desktop/Web
- Online/Offline

Join & Write a Comment

Introduction Java can be integrated with native programs using an interface called JNI(Java Native Interface). Native programs are programs which can directly run on the processor. JNI is simply a naming and calling convention so that the JVM (Java…
Introduction This article is the last of three articles that explain why and how the Experts Exchange QA Team does test automation for our web site. This article covers our test design approach and then goes through a simple test case example, how …
Viewers learn about the third conditional statement “else if” and use it in an example program. Then additional information about conditional statements is provided, covering the topic thoroughly. Viewers learn about the third conditional statement …
Viewers will learn about if statements in Java and their use The if statement: The condition required to create an if statement: Variations of if statements: An example using if statements:

771 members asked questions and received personalized solutions in the past 7 days.

Join the community of 500,000 technology professionals and ask your questions.

Join & Ask a Question

Need Help in Real-Time?

Connect with top rated Experts

14 Experts available now in Live!

Get 1:1 Help Now