Solved

Detecting if an FTP file is being written to before attempting download

Posted on 2008-10-02
5
287 Views
Last Modified: 2013-12-29
Hi,
I am polling an IIS FTP Server for files on a regular basis using Java.

Sometimes i am receiving an IOException, because the file is being written to while i am reading it.

Using a "ready" or trigger file is not an option at the moment with the vendor.

I am using Java SDK 1.4.2 and Apache Commons Net 1.4.1.

I am dealing with large files, in the code snippet i copy the stream to a ByteArrayOutputStream. The error occurs in the copyStream method while reading in the file.

Does anyone have any suggestions? i guess i could retry a few times...

Thanks

Mike


try {
 
            ftp = connect();
 
            ftp.setFileType(FTP.BINARY_FILE_TYPE);
 
            inputStream = new BufferedInputStream(ftp.retrieveFileStream(srcfilename));
 
            byteOutputStream = new ByteArrayOutputStream();
 
            /** Thread safe byte copy * */
            FTPUtil ecfu = new FTPUtil();
            ecfu.copyStream(inputStream, byteOutputStream);
 
            ftp.completePendingCommand();
            logger.debug("FTP: Byte transfer from server sucessful");
 
        } catch (IOException e) {
            throw new FTPServiceException("FTP: IOException downloading " + srcfilename, e);
        }

Open in new window

0
Comment
Question by:kwikksilva
[X]
Welcome to Experts Exchange

Add your voice to the tech community where 5M+ people just like you are talking about what matters.

  • Help others & share knowledge
  • Earn cash & points
  • Learn & ask questions
  • 2
  • 2
5 Comments
 
LVL 9

Accepted Solution

by:
mbodewes earned 125 total points
ID: 22626479
Not really, afaik there is no option in the FTP protocol that tells you it is done. I've had the same problem, but then with detecting it after delivery by FTP.

You could try and see if the server understands this command:


MDTM

Syntax: MDTM remote-filename

Returns the last-modified time of the given file on the remote host in the format "YYYYMMDDhhmmss": YYYY is the four-digit year, MM is the month from 01 to 12, DD is the day of the month from 01 to 31, hh is the hour from 00 to 23, mm is the minute from 00 to 59, and ss is the second from 00 to 59.


And wait during polling until it is hasn't been changed for some time.
0
 
LVL 23

Expert Comment

by:Ajay-Singh
ID: 22630742
Whats the error you are getting? If the file is huge, keeping into memory is not a good idea.
0
 
LVL 9

Expert Comment

by:mbodewes
ID: 22652633
kwikksilva, have you solved the problem? It might be interesting to post the error message so we can exclude other errors.
0
 

Author Closing Comment

by:kwikksilva
ID: 31502314
This is the closest to the correct answer, i used the getTimestamp() method of FTPFile, and then set a parameter called timestamp-offset (in seconds) is my settings file. I don't touch the file unless it is older than the offset. This works for me in a production environment.
0
 

Author Comment

by:kwikksilva
ID: 22653382
Thanks guys, sorry i did not want to post the Exception, as it was only a side effect of the file being in transit. I used a play on mbodewes solution to avoid the problem altogether.
0

Featured Post

Optimize your web performance

What's in the eBook?
- Full list of reasons for poor performance
- Ultimate measures to speed things up
- Primary web monitoring types
- KPIs you should be monitoring in order to increase your ROI

Question has a verified solution.

If you are experiencing a similar issue, please ask a related question

An old method to applying the Singleton pattern in your Java code is to check if a static instance, defined in the same class that needs to be instantiated once and only once, is null and then create a new instance; otherwise, the pre-existing insta…
Introduction Java can be integrated with native programs using an interface called JNI(Java Native Interface). Native programs are programs which can directly run on the processor. JNI is simply a naming and calling convention so that the JVM (Java…
Viewers will learn about basic arrays, how to declare them, and how to use them. Introduction and definition: Declare an array and cover the syntax of declaring them: Initialize every index in the created array: Example/Features of a basic arr…
This tutorial covers a practical example of lazy loading technique and early loading technique in a Singleton Design Pattern.
Suggested Courses

617 members asked questions and received personalized solutions in the past 7 days.

Join the community of 500,000 technology professionals and ask your questions.

Join & Ask a Question