Solved

Detecting if an FTP file is being written to before attempting download

Posted on 2008-10-02
5
264 Views
Last Modified: 2013-12-29
Hi,
I am polling an IIS FTP Server for files on a regular basis using Java.

Sometimes i am receiving an IOException, because the file is being written to while i am reading it.

Using a "ready" or trigger file is not an option at the moment with the vendor.

I am using Java SDK 1.4.2 and Apache Commons Net 1.4.1.

I am dealing with large files, in the code snippet i copy the stream to a ByteArrayOutputStream. The error occurs in the copyStream method while reading in the file.

Does anyone have any suggestions? i guess i could retry a few times...

Thanks

Mike


try {
 
            ftp = connect();
 
            ftp.setFileType(FTP.BINARY_FILE_TYPE);
 
            inputStream = new BufferedInputStream(ftp.retrieveFileStream(srcfilename));
 
            byteOutputStream = new ByteArrayOutputStream();
 
            /** Thread safe byte copy * */
            FTPUtil ecfu = new FTPUtil();
            ecfu.copyStream(inputStream, byteOutputStream);
 
            ftp.completePendingCommand();
            logger.debug("FTP: Byte transfer from server sucessful");
 
        } catch (IOException e) {
            throw new FTPServiceException("FTP: IOException downloading " + srcfilename, e);
        }

Open in new window

0
Comment
Question by:kwikksilva
  • 2
  • 2
5 Comments
 
LVL 9

Accepted Solution

by:
mbodewes earned 125 total points
ID: 22626479
Not really, afaik there is no option in the FTP protocol that tells you it is done. I've had the same problem, but then with detecting it after delivery by FTP.

You could try and see if the server understands this command:


MDTM

Syntax: MDTM remote-filename

Returns the last-modified time of the given file on the remote host in the format "YYYYMMDDhhmmss": YYYY is the four-digit year, MM is the month from 01 to 12, DD is the day of the month from 01 to 31, hh is the hour from 00 to 23, mm is the minute from 00 to 59, and ss is the second from 00 to 59.


And wait during polling until it is hasn't been changed for some time.
0
 
LVL 23

Expert Comment

by:Ajay-Singh
ID: 22630742
Whats the error you are getting? If the file is huge, keeping into memory is not a good idea.
0
 
LVL 9

Expert Comment

by:mbodewes
ID: 22652633
kwikksilva, have you solved the problem? It might be interesting to post the error message so we can exclude other errors.
0
 

Author Closing Comment

by:kwikksilva
ID: 31502314
This is the closest to the correct answer, i used the getTimestamp() method of FTPFile, and then set a parameter called timestamp-offset (in seconds) is my settings file. I don't touch the file unless it is older than the offset. This works for me in a production environment.
0
 

Author Comment

by:kwikksilva
ID: 22653382
Thanks guys, sorry i did not want to post the Exception, as it was only a side effect of the file being in transit. I used a play on mbodewes solution to avoid the problem altogether.
0

Featured Post

Courses: Start Training Online With Pros, Today

Brush up on the basics or master the advanced techniques required to earn essential industry certifications, with Courses. Enroll in a course and start learning today. Training topics range from Android App Dev to the Xen Virtualization Platform.

Question has a verified solution.

If you are experiencing a similar issue, please ask a related question

An old method to applying the Singleton pattern in your Java code is to check if a static instance, defined in the same class that needs to be instantiated once and only once, is null and then create a new instance; otherwise, the pre-existing insta…
By the end of 1980s, object oriented programming using languages like C++, Simula69 and ObjectPascal gained momentum. It looked like programmers finally found the perfect language. C++ successfully combined the object oriented principles of Simula w…
This theoretical tutorial explains exceptions, reasons for exceptions, different categories of exception and exception hierarchy.
Viewers will learn how to properly install Eclipse with the necessary JDK, and will take a look at an introductory Java program. Download Eclipse installation zip file: Extract files from zip file: Download and install JDK 8: Open Eclipse and …

808 members asked questions and received personalized solutions in the past 7 days.

Join the community of 500,000 technology professionals and ask your questions.

Join & Ask a Question