• Status: Solved
  • Priority: Medium
  • Security: Public
  • Views: 302
  • Last Modified:

Detecting if an FTP file is being written to before attempting download

Hi,
I am polling an IIS FTP Server for files on a regular basis using Java.

Sometimes i am receiving an IOException, because the file is being written to while i am reading it.

Using a "ready" or trigger file is not an option at the moment with the vendor.

I am using Java SDK 1.4.2 and Apache Commons Net 1.4.1.

I am dealing with large files, in the code snippet i copy the stream to a ByteArrayOutputStream. The error occurs in the copyStream method while reading in the file.

Does anyone have any suggestions? i guess i could retry a few times...

Thanks

Mike


try {
 
            ftp = connect();
 
            ftp.setFileType(FTP.BINARY_FILE_TYPE);
 
            inputStream = new BufferedInputStream(ftp.retrieveFileStream(srcfilename));
 
            byteOutputStream = new ByteArrayOutputStream();
 
            /** Thread safe byte copy * */
            FTPUtil ecfu = new FTPUtil();
            ecfu.copyStream(inputStream, byteOutputStream);
 
            ftp.completePendingCommand();
            logger.debug("FTP: Byte transfer from server sucessful");
 
        } catch (IOException e) {
            throw new FTPServiceException("FTP: IOException downloading " + srcfilename, e);
        }

Open in new window

0
kwikksilva
Asked:
kwikksilva
  • 2
  • 2
1 Solution
 
mbodewesCommented:
Not really, afaik there is no option in the FTP protocol that tells you it is done. I've had the same problem, but then with detecting it after delivery by FTP.

You could try and see if the server understands this command:


MDTM

Syntax: MDTM remote-filename

Returns the last-modified time of the given file on the remote host in the format "YYYYMMDDhhmmss": YYYY is the four-digit year, MM is the month from 01 to 12, DD is the day of the month from 01 to 31, hh is the hour from 00 to 23, mm is the minute from 00 to 59, and ss is the second from 00 to 59.


And wait during polling until it is hasn't been changed for some time.
0
 
Ajay-SinghCommented:
Whats the error you are getting? If the file is huge, keeping into memory is not a good idea.
0
 
mbodewesCommented:
kwikksilva, have you solved the problem? It might be interesting to post the error message so we can exclude other errors.
0
 
kwikksilvaAuthor Commented:
This is the closest to the correct answer, i used the getTimestamp() method of FTPFile, and then set a parameter called timestamp-offset (in seconds) is my settings file. I don't touch the file unless it is older than the offset. This works for me in a production environment.
0
 
kwikksilvaAuthor Commented:
Thanks guys, sorry i did not want to post the Exception, as it was only a side effect of the file being in transit. I used a play on mbodewes solution to avoid the problem altogether.
0
Question has a verified solution.

Are you are experiencing a similar issue? Get a personalized answer when you ask a related question.

Have a better answer? Share it in a comment.

Join & Write a Comment

Featured Post

Cloud Class® Course: CompTIA Healthcare IT Tech

This course will help prep you to earn the CompTIA Healthcare IT Technician certification showing that you have the knowledge and skills needed to succeed in installing, managing, and troubleshooting IT systems in medical and clinical settings.

  • 2
  • 2
Tackle projects and never again get stuck behind a technical roadblock.
Join Now