how to send data in chunks from server and client in java

Posted on 2011-03-07
Medium Priority
Last Modified: 2013-11-23
if the file i request is too large, the client need to wait very long. what does to be modify from my code in order to receive the data in chunks.
e.g. transmit 100MB into 10MB each chunk in order for me to process
int len=0;
        byte [] mybytearray  = new byte [buffer];
        InputStream is = connection.getInputStream();
        FileOutputStream fos = new FileOutputStream("default.amc");
        BufferedOutputStream bos = new BufferedOutputStream(fos);

 while((len=is.read(mybytearray)) > 0)
         long end = System.currentTimeMillis();

Open in new window

Question by:jackson_duffy
  • 5
  • 4
LVL 92

Expert Comment

ID: 35054550
To support sending data in chunks would also require modifying the client to support receive the data in chunks
Changes to the server would be to support specifying the start byte and the number of bytes to send.

>  while((len=is.read(mybytearray)) > 0)

btw, that should be:

 while((len=is.read(mybytearray)) >= 0)

Author Comment

ID: 35054693
my server side codes are shown below.
with my current codes. i only able to see the received file at the client folder when the file is received fully
Please advise any changes needed. thanks
byte[] bytes = new byte[65536];
                File file = new File("test.txt");
                FileInputStream bis = new FileInputStream(file);
                BufferedInputStream in = new BufferedInputStream(bis);
                OutputStream out = connection.getOutputStream();
                DataOutputStream dout = new DataOutputStream(out);
                //now send the length (as a simple long)
                long numToSend = file.length();
                //now send the file contents
                long numSent = 0;
                while(numSent < numToSend) {
                   long numThisTime = numToSend - numSent;
                   numThisTime = numThisTime < bytes.length ? numThisTime : bytes.length;
                   int numRead = in.read(bytes, 0, (int) numThisTime);
                   if(numRead ==-1 ) break;
                   numSent += numRead;

Open in new window

Free Tool: SSL Checker

Scans your site and returns information about your SSL implementation and certificate. Helpful for debugging and validating your SSL configuration.

One of a set of tools we are providing to everyone as a way of saying thank you for being a part of the community.


Author Comment

ID: 35065313
any amends to my codes is needed??
LVL 92

Expert Comment

ID: 35065693
not sure what you need.

Author Comment

ID: 35065726
i am sorry.
what i am trying to ask is how to i send and receive file in chunks using a server and client architecture. and what do i have to take note of especially for the server side which is send data and the client side which is to receive data.
as you mentioned, for the send data portion, do the server have to send data in chunks too in order for the client to receive the data in chunks? or what should be done?
LVL 92

Expert Comment

ID: 35065874
first step would be to design the protocol used by the client and server to communicate. Not much point writing any code until you decide how the two are going to communicate.

Author Comment

ID: 35066122
the protocol is udp
LVL 92

Accepted Solution

objects earned 2000 total points
ID: 35066377
I meant the application protocol that the client and server will use when communicating.

heres an example od a simple udp client server setup.

Featured Post

Free Tool: IP Lookup

Get more info about an IP address or domain name, such as organization, abuse contacts and geolocation.

One of a set of tools we are providing to everyone as a way of saying thank you for being a part of the community.

Question has a verified solution.

Are you are experiencing a similar issue? Get a personalized answer when you ask a related question.

Have a better answer? Share it in a comment.

Join & Write a Comment

By the end of 1980s, object oriented programming using languages like C++, Simula69 and ObjectPascal gained momentum. It looked like programmers finally found the perfect language. C++ successfully combined the object oriented principles of Simula w…
A discussion about automated testing of Web Applications utilizing Selenium, along with illustrated configuration steps for the Jenkins open source tool.
Viewers will learn about basic arrays, how to declare them, and how to use them. Introduction and definition: Declare an array and cover the syntax of declaring them: Initialize every index in the created array: Example/Features of a basic arr…
This video teaches viewers about errors in exception handling.

590 members asked questions and received personalized solutions in the past 7 days.

Join the community of 500,000 technology professionals and ask your questions.

Join & Ask a Question