Solved

how to send data in chunks from server and client in java

Posted on 2011-03-07
9
1,150 Views
Last Modified: 2013-11-23
if the file i request is too large, the client need to wait very long. what does to be modify from my code in order to receive the data in chunks.
e.g. transmit 100MB into 10MB each chunk in order for me to process
int len=0;
        byte [] mybytearray  = new byte [buffer];
        InputStream is = connection.getInputStream();
        FileOutputStream fos = new FileOutputStream("default.amc");
        BufferedOutputStream bos = new BufferedOutputStream(fos);

 while((len=is.read(mybytearray)) > 0)
        {
        	bos.write(mybytearray,0,len);
        	current+=len;
        	
        }
        
         bos.flush();
         long end = System.currentTimeMillis();
         System.out.println(end-start);
         System.out.println(current);
         bos.close();

Open in new window

0
Comment
Question by:jackson_duffy
  • 5
  • 4
9 Comments
 
LVL 92

Expert Comment

by:objects
ID: 35054550
To support sending data in chunks would also require modifying the client to support receive the data in chunks
Changes to the server would be to support specifying the start byte and the number of bytes to send.


>  while((len=is.read(mybytearray)) > 0)

btw, that should be:

 while((len=is.read(mybytearray)) >= 0)
0
 
LVL 92

Expert Comment

by:objects
ID: 35054598
0
 

Author Comment

by:jackson_duffy
ID: 35054693
my server side codes are shown below.
with my current codes. i only able to see the received file at the client folder when the file is received fully
Please advise any changes needed. thanks
byte[] bytes = new byte[65536];
                File file = new File("test.txt");
                FileInputStream bis = new FileInputStream(file);
                BufferedInputStream in = new BufferedInputStream(bis);
                OutputStream out = connection.getOutputStream();
                
                DataOutputStream dout = new DataOutputStream(out);
                dout.writeUTF(message);
                //now send the length (as a simple long)
                long numToSend = file.length();
                dout.writeLong(numToSend);
                //now send the file contents
                long numSent = 0;
                while(numSent < numToSend) {
                   long numThisTime = numToSend - numSent;
                   numThisTime = numThisTime < bytes.length ? numThisTime : bytes.length;
                   int numRead = in.read(bytes, 0, (int) numThisTime);
                   if(numRead ==-1 ) break;
                   dout.write(bytes,0,numRead);
                   numSent += numRead;
                }
                out.flush();
                out.close();
                connection.close();

Open in new window

0
 

Author Comment

by:jackson_duffy
ID: 35065313
any amends to my codes is needed??
0
Is Your Active Directory as Secure as You Think?

More than 75% of all records are compromised because of the loss or theft of a privileged credential. Experts have been exploring Active Directory infrastructure to identify key threats and establish best practices for keeping data safe. Attend this month’s webinar to learn more.

 
LVL 92

Expert Comment

by:objects
ID: 35065693
not sure what you need.
0
 

Author Comment

by:jackson_duffy
ID: 35065726
i am sorry.
what i am trying to ask is how to i send and receive file in chunks using a server and client architecture. and what do i have to take note of especially for the server side which is send data and the client side which is to receive data.
as you mentioned, for the send data portion, do the server have to send data in chunks too in order for the client to receive the data in chunks? or what should be done?
0
 
LVL 92

Expert Comment

by:objects
ID: 35065874
first step would be to design the protocol used by the client and server to communicate. Not much point writing any code until you decide how the two are going to communicate.
0
 

Author Comment

by:jackson_duffy
ID: 35066122
the protocol is udp
0
 
LVL 92

Accepted Solution

by:
objects earned 500 total points
ID: 35066377
I meant the application protocol that the client and server will use when communicating.

heres an example od a simple udp client server setup.
http://systembash.com/content/a-simple-java-udp-server-and-udp-client/
0

Featured Post

Is Your Active Directory as Secure as You Think?

More than 75% of all records are compromised because of the loss or theft of a privileged credential. Experts have been exploring Active Directory infrastructure to identify key threats and establish best practices for keeping data safe. Attend this month’s webinar to learn more.

Question has a verified solution.

If you are experiencing a similar issue, please ask a related question

For customizing the look of your lightweight component and making it look opaque like it was made of plastic.  This tip assumes your component to be of rectangular shape and completely opaque.   (CODE)
Introduction This article is the first of three articles that explain why and how the Experts Exchange QA Team does test automation for our web site. This article explains our test automation goals. Then rationale is given for the tools we use to a…
This tutorial covers a practical example of lazy loading technique and early loading technique in a Singleton Design Pattern.
This theoretical tutorial explains exceptions, reasons for exceptions, different categories of exception and exception hierarchy.

947 members asked questions and received personalized solutions in the past 7 days.

Join the community of 500,000 technology professionals and ask your questions.

Join & Ask a Question

Need Help in Real-Time?

Connect with top rated Experts

23 Experts available now in Live!

Get 1:1 Help Now