Solved

Websocket through haproxy reused connection causes "Not a valid frame" error.

Posted on 2016-10-16
4
39 Views
Last Modified: 2016-10-17
Hello Experts.

    Websocket-client connects to websocket-server through haproxy.
    Sometimes transmission works, sometimes not.
    Websocket-client is based on python2.6/site-packages/websocket_client-0.7.0-py2.6.egg/websocket.py
    Websocket-server based on c++ library.
    Haproxy version is 1.5.x

    As you can see, websocket client reuses connection when python-script is reentered.
    Note, if not to reuse the connection, there are no errors.

    How get rid of this error?
    #must we put here something to "flush" the "mysterios" ws "buffer"? ( See this comment in script )

    Script, error-trace, haproxy.cfg and log are attached.

Thank you.
script-and-error.txt
haproxy-cfg-and-log.txt
0
Comment
Question by:Bitlab
  • 2
  • 2
4 Comments
 
LVL 32

Expert Comment

by:sarabande
Comment Utility
   Note, if not to reuse the connection, there are no errors.
if so, can you try to always close an existing connection properly and then use a new connection?

reusing a connection which might not be terminated properly or is still used by someone, always makes trouble and it is difficult to impossible to handle this.

Sara
0
 
LVL 2

Author Comment

by:Bitlab
Comment Utility
Thanks.
"reusing a connection which might not be terminated properly or is still used by someone" -
this kills a speed which is a purpose of keeping connection alive.

and how can it be terminated non-properly?
and who else can use the connection? the socket open between client, haproxy, and a server: there is no middle man
0
 
LVL 32

Accepted Solution

by:
sarabande earned 500 total points
Comment Utility
how can it be terminated non-properly?
there are two sides, client and server, and their tcp subsystems which were running asynchronously:
if one side disconnects, the other side needs to be informed to close the connection as well. it wouldn't get knowledge of the termination automatically but only if it tries to read or write. note, i don't know what libraries you were using. some of them may solve the those issues properly for you. some will not. and if someone blocks the connection - say because not all data sent are read from other, it is impossible to reuse it. note, shutdown will not immediately terminate, since tcp always will try to have a graceful closing process.

who else can use the connection? the socket open between client, haproxy, and a server: there is no middle man
isn't the haproxy a load-balancer? if so, it manages multiple connections to multiple servers, right? i wonder that you are  allowed to 'reuse' a connection when using haproxy.

this kills a speed which is a purpose of keeping connection alive.
did you measure it? you easily can keep connections alive if your clients were using an own service for handling the connection. if one connection is used always by the same client, you could use an own thread which keeps the connection alive. if you do so, you never need to reuse but only use the one and ever alive connection managed by the thread.

actually, i never have written code which tried to reuse a connection since there are always better concepts that would go without.

Sara
0
 
LVL 2

Author Comment

by:Bitlab
Comment Utility
Thank you, Sara.

Apparently your solution works: I increased timeouts to:

    timeout client          2400s
    timeout server          2400s

and there are no more errors. It may happen on the boundary of 2400, but at least I know now where to troubleshoot.  It looks so simple now.

"if you do so, you never need to reuse but only use the one and ever alive connection managed by the thread. "  I meant this when spoke about "reusing". I meant just checking that socket i is alive by

if ws == None:

means that connection is not closed.

Thanks a lot again.
0

Featured Post

Get up to 2TB FREE CLOUD per backup license!

An exclusive Black Friday offer just for Expert Exchange audience! Buy any of our top-rated backup solutions & get up to 2TB free cloud per system! Perform local & cloud backup in the same step, and restore instantly—anytime, anywhere. Grab this deal now before it disappears!

Join & Write a Comment

Suggested Solutions

A few customers have recently asked my thoughts on Password Managers.  As Security is a big part of our industry I was initially very hesitant and sceptical about giving a program all of my secret passwords.  But as I was getting asked about them mo…
Since pre-biblical times, humans have sought ways to keep secrets, and share the secrets selectively.  This article explores the ways PHP can be used to hide and encrypt information.
The viewer will be introduced to the technique of using vectors in C++. The video will cover how to define a vector, store values in the vector and retrieve data from the values stored in the vector.
The viewer will be introduced to the member functions push_back and pop_back of the vector class. The video will teach the difference between the two as well as how to use each one along with its functionality.

772 members asked questions and received personalized solutions in the past 7 days.

Join the community of 500,000 technology professionals and ask your questions.

Join & Ask a Question

Need Help in Real-Time?

Connect with top rated Experts

10 Experts available now in Live!

Get 1:1 Help Now