Solved

Websocket through haproxy reused connection causes "Not a valid frame" error.

Posted on 2016-10-16
4
86 Views
Last Modified: 2016-10-17
Hello Experts.

    Websocket-client connects to websocket-server through haproxy.
    Sometimes transmission works, sometimes not.
    Websocket-client is based on python2.6/site-packages/websocket_client-0.7.0-py2.6.egg/websocket.py
    Websocket-server based on c++ library.
    Haproxy version is 1.5.x

    As you can see, websocket client reuses connection when python-script is reentered.
    Note, if not to reuse the connection, there are no errors.

    How get rid of this error?
    #must we put here something to "flush" the "mysterios" ws "buffer"? ( See this comment in script )

    Script, error-trace, haproxy.cfg and log are attached.

Thank you.
script-and-error.txt
haproxy-cfg-and-log.txt
0
Comment
Question by:Bitlab
  • 2
  • 2
4 Comments
 
LVL 33

Expert Comment

by:sarabande
ID: 41846960
   Note, if not to reuse the connection, there are no errors.
if so, can you try to always close an existing connection properly and then use a new connection?

reusing a connection which might not be terminated properly or is still used by someone, always makes trouble and it is difficult to impossible to handle this.

Sara
0
 
LVL 2

Author Comment

by:Bitlab
ID: 41846993
Thanks.
"reusing a connection which might not be terminated properly or is still used by someone" -
this kills a speed which is a purpose of keeping connection alive.

and how can it be terminated non-properly?
and who else can use the connection? the socket open between client, haproxy, and a server: there is no middle man
0
 
LVL 33

Accepted Solution

by:
sarabande earned 500 total points
ID: 41847055
how can it be terminated non-properly?
there are two sides, client and server, and their tcp subsystems which were running asynchronously:
if one side disconnects, the other side needs to be informed to close the connection as well. it wouldn't get knowledge of the termination automatically but only if it tries to read or write. note, i don't know what libraries you were using. some of them may solve the those issues properly for you. some will not. and if someone blocks the connection - say because not all data sent are read from other, it is impossible to reuse it. note, shutdown will not immediately terminate, since tcp always will try to have a graceful closing process.

who else can use the connection? the socket open between client, haproxy, and a server: there is no middle man
isn't the haproxy a load-balancer? if so, it manages multiple connections to multiple servers, right? i wonder that you are  allowed to 'reuse' a connection when using haproxy.

this kills a speed which is a purpose of keeping connection alive.
did you measure it? you easily can keep connections alive if your clients were using an own service for handling the connection. if one connection is used always by the same client, you could use an own thread which keeps the connection alive. if you do so, you never need to reuse but only use the one and ever alive connection managed by the thread.

actually, i never have written code which tried to reuse a connection since there are always better concepts that would go without.

Sara
0
 
LVL 2

Author Comment

by:Bitlab
ID: 41847168
Thank you, Sara.

Apparently your solution works: I increased timeouts to:

    timeout client          2400s
    timeout server          2400s

and there are no more errors. It may happen on the boundary of 2400, but at least I know now where to troubleshoot.  It looks so simple now.

"if you do so, you never need to reuse but only use the one and ever alive connection managed by the thread. "  I meant this when spoke about "reusing". I meant just checking that socket i is alive by

if ws == None:

means that connection is not closed.

Thanks a lot again.
0

Featured Post

PRTG Network Monitor: Intuitive Network Monitoring

Network Monitoring is essential to ensure that computer systems and network devices are running. Use PRTG to monitor LANs, servers, websites, applications and devices, bandwidth, virtual environments, remote systems, IoT, and many more. PRTG is easy to set up & use.

Question has a verified solution.

If you are experiencing a similar issue, please ask a related question

Suggested Solutions

Dictionaries contain key:value pairs. Which means a collection of tuples with an attribute name and an assigned value to it. The semicolon present in between each key and values and attribute with values are delimited with a comma.  In python we can…
Periodically we have to update or add SSL certificates for customers. Depending upon your hosting plan you may be responsible for the installation and/or key generation. In the wake of Heartbleed many sites were forced to re-key. We will concen…
The goal of the video will be to teach the user the difference and consequence of passing data by value vs passing data by reference in C++. An example of passing data by value as well as an example of passing data by reference will be be given. Bot…
The viewer will learn how to clear a vector as well as how to detect empty vectors in C++.

770 members asked questions and received personalized solutions in the past 7 days.

Join the community of 500,000 technology professionals and ask your questions.

Join & Ask a Question