Go Premium for a chance to win a PS4. Enter to Win

x
  • Status: Solved
  • Priority: Medium
  • Security: Public
  • Views: 217
  • Last Modified:

Websocket through haproxy reused connection causes "Not a valid frame" error.

Hello Experts.

    Websocket-client connects to websocket-server through haproxy.
    Sometimes transmission works, sometimes not.
    Websocket-client is based on python2.6/site-packages/websocket_client-0.7.0-py2.6.egg/websocket.py
    Websocket-server based on c++ library.
    Haproxy version is 1.5.x

    As you can see, websocket client reuses connection when python-script is reentered.
    Note, if not to reuse the connection, there are no errors.

    How get rid of this error?
    #must we put here something to "flush" the "mysterios" ws "buffer"? ( See this comment in script )

    Script, error-trace, haproxy.cfg and log are attached.

Thank you.
script-and-error.txt
haproxy-cfg-and-log.txt
0
Bitlab
Asked:
Bitlab
  • 2
  • 2
1 Solution
 
sarabandeCommented:
   Note, if not to reuse the connection, there are no errors.
if so, can you try to always close an existing connection properly and then use a new connection?

reusing a connection which might not be terminated properly or is still used by someone, always makes trouble and it is difficult to impossible to handle this.

Sara
0
 
BitlabAuthor Commented:
Thanks.
"reusing a connection which might not be terminated properly or is still used by someone" -
this kills a speed which is a purpose of keeping connection alive.

and how can it be terminated non-properly?
and who else can use the connection? the socket open between client, haproxy, and a server: there is no middle man
0
 
sarabandeCommented:
how can it be terminated non-properly?
there are two sides, client and server, and their tcp subsystems which were running asynchronously:
if one side disconnects, the other side needs to be informed to close the connection as well. it wouldn't get knowledge of the termination automatically but only if it tries to read or write. note, i don't know what libraries you were using. some of them may solve the those issues properly for you. some will not. and if someone blocks the connection - say because not all data sent are read from other, it is impossible to reuse it. note, shutdown will not immediately terminate, since tcp always will try to have a graceful closing process.

who else can use the connection? the socket open between client, haproxy, and a server: there is no middle man
isn't the haproxy a load-balancer? if so, it manages multiple connections to multiple servers, right? i wonder that you are  allowed to 'reuse' a connection when using haproxy.

this kills a speed which is a purpose of keeping connection alive.
did you measure it? you easily can keep connections alive if your clients were using an own service for handling the connection. if one connection is used always by the same client, you could use an own thread which keeps the connection alive. if you do so, you never need to reuse but only use the one and ever alive connection managed by the thread.

actually, i never have written code which tried to reuse a connection since there are always better concepts that would go without.

Sara
0
 
BitlabAuthor Commented:
Thank you, Sara.

Apparently your solution works: I increased timeouts to:

    timeout client          2400s
    timeout server          2400s

and there are no more errors. It may happen on the boundary of 2400, but at least I know now where to troubleshoot.  It looks so simple now.

"if you do so, you never need to reuse but only use the one and ever alive connection managed by the thread. "  I meant this when spoke about "reusing". I meant just checking that socket i is alive by

if ws == None:

means that connection is not closed.

Thanks a lot again.
0

Featured Post

What is SQL Server and how does it work?

The purpose of this paper is to provide you background on SQL Server. It’s your self-study guide for learning fundamentals. It includes both the history of SQL and its technical basics. Concepts and definitions will form the solid foundation of your future DBA expertise.

  • 2
  • 2
Tackle projects and never again get stuck behind a technical roadblock.
Join Now