[Okta Webinar] Learn how to a build a cloud-first strategyRegister Now


High frequency event handling in VB.NET

Posted on 2009-02-09
Medium Priority
Last Modified: 2012-05-06
I'm working with a market data feed API in VB.NET.  API is written is written in C#.

This API calls a method in one of my classes to signal when an event such as a price tick or a trade arrives on a TCP socket.  This can happen upwards of 10,000 times per second.  After the event comes in, the data is converted from a byte stream into data structures and the data structures are used in a pricing model.

Each event can take a couple ms to process, so multi-threading is probably necessary.  If events are not processed in time, they queue up, but this is extremely undesirable, so we want to process events without them backing up.

I wanted to gather your thoughts on the do's and don't of processing this many events.  For example, should I use the ThreadPool.QueueWorkItem or should I build my own threadpool?

Has anyone used ThreadPool.QueueWorkItem for so many small work items?

If I build my own threadpool, the approach that makes sense is to create a wrapper for the thread, and suspend the thread.  When an event arrives, put the data into the wrapper and call resume() to make the thread process the event.  Once the processing is complete, do another suspend() because once a thread dies, it cannot be restarted.

If I build my own threadpool, what is the overhead of doing suspend/resume so frequently?  What have been your experiences with having many threads going on and off at the same time?

Thanks in advance
Question by:sevzas

Accepted Solution

vigylant earned 1500 total points
ID: 23598437
Suspend/Resume is deprecated. If you want your thread to wait, try using Threading.EventWaitHandle or something similar.

If you keep the thread running all the time (Which is the whole point of using EventWaitHandle), there is very little overhead, probably not noticeable.

As a queue, you could simply use System.Collections.Queue.
At my Q6600 CPU, it could dequeue about 10 million items in 120ms, which apparently is more than you need, so it should work.

In this code, they will however queue up, and you mentioned this was undesireable, so i dont know if this code is goign to help you, but here goes :)

Make one class of this, and use Add(obj) to enqueue an item.
Public Class TCPQueue
    Dim WH As New Threading.EventWaitHandle(False, Threading.EventResetMode.ManualReset)
    Dim Q As New System.Collections.Queue
    Public Sub New()
        Dim T As New Threading.Thread(AddressOf Worker)
    End Sub
    Public Sub Add(ByVal obj As Object)
    End Sub
    Private Sub Worker()
            Do While Queue.Synchronized(Q).Count > 0
                Dim obj As Object = Queue.Synchronized(Q).Dequeue
                'Process here
    End Sub
End Class

Open in new window


Author Comment

ID: 23611116
vigylant: Thanks for the code.  It's nice that you showed me how to use a waithandle.  This is a very helpful class.

I can probably deploy an array of these queues to process the events.

I'm still curious whether it would be just as effective to throw all of these events into the ThreadGroup that the CLR makes available to me.  Does anyone have experience with ThreadGroup ?

Featured Post

Technology Partners: We Want Your Opinion!

We value your feedback.

Take our survey and automatically be enter to win anyone of the following:
Yeti Cooler, Amazon eGift Card, and Movie eGift Card!

Question has a verified solution.

If you are experiencing a similar issue, please ask a related question

The article shows the basic steps of integrating an HTML theme template into an ASP.NET MVC project
High user turnover can cause old/redundant user data to consume valuable space. UserResourceCleanup was developed to address this by automatically deleting user folders when the user account is deleted.
As developers, we are not limited to the functions provided by the VBA language. In addition, we can call the functions that are part of the Windows operating system. These functions are part of the Windows API (Application Programming Interface). U…
Show developers how to use a criteria form to limit the data that appears on an Access report. It is a common requirement that users can specify the criteria for a report at runtime. The easiest way to accomplish this is using a criteria form that a…
Suggested Courses
Course of the Month19 days, 22 hours left to enroll

873 members asked questions and received personalized solutions in the past 7 days.

Join the community of 500,000 technology professionals and ask your questions.

Join & Ask a Question