Id like to perform image processing on a video sequence (e.g. avi) on a per frame basis. Id like to achieve results of around 25 fps output with an 16/24 bit colour 320x240 input sequence. Processing would include calculating differences between frames thresholding, averaging frames, performing custom mathematical operations on a per pixel basis. All this and more for each frame of hte sequence. The goal in the end is to do this in real time by feeding a live sequence from a capture card.
Has anyone done this sort of thing before? How should I go about implementing this? (language, APIs, SDKs etc...)
Note: I tried to implement this using Java with JMF and JAI, but the results were very poor.