Chromatic delete / library algorithm

Question

I am working on desktop recording software that runs on Windows XP / 7. I would like to be able to remove backgrounds from the recorded video using the color keyboard.

_{(source: kudlian.net )}

Any information on such algorithms, complete libraries, open source projects? I need it to be accessible from c #, and it is desirable that it works on GPUs (CUDA, pixel shaders, ...)

My video is available in RGB24 and YUY2, so it would be great if such a library could handle these formats.

Answer 1

A good starting point is to study the solution contained in this blog. The color separation approach described there is a good basic algorithm. However, relying only on color may not be optimal, these are some situations (high movement of objects, color conflicts of clothing, etc.). If you want something very reliable, you will need to start learning the methods of edge segmentation (aka active edges).