You can try using an angular detector (such as Harris) to find the corners of the window, the ends and the intersection X. This makes it easy to find points in the correct configuration.
Edit (response to comment):
I assume that you can find the corner points in your image, 4 corners of the rectangle, 4 lines of the end of X and the center of X, as well as several other corners of the image due to noise or objects in the background. This simplifies the task of finding a set of 9 points in the correct configuration from a given set of points.
, A. B A. , , () A - , B - , , , . ( , FLANN), , , . , , , , .
, . ( , + X), , ( ), . , , . , , / , .