How to use existing Windows features to extract text from the user interface

Question

I looked around a bit and found various pieces related to this, but nothing concrete.

I need to find a way to extract user interface elements different from Spy ++ tool. I can find screen elements and their main text headings based on HWND, however third-party applications such as Firefox offer additional problems because they only have one large window to display. If anyone has any ideas on how to get the screen coordinates initially to do OCR or control the recognition of user interface elements inside, say, a webpage that I would like to hear from you.

Answer 1

If you want programmatic access to a web page, as Firefox sees, there are much better ways.

Try Watir or selenium . They are designed to test web applications, and they allow you to problem control your web browser.