Python Browser Emulator with JS Support

Question

I want to get some data from the site. I usually use mechanize for such things, but now the site provides data with JS. Alas, mechanize does not support it.

What can i use instead?

Answer 1

Here are a few options:

• Selenium ( textbook )
  • For headless automation, selenium can be used in conjunction with PhantomJS
• Webkit
• Spidermonkey

Here are some sample code:

• PyQt4 + WebKit
• PyQt4 + WebKit usage example and redone with Selenium