Can we use selenium-webdriver and nokogiri together?

Question

I used Nokogiri as shown below:

 require 'nokogiri' require 'open-uri' # Get a Nokogiri::HTML::Document for the page we're interested in... doc = Nokogiri::HTML(open('http://www.google.com/search?q=sparklemotion')) 

But my bad due to company firewall maybe I get an error:

 C:/Ruby193/lib/ruby/1.9.1/net/http.rb:762:in `initialize': getaddrinfo: No such host is known. (SocketError) 

So, I thought that I would use selenium-webdriver for navigation and Nokogiri to work with the html web page source.

 require "rubygems" require "selenium-webdriver" driver = Selenium::WebDriver.for :firefox driver.get "http://www.google.com/search?q=sparklemotion" 

So, how do I transfer the contents of a web page (html) to Nokogiri ?

Please suggest me here.

Answer 1

You can get the page source from selenium-webdriver using the page_source method:

 driver.page_source 

So your script could be:

 require 'selenium-webdriver' require 'nokogiri' driver = Selenium::WebDriver.for :firefox driver.get "http://www.google.com/" doc = Nokogiri::HTML(driver.page_source) # Do whatever with nokogiri 

However, I do not know why you would like to use nokogiri instead of just selenium-webdriver.