Looking for the recommendation of a good best practice tutorial for a web scraping project?

Question

I need to do a fairly extensive project using web scraping, and I am considering using Hpricot or Beautiful Soup (i.e. Ruby or Python). Has anyone come across a tutorial that they thought was particularly good at this, which would help me launch a project on my right foot?

Answer 1

ScrAPI has a great episode of Railscasts .

Answer 2

- Python: Scrapy Mechanize. .

Answer 3

, , - , Webbots, Spiders Screen Scrapers.

: , - . , , , . , , . Theres , , , , .

, -, PHP. , , .

Answer 4

lxml BeautifulSoup. , HTML. , , BeautifulSoup, "" HTML , BeautifulSoup ( - lxml ). API BeautifulSoup, API- lxml.

Ian Blicking .

BeautifulSoup , Google App Engine - , , Python.

Answer 5

:

• http://railscasts.com/episodes/190-screen-scraping-with-nokogiri
• http://railscasts.com/episodes/191-mechanize

, , :

• http://asciicasts.com/episodes/190-screen-scraping-with-nokogiri
• http://asciicasts.com/episodes/191-mechanize

Answer 6

Ruby Scrubyt -. , , - .