Processing HTML file using Python

Question

I wanted to remove all tags in the HTML file. For this, I used the python re-module. For example, consider a string <h1>Hello World!</h1>. I want to save only "Hello World!". To remove tags, I used re.sub('<.*>','',string). For obvious reasons, the result I get is an empty string (Regexp identifies the first and last angle brackets and removes everything between them). How do I solve this problem?

Answer 1

You can make the match inanimate: '<.*?>'

You also need to be careful, HTML is a tricky beast and can interfere with your regular expressions.

Answer 2

Parse the HTML with BeautifulSoup, then get only the text.

Answer 3

: http://docs.python.org/release/2.6/howto/regex.html#greedy-versus-non-greedy

off-topic: , , . , . http://lxml.de/

Answer 4

, lxml BeautifulSoup:

import lxml.html
print lxml.html.fromstring(mystring).text_content()

:

HTML: ?

HTML/XML:

Answer 5

Beautiful Soup html!

You may not need this, but you should learn how to use it. Also will help you in the future.