Geek Answers Handbook

How to check if urllib2 matches redirection?

I wrote this function:

def download_mp3(url,name):
        opener1 = urllib2.build_opener()
        page1 = opener1.open(url)
        mp3 = page1.read()
        filename = name+'.mp3'
        fout = open(filename, 'wb')
        fout.write(mp3)
        fout.close()

This function takes the URL and name as a string. Then it will download and save mp3 from the url with the name of the variable name.

The url is in the form http: //site/download.php? id = xxxx , where xxxx is the mp3 identifier

If this identifier does not exist, the site redirects me to another page.

So the question is: how can I check if this identifier exists? I tried to check if url exists with such function:

def checkUrl(url):
    p = urlparse(url)
    conn = httplib.HTTPConnection(p.netloc)
    conn.request('HEAD', p.path)
    resp = conn.getresponse()
    return resp.status < 400

But it seems unworkable.

thank

+5
source share
2 answers

Something like this and a verification code:

import urllib2, urllib

class NoRedirectHandler(urllib2.HTTPRedirectHandler):
    def http_error_302(self, req, fp, code, msg, headers):
        infourl = urllib.addinfourl(fp, headers, req.get_full_url())
        infourl.status = code
        infourl.code = code
        return infourl
    http_error_300 = http_error_302
    http_error_301 = http_error_302
    http_error_303 = http_error_302
    http_error_307 = http_error_302

opener = urllib2.build_opener(NoRedirectHandler())
urllib2.install_opener(opener)
response = urllib2.urlopen('http://google.com')
if response.code in (300, 301, 302, 303, 307):
    print('redirect')
+5

req = urllib2.Request(url)
try:
   response = urllib2.urlopen(url)
except urllib2.HTTPError as e:
   # Do something about it
   raise HoustonWeHaveAProblem
else:
   if response.url != url:
       print 'We have redirected!'
+1

More articles:


All Articles