Geek Answers Handbook

Getting url page using luasocket and proxy

So far I have the following snippet:

local socket = require "socket.http"
client,r,c,h = socket.request{url = "http://example.com/", proxy="<my proxy and port here>"}
for i,v in pairs( c ) do
  print( i, v )
end

which gives me the output as below:

connection  close
content-type    text/html; charset=UTF-8
location    http://www.iana.org/domains/example/
vary    Accept-Encoding
date    Tue, 24 Apr 2012 21:43:19 GMT
last-modified   Wed, 09 Feb 2011 17:13:15 GMT
transfer-encoding   chunked
server  Apache/2.2.3 (CentOS)

which means that the connection is only excellent . Now I want to get my title url'susing this one socket.http. I searched for previous SO questions and luasocket http documentation . but I still don’t know how to get / save the whole / part of the page in a variable and do something with it.

Please, help.

+5
source share
1 answer

You use the "generic" form http.request (), which requires storing the body through the LTN12 receiver. It is not as difficult as it seems, try this code:

local socket = require "socket.http"
local ltn12 = require "ltn12"; -- LTN12 lib provided by LuaSocket

-- This table will store the body (possibly in multiple chunks):
local result_table = {};
client,r,c,h = socket.request{
    url = "http://example.com/",
    sink = ltn12.sink.table(result_table),
    proxy="<my proxy and port here>"
}
-- Join the chunks together into a string:
local result = table.concat(result_table);
-- Hacky solution to extract the title:
local title = result:match("<[Tt][Ii][Tt][Ll][Ee]>([^<]*)<");
print(title);

, http.request() - http.PROXY:

local http = require "socket.http"
http.PROXY="<my proxy and port here>"

local result = http.request("http://www.youtube.com/watch?v=_eT40eV7OiI")
local title = result:match("<[Tt][Ii][Tt][Ll][Ee]>([^<]*)<");
print(title);

:

    Flanders and Swann - A song of the weather
  - YouTube
+4

More articles:


All Articles