Using direct HTTP headers

Question

On the website, I enter some parameters in the form, click on the search, and then I get a page with the message "getting results". Upon completion of the search, I get another page with the results displayed.

I am trying to recreate this programmatically, and I used HTTP HTTP headers to get an idea of ​​what is going on ie the url, form variables, etc. However, I get information about what is happening on the page, which shows "getting your results." Live HTTP Header does not give me information up to the page that contains the final results.

What can I do to get this last bit of information (i.e. url, form variables, etc.)

Answer 1

I use Charles HTTP Proxy for all my HTTP troubleshooting problems. It has many options and works with any browser.

Answer 2

Web Developer does the following:

https://addons.mozilla.org/en-US/firefox/addon/60

Answer 3

@ Mark Harrison

I have installed webdeveloper. I originally used it to turn off meta redirects and sources to get a clearer picture of http interactions. But when I do this, the website is down (i.e., it cannot complete the search process for my search results), so I turned it on.

I am wondering if anyone needs to capture http information for a site that has a data processing page between the user input page and the results page

Answer 4

It sounds strange? I am sure that LiveHttpHeaders should show this. Can you double check that you are missing something? Otherwise, try Firebug. It has a tab for the "network" in which all completed requests are displayed.

Answer 5

I use Fiddler2 , which is a free (like in beer), highly customizable proxy; works with all browsers, allows you to check the title / edit / auto-modification on request / response.

Disclaimer: I am in no way affiliated with Fiddler, just a (very happy) user.

Answer 6

I for such tasks, Ethereal or a similar network espionage tool is always launched to see exactly what is happening.

Answer 7

The document creates a browser component called XMLHTTPRequest for a send event that is called by the send () method, while the server waits for a response, the html element is replaced with a “wait message” for a successful response, the callback is called with new html elements, and then inserted into the selected html element. (This is called ajax).

If you want to follow this process, you can use the Firefox Live HTTP Headers Extension , or Wireshark to view full HTTP headers and actions (get / post /).