What you ask for is beyond the scope of most test tools when you drop the site spider feature.
This final requirement pushes you into the field of manual coding. Using the Mechanize gem, you can do all of this, but you can code a lot of site navigation.
The mechanism uses Nokogiri internally, so itβs easy to capture all the links on the page that you could store in a database that needs to be checked by another thread or some subsequent code. However, writing a spider is not difficult if you own the pages that you click, because you can be quite cruel in accessing the server and let the code run at full speed without worrying that it is forbidden to overuse the strip transmission.
source share