How to avoid circular bot traps in phpcrawl?

Question

How can I avoid being trapped in circular link traps when using PHP traversal?

+7

php web-crawler

Mehsan J. Dec 17 '15 at 4:20

source share

1 answer

Charles Thompson · Accepted Answer · 2015-12-17T04:24:14+0000

If you store the URL that you visited in some array, you can check to see if the URL has already been visited, and if so, do not click it again.