You should always cache the page on your own server, if possible.
In general, avoid loading deleted pages unless you need to. The cost of resources is high both at yours and at your end.
A polite frequency for things like search bots is one request per second. Of course, if it's a service like google, they may be more frequent, but keep them as low as possible.
Aaron harun
source share