How can I enable google-like search in my application (on the Internet or in the console). I need only those pages that need to be rescan, which are updated after a certain date.
The LastModified header in System.Net.WebResponse provides only the current server date. For example, if I load one page with HTTPWebRequest on January 27, 2012 and check the header for the LastModified date, it shows the current server time when the page was submitted. In this case, it is only January 27, 2012.
Can anyone suggest any other methods?
-, , , , , , ( ). , , , Content-Length . , , .
-, , Last-Modified , , .
Last-Modified
, -, , , , , Google - ( Google ). Google / -. : Google -, , 10 , Google , 10 , . , , , , Google, .
- (), , (), ( , Google). , , , , , , , . , :
, - (, ), . , , - , .