Google Bots , , . , 2015 , , .
Google /, 301, 302 .. 301, 302 . , , Google - / /, .
n, n 5, , 200 .
Google , , ( ), ( ). , . , URL- - ( ).
Google (API, Google Docs...), , Google libcurl . Libcurl 3xx.
SEO sitemap.xml, , , .
, GoogleBots , :
index.php /
, Google Bot → /en
Google Bot: ,
Google Bots .
User Agent, DNS- sollicitor, Google.
You can undo the DNS sollicitor from gethostbyaddr(), but this can slow down the boot process, or you can trust the database of IP browsers . I would recommend none of them, the User Agent control should be fine.
source
share