after several months when the site disappeared from the search results in every major search engine, I finally figured out a possible reason.
I used WebBug to examine the server header. See Difference if the request is HEAD or GET.
HEAD Sent data:
HEAD / HTTP/1.1
Host: www.attu.it
Connection: close
Accept: */*
User-Agent: WebBug/5.0
HEAD Received data:
HTTP/1.1 403 Forbidden
Date: Tue, 10 Aug 2010 23:01:00 GMT
Server: Apache/2.2
Connection: close
Content-Type: text/html; charset=iso-8859-1
GET Sent data:
GET / HTTP/1.1
Host: www.attu.it
Connection: close
Accept: */*
User-Agent: WebBug/5.0
GET Received data:
HTTP/1.1 200 OK
Date: Tue, 10 Aug 2010 23:06:15 GMT
Server: Apache/2.2
Last-Modified: Fri, 08 Jan 2010 08:58:01 GMT
ETag: "671f91b-2d2-47ca362815840"
Accept-Ranges: bytes
Content-Length: 722
Connection: close
Content-Type: text/html
Now browsers by default send a GET request (at least that's what Firebug says). Is it possible for scanners to send a HEAD request? If so, why only this server responds 403, and other servers from other sites that I support do not?
, , , .htaccess, ( , )
AddType text/x-component .htc
UPDATE
@Ryk. FireBug Fiddler GET, 200 ( 300) . . , ( , ) -, .htaccess. .
, , - - (: www.attu.it ). ?
2
, , phpMyAdmin, .htaccess, , 403