Secure Site API Determine if the site has adult, fraudulent, or malicious content.

Question

Is there an API to determine if a site is secure?

Safe site is:

1. Malicious software not hosted
2. No sign of fraud or fraud.
3. No adult or gambling content.

Some web services exist, such as Mcafee SiteAdvisor and Trend Micro Site Safety Center. I don't know if there is a good API or Python library for this purpose?

Answer 1

The Google Safe Browser API permits parts 1 and 2: https://developers.google.com/safe-browsing/

I'm not sure what can be used to filter adult content. Google images have filtering: you can check if the image from the site is blocked using a secure search.

Edit: To find out if a domain has adult content, enter it in the Google Image Search: site: domain.com safe = active

you can do this with safe deactivation, and if the difference in results exceeds a certain threshold (i.e. 10%), you can say that the site has adult content.

Edit 2: You may be able to check the meta tag and description tags (not all sites have them). They may have some dead prizes (keywords like “porn” or “sex”, etc.).

Answer 2

Take a look at Web Trust Trust

Since this question is marked as "python": I have never heard of any python shell for my API. It would be pretty easy to write your own.

Answer 3

To deal with malware and phishing scams, you can try connecting to the Google Safe Browsing API .

The “signs” of fraud are becoming a bit more complex, and this is obviously quite subjective; I do not know of any services that provide an updated list of such sites or APIs for checking the site (and the first one will probably win anyway!).

Regarding adult content, there are some useful links in this answer: How to determine if the URL contains adult or illegal content?

Answer 4

for the malicious, there is a website that can crawl the website, and it's free:

http://vscan.novirusthanks.org/

also http://iseclab.org provides many services that are very useful for security scanning.

and my personal opinion for adult content, I would use regular expression to check a few keywords, to know and distort images that crawl on the site, provide images and check their contents using regular expression

Answer 5

To discover adult content, the SimilarWeb API accesses their adult classification mechanism. On-the-fly classification is done at the domain level and is based on their categorization, methods and similarities on websites.

API Link: https://developer.similarweb.com/

Disclosure, Im affiliated SimilarGroup, creator of SimilarWeb.

Answer 6

also check the following urls, online checker is free

http://www.siteprice.org/AdultWebsiteChecker.aspx as well as http://www.siteprice.org/api/

Answer 7

I had the same problem as a couple of months ago, and I found http://www.urlvoid.com/

It uses several URL checks:

• Spamhausdbl
• Mywot
• Malwaredomainlist
• Malc0de
• Tracker ZeuS
• SpyEye Tracker
• Phishtank
• Scumware
• GoogleSafeBrowsing
• Surbl
• URLVir
• Threatlog
• urlQuery
• Malwarepatrol
• hpHosts
• Drweb
• DNS-BH
• BrowserDefender
• Bitdefender
• Avira
• AVGThreatLabs
• DShield
• Quttera
• Spam404
• Sucuri
• z_protect
• CRDF
• Fortinet
• Openphish
• Cert-gib

I use it with curl script. It works very well. if you use it, do not forget to click (using curl) the "Refresh" button before getting a reputation. if the website does not use cache history.

Answer 8

I would also try:

http://virustotal.com and (has an API)

http://sitecheck.sucuri.net (also has an API)

thanks,