How to keep web tracks running?

Question

I want to write my own scanner in JS. I am thinking about using a node.js solution like https://www.npmjs.com/package/js-crawler

The goal is to “crawl” every half hour - so every 10 minutes I want my crawler to retrieve data from a website.

I understand that I can write an infinite loop, for example:

var keeRunning = true; while (keepRunning) { // fetch data and process it every 10 minutes } 

This can work just fine if I have a computer all the time and I am on a website.

However, if I turn off my computer, I can imagine that it will no longer work. So, what solution should be considered to support the script all the time, even when the computer is turned off?

Answer 1

Use CronJobber to plan when you run the script (every x minutes or at a specific time, etc.) and deploy the application somewhere, so it will be hosted online on a server that never shuts down. There are many solutions where you can host your node server for free

• C9
• Heroku
• Nodejitsu