I currently want to deploy a website ranking API, and for that I need a web crawler. The thing is I want to keep the web crawler running 24/7 so it can continuously update the websites. However, with services like Heroku, after one hour the server stops. So all my crawling progress is gone and I have to recrawl. How do I host a Node.js script that is always alive on Heroku. If it is not possible, what else can I do?
↧