Crawler/spider/script who opens all posts/pages for real?


#1

Hi,
I’m looking for a plugin/script that will open/read all of my pages/posts on frontend on my website like a real user will do it. That means a kind of crawler/spider that will open automatically all pages/posts for real.
Does such a plugin/script exists?
Thanks and regards
Roland


#2

It might be a fun thing to create even if it exists.
I would use PhantonJS ( http://phantomjs.org/ ) to do it, and it’s as simple as:

console.log('Loading a web page');
var page = require('webpage').create();
var url = 'http://phantomjs.org/';
page.open(url, function (status) {
    //Page is loaded!
    phantom.exit();
});

Find a nodejs developer and you’re all set :slight_smile: