Lua web scraping
Hire lua web scraping service to run the script, and i've put it through its paces a few times now to see how well it performs.
it does get pretty laggy with a large request load, but the biggest lag came when the script crashed and we lost the event log. it does, however, do reasonably well without a lot of request load so here we go.
i've used nginx as the http server for my blog as it handles most requests fairly well and it's my favourite server by far.
i've also used a simple lua script to handle the user authentication as it was the least stressful for me so that's how i'll handle that.
the script is fairly self explanatory but for the sake of clarity i'll use a copy of the script i built a few months ago as this is a fairly basic example. if you are interested in checking out the source you can find it here. (also, you have to be logged in with your blogger credentials for this to work, sorry about that).
if you feel like going through the details of the code i've placed the code on github as well as in my original blog post.
first i've placed the nginx server files in the base directory. this is all that's required - you don't have to run anything as it does almost everything (including monitoring and caching if you decide to use that).
Top services about Lua web scraping
I will write fully automatic robot