Monitoring MongoDB in Munin on Ubuntu (updated)

If you try now to install Munin monitoring for MongoDB database, you’ll find in the Mongo’s documentation, a link to an repository for munin plugins. The bad thing is this repository were updated for the last time on Feburay 2012. Of course, since 2012, MongoDB evolved and this plugins were not working at all on a recent version of MongoDB (2.6+).

Principally because MongoDB now removed the auto activation of the rest server (for security reasons). Continue reading Monitoring MongoDB in Munin on Ubuntu (updated)

Scrapy : How to crawl pages from a listing page

For professional reasons, I was asked to fetch a lot of data from different webpages, so a crawler was the better way to do this. I was told about Scrapy, a good tool to do that.

My problem was that I found a lot of tutorials about Scrapy but none who were explaining step-by-step how to use it to fetch a list of links from a page, and use it to crawl information on each links. Continue reading Scrapy : How to crawl pages from a listing page