MapflareBot

The MapflareBot is a web crawler responsible for indexing web sites which contain news articles.

Collected information

If a page contains a news arcticle and if the content of this article can be assigned to a place, the following information are stored:

• URL to the article
• title of the article
• publishing date
• places mentioned in the article

Note: Only the titles of news articles are stored, never any parts of the content.

How to stop MapflareBot from crawling your site

Add this to your robots.txt file:

User-agent: MapflareBot
Disallow: / 

Contact

If you still have questions about MapflareBot or you think that your rules in your robots.txt are not obeyed correctly by MapflareBot, feel free to contact us.