Our crawler
Taman Mzian reads the public pages of shops with a program. This page is for the people who run a website and see its visits.
What it reads
- Catalogue and product pages, or the public data the shop publishes for them: name, price, stock, reference, address of the photo.
- Never a customer account, a basket, a search or a closed page.
How often
- One request at a time per shop, with a pause of several seconds in between.
- Two to ten passes a day depending on the shop, never continuously.
- It follows each site's
robots.txtfile, and stops at a protection against robots rather than getting around it.
Slowing it down or stopping it
Write to to complete: contact address from an address on your domain name: we can space the visits out, avoid certain hours, read a feed instead, or stop reading your site. A rule in your robots.txt is respected without you having to write to us.