TappieBot

TappieBot reads drink prices from shop websites for Tappie's price finder, so people can see where a beer, wine or spirit costs least and go buy it there. Every price links straight to the product on your site.

How it behaves

• It identifies itself as TappieBot/1.0 (+https://tappie.jevido.app/bot) and never pretends to be a browser.
• It follows your robots.txt: the rules for TappieBot if you set any, otherwise those for *, including Crawl-delay.
• It makes one request at a time, at least two seconds apart, once a night, starting around 03:00 (Amsterdam time).
• It reads only product pages listed in your sitemap (or your product feed), and only what's in their schema.org product data: name, brand, barcode, price and stock.
• It asks for pages it has seen before with If-None-Match and If-Modified-Since, so unchanged pages cost you a 304.
• When your site answers 429 or 503 it waits as long as Retry-After says and slows down; when it keeps answering that, or 403, it stops for the night.
• It keeps one product photo per drink, re-encoded and without its metadata, to show next to your price. It doesn't copy descriptions, and keeps only the current price, no history.

Opting out

Add this to your robots.txt and TappieBot stays away from the next crawl on:

User-agent: TappieBot
Disallow: /

Or write to hello@jevido.app: we'll stop crawling your shop and remove its prices and photos from Tappie, usually the same day.

Getting listed

Shops with a Google Shopping product feed, or schema.org product data on their pages, are easy to add. Mail us the feed's address and your shipping costs.