SaveWiseBot
SaveWiseBot reads public product pages of Indian stores so shoppers can compare the same product across stores. This page says what it fetches, how often, and how to stop it.
User agent
SaveWiseBot/0.1 (+https://35-234-213-113.sslip.io/bot)
What it fetches
- robots.txt, checked for every URL and cached for 24 hours.
- Sitemaps you publish for crawlers, to find product pages.
- Product pages, and Shopify product JSON where a store offers it.
It never fetches site search, logged-in pages, carts or checkout, never solves CAPTCHAs, never spoofs headers and never uses proxies.
How often
- One request at a time per site, at least 5 seconds apart, with random jitter. Never two crawls of one site in parallel.
- A product page is re-read at most every 6 hours; most pages far less often.
- After a 403, a 429 or a challenge page it backs off that site for an hour.
What we keep and show
- Facts only: price, MRP, stock, rating numbers, specifications and model codes.
- Descriptions stay internal. Product images are shown from your own image URL, never copied to our servers, and removed on request.
- Every price on SaveWise shows your store name, when it was checked and links to your page.