About kleerer-bot.
kleerer-bot is the crawler behind our supplement price & label transparency data. Once a day it visits a fixed list of public product pages to record the price, availability and ingredient list โ that's all.
It identifies itself honestly (User-Agent: kleerer-bot), respects robots.txt, waits several seconds between requests to the same site, never logs in, never accesses private data, and never bypasses technical protections. The list of tracked pages and the crawler's full source code are public in our repository.
Site owner and want something changed or excluded? Write to hello@kleerer.com and we'll act on it quickly.