FeedwerkBot

If you found this page from an entry in your server log: here is who we are, what we do, and how to shut us out.

Identification

Every fetch we make carries this user agent:

AgentViewBot/1.0 (+https://feedwerk.co/bot)

We never impersonate GPTBot, ClaudeBot, PerplexityBot or anybody else's crawler. Whether such a bot is blocked on your site we evaluate locally against your robots.txt instead — just as accurate, and without deceiving anyone.

What the bot does

It is triggered when somebody enters a store address on our home page. It then loads publicly reachable pages of that store once as plain HTML and once in a real browser, to compare which product data is present without JavaScript execution. It fills in no forms, adds nothing to a cart, signs in nowhere, and stores no personal data from your pages.

Limits we hold ourselves to

• At most one request per second per domain
• At most 10 page fetches per check
• A 15-second limit per request, 60 seconds per check
• Images, fonts and media are never loaded during rendering
• Each domain is re-checked at most every 24 hours
• We honor your robots.txt

How to block us

Add this to your robots.txt:

User-agent: FeedwerkBot
Disallow: /

We honor it. It then shows up in the report as a finding — not as an accusation, but as a note that the same block often catches retrieval bots such as OAI-SearchBot or Claude-SearchBot too.

Contact

Questions or complaints about the bot's behavior: jpd.peters@gmail.com.