viberank

What is viberank?

Directory/review crawler for AI agent products. Agent crawlers browse the web on a user's behalf inside AI tools: opening pages, reading documentation, and completing tasks. Traffic arrives from engaged users who asked for exactly what you offer. Blocking agents does not protect content from training, but it does cut off this kind of high-intent visit.

Allowing it keeps your site reachable to AI agents acting for users — an emerging traffic channel worth keeping open.

Does viberank respect robots.txt?

Yes. viberank honors robots.txt directives, including wildcard rules and Allow lines. A Disallow rule for this crawler is respected — but remember robots.txt is a voluntary protocol across the whole industry, not a wall.

How to block viberank

Add this group to your robots.txt to deny viberank across your whole site:

User-agent: viberank
Disallow: /

Blocking it stops agent-driven visits but provides no real content protection, since agents only fetch pages the user asked for.

How to allow viberank

viberank is allowed by default on every site. It only gets blocked if a matching rule exists — most often a global User-agent: * group with Disallow: /. To exempt it while blocking other bots, put an empty Disallow group for it before the global block:

User-agent: viberank
Disallow:

User-agent: *
Disallow: /