TechSpyBot

Web crawler operated by TechSpy.pro

What is TechSpyBot?

TechSpyBot is a web crawler that indexes publicly accessible websites to detect the technologies, tools, and software they use (such as CMS platforms, analytics, advertising tags, and e-commerce solutions). The collected data powers TechSpy.pro — a B2B technology intelligence platform used by sales and marketing teams.

Crawl behaviour

• Fetches only the root page (/) and a small number of contact-related sub-pages per domain
• Respects Crawl-delay directives in robots.txt
• Enforces a minimum 1-second gap between requests to the same domain
• Does not index page content for search — only technology signals
• Does not store personally identifiable information from page body text

How to block TechSpyBot

Add the following to your robots.txt file:

We honour Disallow rules for TechSpyBot and for User-agent: *.

Opt-out / data removal

If you would like your domain removed from the TechSpy index, or if you have questions about a specific crawl, please contact us at privacy@techspy.pro. We process removal requests within 14 business days.

Contact

For any questions about TechSpyBot: bot@techspy.pro

TechSpy.pro — Technology Intelligence for B2B Sales