anti-crawling

Krawl is a customizable, lightweight, cloud-native web deception server and anti-crawler that creates fake web applications with low-hanging vulnerabilities using realistic, randomly generated decoy data and AI-generated HTML templates.

知乎内容爬虫 | Web scraper for Zhihu content extraction

Protect sensitive information aganist unwanted web bots

PHP library to block unwanted crawlers, scrapers and bad bots by User-Agent, IP block lists and allow lists. No captcha, works on any PHP site. Self hosted alternative to Cloudflare.

Anubis for Caddy web server

This package helps administrators of Forgejo (or Git hosting platforms) generate clear, actionable anti-crawling measures by analyzing user-provided text inputs. When given a description of suspicious

大众点评数据爬取与分析 | Dianping web scraper and data analyzer

🛡️ Strengthen your Forgejo setup with effective anti-crawling measures and prioritize safety with tailored technical fixes for suspicious bot activity.

裁判文书网爬取

A TagHelper to hide sensitive contents (like email addresses) in order to keep them from being accessed by malicious bots.