Browser Detection for Laravel by hisorange!
-
Updated
Dec 10, 2024 - PHP
#
crawler-detection
Here are 32 public repositories matching this topic...
Ruby gem to detect bots and crawlers via the user agent
-
Updated
Oct 6, 2026 - Ruby
Golang module to detect bots and crawlers via the user agent
-
Updated
Oct 2, 2026 - Go
Detect bots/crawlers/spiders using the user agent string.
-
Updated
Oct 16, 2023 - Go
Rust library to detect bots using a user-agent string
-
Updated
Jul 23, 2022 - Rust
Final project of Rahnema College internship. Crawler detection using unsupervised learning methods.
-
Updated
Jul 15, 2021 - Python
Browser Detection for Laravel.
laravel browser user-agent-parser ua-parser browser-detection bot-detection mobile-detection crawler-detection
-
Updated
Oct 6, 2026 - PHP
Laravel middleware to detect AI crawlers (GPTBot, ClaudeBot, 354+ bots), block prompt injection attacks, and prevent data scraping. Honeypot traps, PII leak detection, robots.txt enforcement, optional ML detection. Zero dependencies.
php security middleware laravel ai honeypot waf web-application-firewall bot-detection crawler-detection pii-detection prompt-injection llm-security gptbot claudebot
-
Updated
Sep 27, 2026 - PHP
PHP library to block unwanted crawlers, scrapers and bad bots by User-Agent, IP block lists and allow lists. No captcha, works on any PHP site. Self hosted alternative to Cloudflare.
web-crawler cloudflare web-scraping anti-bot bot-blocker bot-detection cleantalk bot-management user-agent-detection bad-bots crawler-detection semrush anti-crawling google-bot bot-protection anti-scraping anti-crawler scraper-protection ahrefsbot
-
Updated
Oct 6, 2026 - PHP
User-agent parsing, crawler detection and AI bot blocking for Django.
user-agent user-agent-parser robots-txt ai-bots bot-detection device-detection crawler-detection anti-scraping ai-crawlers
-
Updated
Oct 3, 2026 - Python
Classify web traffic from server log entries and header capture into human, AI agent, AI crawler, AI assistant, programmatic, and other bot categories. No analytics service or middleware required.
log-analysis user-agent web-analytics user-agent-parser access-logs bot-detection ai-agents crawler-detection traffic-classification server-logs apache-logs agentic-ai llms-txt web-bot-auth ai-crawlers llm-traffic
-
Updated
Sep 25, 2026 - TypeScript
Offline IP/CIDR/ASN intelligence resolver with provenance, freshness, and explainable infrastructure context.
infrastructure offline-first bgp geoip asn cidr network-security crawler-detection ip-intelligence geofeed security-data ip-enrichment
-
Updated
Sep 12, 2026 - Go
Reads the Nginx log you already write and says what kind of client each visitor was. No script, no cookie, no client-side tracking.
docker nginx security privacy log-analysis sqlite access-logs self-hosted bot-detection threat-intelligence no-javascript crawler-detection fastapi nginx-log-analyzer
-
Updated
Sep 19, 2026 - Python
Controlled bait for AI crawlers, agents, and RAG systems.
python cli honeypot forensics cybersecurity model-evaluation sarif security-tools ai-agents security-research defensive-security crawler-detection ai-security rag data-leakage web-crawlers canary-tokens prompt-injection llm-security rag-evaluation
-
Updated
Jun 18, 2026 - Python
Semrush Scraper — free, open-source Semrush scraper. Unlimited website traffic, keywords & backlinks as clean JSON, no API key, no proxies.
marketing web-performance bot-blocker smd broken-links gsc wordpress-seo crawler-detection semrush keyword-research competitive-analysis ahrefs cloudflare-pages open-source-seo outreach-automation generative-engine-optimization semrush-api semrush-scraper-api semrush-scraper semrush-scraping
-
Updated
Sep 28, 2026 - Python
A PHP-based application for detecting and logging bot activity on your website. This project utilizes CrawlerDetect to differentiate between human users and crawlers, storing relevant data in a MySQL database.
-
Updated
Oct 20, 2024 - PHP
Online User-Agent parser for browser, operating system, device and crawler detection.
-
Updated
Jul 10, 2026
IP intelligence and agent operations: open tools for network data (ASN, BGP, RPKI, geofeed, MMDB) and for the personal agent that runs alongside them.
geoip asn network-analysis fraud-detection threat-intelligence vpn-detection mmdb proxy-detection crawler-detection ip-intelligence
-
Updated
Sep 26, 2026 - HTML
Add this topic to your repo
To associate your repository with the crawler-detection topic, visit your repo's landing page and select "manage topics."