arian/anubis-mirror
1
0
Fork 0
mirror of https://github.com/TecharoHQ/anubis.git synced 2026-04-20 07:06:40 +00:00
Code Issues Packages Projects Releases Wiki Activity

Add IP mapped Perplexity user agents (#1393)

Browse Source 
Perplexity has some proper documentation available for their crawlers,
with published IP addresses: https://docs.perplexity.ai/guides/bots.

Signed-off-by: Timon de Groot <timon.degroot@team.blue>
This commit is contained in:
Timon de Groot
2026-01-16 01:57:31 +01:00
committed by GitHub
parent 186ffeb744
commit 57c0b2b22c
6 changed files with 36 additions and 4 deletions
Download Patch File Download Diff File Expand all files Collapse all files
data/crawlers/ai-search.yaml
+1 -1
View File
@@ -4,5 +4,5 @@
# - Claude-SearchBot: No published IP allowlist
- name: "ai-crawlers-search"
user_agent_regex: >-
OAI-SearchBot|Claude-SearchBot
OAI-SearchBot|Claude-SearchBot|PerplexityBot
action: DENY