mirror of
https://github.com/TecharoHQ/anubis.git
synced 2026-04-05 16:28:17 +00:00
57c0b2b22c
Perplexity has some proper documentation available for their crawlers, with published IP addresses: https://docs.perplexity.ai/guides/bots. Signed-off-by: Timon de Groot <timon.degroot@team.blue>
9 lines
405 B
YAML
9 lines
405 B
YAML
# Permits all well documented AI/LLM user agents with published IP allowlists.
|
|
- import: (data)/bots/ai-catchall.yaml
|
|
- import: (data)/crawlers/openai-searchbot.yaml
|
|
- import: (data)/crawlers/openai-gptbot.yaml
|
|
- import: (data)/crawlers/perplexitybot.yaml
|
|
- import: (data)/clients/openai-chatgpt-user.yaml
|
|
- import: (data)/clients/mistral-mistralai-user.yaml
|
|
- import: (data)/clients/perplexity-user.yaml
|