arian/anubis-mirror
1
0
Fork 0
mirror of https://github.com/TecharoHQ/anubis.git synced 2026-04-14 12:38:45 +00:00
Code Issues Packages Projects Releases Wiki Activity

fix(robots2policy): handle multiple user agents under one block (#925)

Browse Source
This commit is contained in:
Jason Cameron
2025-09-06 22:35:19 -04:00
committed by GitHub
parent 87c2f1e0e6
commit 82099d9e05
8 changed files with 208 additions and 58 deletions
Download Patch File Download Diff File Expand all files Collapse all files

8
cmd/robots2policy/testdata/simple.json vendored
View File

@@ -1,12 +1,12 @@
[
{
"action": "CHALLENGE",
"expression": "path.startsWith(\"/admin/\")",
"name": "robots-txt-policy-disallow-1"
"name": "robots-txt-policy-disallow-1",
"action": "CHALLENGE"
},
{
"action": "CHALLENGE",
"expression": "path.startsWith(\"/private\")",
"name": "robots-txt-policy-disallow-2"
"name": "robots-txt-policy-disallow-2",
"action": "CHALLENGE"
}
]