arian/anubis-mirror
1
0
Fork 0
mirror of https://github.com/TecharoHQ/anubis.git synced 2026-04-11 02:58:49 +00:00
Code Issues Packages Projects Releases Wiki Activity
335 Commits 190 Branches 41 Tags
c48029b48e3a70f6eba5abd09c4d7cb3a06f8aa2
Commit Graph

5 Commits

Author SHA1 Message Date
Jason Cameron
c48029b48e fix: update example URL in usage instructions for robots2policy CLI 2025-06-13 13:44:05 -04:00
Jason Cameron
d1947cadd2 test: add comprehensive tests for robots2policy conversion and parsing 2025-06-13 13:40:49 -04:00
Jason Cameron
714496e317 feat: add various robots.txt and YAML configurations for user agent handling and crawl delays 2025-06-13 13:40:49 -04:00
Jason Cameron
5a85cd41a2 feat: implement crawl delay handling as weight adjustment in Anubis rules 2025-06-13 13:40:48 -04:00
Jason Cameron
9ad2d42b9f feat: add robots2policy CLI utility to convert robots.txt to Anubis challenge policies 2025-06-13 13:40:48 -04:00