arian/anubis-mirror
1
0
Fork 0
mirror of https://github.com/TecharoHQ/anubis.git synced 2026-06-10 22:37:59 +00:00
Code Issues Packages Projects Releases Wiki Activity
333 Commits 206 Branches 41 Tags
714496e31776f8b2953d9172cf04ee8e041e06ba
Commit Graph

3 Commits

Author SHA1 Message Date
Jason Cameron 714496e317 feat: add various robots.txt and YAML configurations for user agent handling and crawl delays 2025-06-13 13:40:49 -04:00
Jason Cameron 5a85cd41a2 feat: implement crawl delay handling as weight adjustment in Anubis rules 2025-06-13 13:40:48 -04:00
Jason Cameron 9ad2d42b9f feat: add robots2policy CLI utility to convert robots.txt to Anubis challenge policies 2025-06-13 13:40:48 -04:00