Files
anubis-mirror/cmd/robots2policy/testdata/wildcards.robots.txt

6 lines
132 B
Plaintext

# Test wildcard patterns
User-agent: *
Disallow: /search*
Disallow: /*/private
Disallow: /file?.txt
Disallow: /admin/*?action=delete