mirror of
https://pagure.io/fedora-infra/ansible.git
synced 2026-04-30 13:32:30 +08:00
The various openshift tools get hit by various crawlers and do not send a robots.txt. This seems to be due to the balancer code used to send back to the nodes. This forces the proxy robots.txt to be honored always.