Adrian Reber 4d80aff5f1 The crawler logs are now on mm-crawler01

2015-06-12 16:11:00 +00:00

..

certificate

…

domainrewrite

Special-case the apache-status rewrite.

2014-12-17 18:32:02 +00:00

fingerprints

Use more https URLs where possible

2015-06-04 17:20:06 +02:00

mime-type

Whitespace.

2014-12-12 19:29:23 +00:00

mod_ssl

…

proxy

and we have ipv6

2015-03-30 20:40:48 +00:00

redirect

…

redirectmatch

…

reverseproxy

The crawler logs are now on mm-crawler01

2015-06-12 16:11:00 +00:00

templates

and we try to make listspam a little less.

2015-03-23 21:56:21 +00:00

website

Just disallow /updates. Not much point in bodhi updates being in search engines.

2015-04-23 15:01:16 +00:00