WarlockFish/fedora-infra_ansible
1
0
Fork 0
mirror of https://pagure.io/fedora-infra/ansible.git synced 2026-03-30 08:50:55 +08:00
Code Issues Packages Projects Releases Wiki Activity
41,284 Commits 9 Branches 0 Tags
969bbfcf2a2d3198661cde7107bf74eae72ddbe2
Commit Graph

24960 Commits

Author SHA1 Message Date
Stephen Smoogen
969bbfcf2a Add blockers to dl.fedoraproject.org 
Looked at logs of servers being hit by the 'non-responsive' bots and
the following were hit heavily every day multiple times a day:

100006 nagios.fedoraproject.org-access.log
102150 koschei.fedoraproject.org-access.log
162296 lists.fedoraproject.org-access.log
495776 fedoraproject.org-access.log
850471 dl.fedoraproject.org-access.log

Added bloks to dl.fedoraproject to try and lower its hit rate. Others
need review from people who know their internals more.

Signed-off-by: Stephen Smoogen <ssmoogen@redhat.com>
 2024-07-09 09:18:56 +00:00
Stephen Smoogen
7e426dbf37 Add more spiders which do not seem to honour robots.txt 
I went through the last couple of logs afer the first round of 'turn
off the spiders' went out. I looked at the areas which the /robots.txt
disregard and then looked for the bots which ignored it and still
looked up stuff in 'accounts'. This may cut down CPU spikes as these
are looking at dynamic data which can 'blow' things up.

It might be good to add similar tooling to pagure and src since they
seem to be hit a lot in the logs also.

Signed-off-by: Stephen Smoogen <ssmoogen@redhat.com>
 2024-07-09 09:18:56 +00:00
Aurélien Bompard
377e83fdd1 Fixup 
Signed-off-by: Aurélien Bompard <aurelien@bompard.org>
 2024-07-09 11:06:50 +02:00
Aurélien Bompard
f931febe61 Mirrormanager: adapt to the new version of generate-worldmap 
Signed-off-by: Aurélien Bompard <aurelien@bompard.org>
 2024-07-09 10:33:32 +02:00
Aurélien Bompard
3b680accf3 Poddlers: fix cron job 
Signed-off-by: Aurélien Bompard <aurelien@bompard.org>
 2024-07-08 11:35:31 +02:00
Carl George
61053600c3 mirrormanager: update EPEL regexes for EPEL 10 
Previously these regexes only matched a single digit for EPEL paths.
This changes them to match multiple digits, and also to optionally match
a minor version.
 2024-07-08 08:42:57 +00:00
Aurélien Bompard
71f07579c6 Poddlers: fixup 
Signed-off-by: Aurélien Bompard <aurelien@bompard.org>
 2024-07-08 10:29:57 +02:00
Aurélien Bompard
849bb32726 Poddlers: fixup 
Signed-off-by: Aurélien Bompard <aurelien@bompard.org>
 2024-07-06 08:43:33 +02:00
Kevin Fenzi
115c22652d bodhi / backend: remove epel8-next sync too 
Signed-off-by: Kevin Fenzi <kevin@scrye.com>
 2024-07-05 18:30:16 -07:00
Kevin Fenzi
e41d2924e1 people: adjust quota per issue 12034 
Signed-off-by: Kevin Fenzi <kevin@scrye.com>
 2024-07-05 08:32:34 -07:00
Aurélien Bompard
2d36b630a5 Poddlers: fixup 
Signed-off-by: Aurélien Bompard <aurelien@bompard.org>
 2024-07-05 07:15:55 +02:00
Aurélien Bompard
a41e381f10 Poddlers: rebase on Fedora 
Signed-off-by: Aurélien Bompard <aurelien@bompard.org>
 2024-07-05 00:19:56 +02:00
Aurélien Bompard
950331cd6d Poddlers: fixup 
Signed-off-by: Aurélien Bompard <aurelien@bompard.org>
 2024-07-05 00:16:05 +02:00
Aurélien Bompard
936e3be0c1 Poddlers: fixup 
Signed-off-by: Aurélien Bompard <aurelien@bompard.org>
 2024-07-05 00:12:24 +02:00
Aurélien Bompard
6924ce63c7 Poddlers: fixup 
Signed-off-by: Aurélien Bompard <aurelien@bompard.org>
 2024-07-05 00:08:38 +02:00
Aurélien Bompard
322067e1b2 Poddlers: build from an image that has devel dependencies 
Signed-off-by: Aurélien Bompard <aurelien@bompard.org>
 2024-07-05 00:05:27 +02:00
Aurélien Bompard
ad7b61b213 Poddlers: fixup 
Signed-off-by: Aurélien Bompard <aurelien@bompard.org>
 2024-07-04 23:55:07 +02:00
Aurélien Bompard
a9964d904f Poddlers: fixup 
Signed-off-by: Aurélien Bompard <aurelien@bompard.org>
 2024-07-04 23:43:29 +02:00
Aurélien Bompard
495c3dd76c Poddlers: fixup 
Signed-off-by: Aurélien Bompard <aurelien@bompard.org>
 2024-07-04 23:39:56 +02:00
Aurélien Bompard
a31f9b530e Poddlers: try again 
Signed-off-by: Aurélien Bompard <aurelien@bompard.org>
 2024-07-04 23:34:52 +02:00
Aurélien Bompard
c36422f522 Poddlers: try to give the template file access to the loop variable 
Signed-off-by: Aurélien Bompard <aurelien@bompard.org>
 2024-07-04 23:23:20 +02:00
Aurélien Bompard
8337130d4c Poddlers: fixup 
Signed-off-by: Aurélien Bompard <aurelien@bompard.org>
 2024-07-04 23:05:54 +02:00
Aurélien Bompard
3504a173a9 Poddlers: fixup 
Signed-off-by: Aurélien Bompard <aurelien@bompard.org>
 2024-07-04 23:01:52 +02:00
Aurélien Bompard
b8f1abaf5b Poddlers: fixup 
Signed-off-by: Aurélien Bompard <aurelien@bompard.org>
 2024-07-04 22:44:23 +02:00
Aurélien Bompard
f78d45c472 Poddlers: fixup 
Signed-off-by: Aurélien Bompard <aurelien@bompard.org>
 2024-07-04 22:38:21 +02:00
Aurélien Bompard
8b815abbe0 Poddlers: fixup 
Signed-off-by: Aurélien Bompard <aurelien@bompard.org>
 2024-07-04 22:35:13 +02:00
Aurélien Bompard
ca9eab0f53 Poddlers: fixup 
Signed-off-by: Aurélien Bompard <aurelien@bompard.org>
 2024-07-04 21:54:55 +02:00
Aurélien Bompard
d7e9cc0aa2 Toddlers is not hosted on Github 
Signed-off-by: Aurélien Bompard <aurelien@bompard.org>
 2024-07-04 18:27:23 +02:00
Aurélien Bompard
5313c40b50 Early try of poddlers 
Signed-off-by: Aurélien Bompard <aurelien@bompard.org>
 2024-07-04 17:00:08 +02:00
Michal Konecny
bebc73c9e3 [mailman3] Fix the syntax error 
ansible-playbook is complaining about missing quotes.

Signed-off-by: Michal Konecny <mkonecny@redhat.com>
 2024-07-04 09:46:49 +02:00
Michal Konecny
9892b05601 [mailman3] Fix yamllint error 
Signed-off-by: Michal Konecny <mkonecny@redhat.com>
 2024-07-04 09:35:42 +02:00
Michal Konecny
2c4f7c6968 [mailman3] Improve the gunicorn setup 
Use the recommended CPU*2+1 amount of workers and limit max requests done. After
that the gunicorn reloads itself and free up all the memory.

Signed-off-by: Michal Konecny <mkonecny@redhat.com>
 2024-07-04 09:27:46 +02:00
Aurélien Bompard
0f7426448b Bugzilla2Fedmsg: Add FAJSON URL in the config 
Signed-off-by: Aurélien Bompard <aurelien@bompard.org>
 2024-07-04 08:00:18 +02:00
Aurélien Bompard
9d431a0b0b Badges: fetch all branches from origin before checking out the staging branch 
Signed-off-by: Aurélien Bompard <aurelien@bompard.org>
 2024-07-04 07:46:31 +02:00
Aurélien Bompard
fb60871402 Bugzilla2Fedmsg: deploy keytab 
Signed-off-by: Aurélien Bompard <aurelien@bompard.org>
 2024-07-04 07:46:31 +02:00
Kevin Fenzi
7bfb291a9a s3-mirror: drop this role as it's no longer used 
Signed-off-by: Kevin Fenzi <kevin@scrye.com>
 2024-07-03 15:22:57 -07:00
Stephen Smoogen
432a3a497b Go through and remove entries for EL6 and EL7 
Using `git grep el6` and `git grep el7` and variants like EL-7 or
el-7, I found various entries and files which were no longer needed
with the current ansible. I updated text or tests to later versions of
RHEL as needed.

found entries for the fedora ami's for the original cloud and removed
those entries also.

Signed-off-by: Stephen Smoogen <ssmoogen@redhat.com>
 2024-07-03 22:20:30 +00:00
Kevin Fenzi
5a371a1049 mirrormanager: redirect mirrors.fedoraproject.org to new mirrormanager 
The mirrormanager application moved over to
mirrormanager.fedoraproject.org from
admin.fedoraproject.org/mirrormanager. So we need to change this
redirect to point things to the new place.

Signed-off-by: Kevin Fenzi <kevin@scrye.com>
 2024-07-03 14:22:14 -07:00
Michal Konecny
315f303956 [mailman] Remove the mailman role from ansible repository 
The mailman is no longer running and the new one is deployed by new mailman3
role. Let's do some cleaning.

Signed-off-by: Michal Konecny <mkonecny@redhat.com>
 2024-07-03 20:53:37 +00:00
Kevin Fenzi
35902dad8b mailman: lets try 9 workers 
Signed-off-by: Kevin Fenzi <kevin@scrye.com>
 2024-07-03 13:46:36 -07:00
Kevin Fenzi
d11f9c5ced epel7 retirement 
Drop epel7 all the places in ansible where it is and makes sense.

Signed-off-by: Kevin Fenzi <kevin@scrye.com>
 2024-07-03 20:00:59 +00:00
roseline
0000a57684 Fedora Ready Team 2024-07-03 19:40:58 +00:00
Kevin Fenzi
95a5a8b6ae mailman: try 15 gunicorn workers 
Signed-off-by: Kevin Fenzi <kevin@scrye.com>
 2024-07-03 12:36:48 -07:00
Kevin Fenzi
8707b2799d mailman: fix missing } 
Signed-off-by: Kevin Fenzi <kevin@scrye.com>
 2024-07-03 12:35:49 -07:00
Stephen Smoogen
4937c5be2a Attempt to stop various spiders which do not follow rules. 
The ByteSpider and ClaudeBot do not follow robots.txt so need to be
dealt with in other ways.

Signed-off-by: Stephen Smoogen <ssmoogen@redhat.com>
 2024-07-03 17:18:06 +00:00
Kevin Fenzi
6c2f16eb9a src: adjust robots.txt and fix formatting 
Signed-off-by: Kevin Fenzi <kevin@scrye.com>
 2024-07-03 10:00:01 -07:00
Kevin Fenzi
2140cf2080 mailman: adjust the right robots.txt and fix formatting 
Signed-off-by: Kevin Fenzi <kevin@scrye.com>
 2024-07-03 09:58:18 -07:00
Kevin Fenzi
536e0a71b0 mailman: try adding crawl-delay to robots.txt 
Signed-off-by: Kevin Fenzi <kevin@scrye.com>
 2024-07-03 09:29:22 -07:00
Jeremy Cline
471599c785 fedora-image-uploader: Publish AMQP messages for published Azure images 
This enables publishing messages whenever we upload an Azure image.
 2024-07-03 11:52:56 +00:00
Michal Konecny
61cb8fd515 [mailman3] Add correct permissions to fedora-messaging certificates 
The mailman user needs to have access to fedora-messaging certificates to send
messages.

Signed-off-by: Michal Konecny <mkonecny@redhat.com>
 2024-07-02 15:54:49 +02:00