Commit Graph

130 Commits

Author SHA1 Message Date
Kevin Fenzi
6ceb3ea68b download: enable/finish anubis for other download servers
Fixed up a few things missed and caught in testing on dl01:
* need to setup subuid/subgid files for podman
* need to allow the right port for httpd to listen in selinux
* need httpd network connect to allow it to connect to anubis
* adjust worker values, we were not using prefork for a long time
so the values were just default up them a bunch.

Signed-off-by: Kevin Fenzi <kevin@scrye.com>
2026-01-22 10:16:22 -08:00
Kevin Fenzi
9717d920af anubis: rename anubis-el8 to anubis-el and see about enabling on download
Looks like the scrapers are hitting the download servers now.
So, look at setting up an anubis pod there like we did for pagure.
anubis package isn't available for epel9, so we just use the container.

Will test this with dl01 and tweak until it's working.

Signed-off-by: Kevin Fenzi <kevin@scrye.com>
2026-01-22 08:50:34 -08:00
Gregory Bartholomew
53cbfac4e6 dl.fedoraproject.org: make *-CHECKSUM files download
This is another attempt at 86696cf. Appearently the condition must be
set to "always" in order to for the header to be "persisted across
internal redirects".

Signed-off-by: Gregory Bartholomew <gregory.lee.bartholomew@gmail.com>
2026-01-21 01:00:17 +00:00
Gregory Bartholomew
86696cf807 dl.fedoraproject.org: make *-CHECKSUM files download
Signed-off-by: Gregory Bartholomew <gregory.lee.bartholomew@gmail.com>
2026-01-19 22:30:08 +00:00
Kevin Fenzi
775d046d8f proxies / download: switch to new 2025 wildcard fedoraproject.org cert
Switch from the 2024 one that expires in a bit to a new shiny one that
doesn't expire until next year.

Signed-off-by: Kevin Fenzi <kevin@scrye.com>
2025-09-25 14:50:49 -07:00
Kevin Fenzi
ff252cea44 I can't off hand think of why this would break anything, but
do let me know if you think it will.

Before we merge this, we will need to adjust things in mirrormanager to
not provide http links most likely (although I suppose the redirects
will work for http clients).

Signed-off-by: Kevin Fenzi kevin@scrye.com
2025-09-17 18:31:52 +00:00
Kevin Fenzi
c05160fede download / rsyncd logrotate: compress log weekly
Signed-off-by: Kevin Fenzi <kevin@scrye.com>
2025-07-29 16:43:59 -07:00
Kevin Fenzi
91e9a5627d httpd / botblocking: fix syntax on bot rewrite
These have to be in "s in order to do a string comparison, since
they were not, they were never matching anything. ;(

Fix them all up, and also block a few more repos on pagure that are
getting heavily crawled.

Signed-off-by: Kevin Fenzi <kevin@scrye.com>
2025-05-13 11:39:25 -07:00
Michal Konecny
2ec055db6f Use first uppercase letter for all handlers
This will unify all the handlers to use first uppercase letter for
ansible-lint to stop complaining.

I went through all `notify:` occurrences and fixed them by running
```
set TEXT "text_to_replace"; set REPLACEMENT "replacement_text"; git grep
-rlz "$TEXT" . | xargs -0 sed -i "s/$TEXT/$REPLACEMENT/g"
```

Then I went through all the changes and removed the ones that wasn't
expected to be changed.

Fixes https://pagure.io/fedora-infrastructure/issue/12391

Signed-off-by: Michal Konecny <mkonecny@redhat.com>
2025-02-10 20:31:49 +00:00
Ryan Lerch
47c68f478d ansiblelint fixes - fqcn[action-core] - template to ansible.builtin.template
Replaces references to template: with ansible.builtin.template

Signed-off-by: Ryan Lerch <rlerch@redhat.com>
2025-01-15 11:30:29 +10:00
Ryan Lerch
25391e95b7 ansiblelint fixes - fqcn[action-core] - package to ansible.builtin.package
Replaces many references to  package: with ansible.builtin.package

Signed-off-by: Ryan Lerch <rlerch@redhat.com>
2025-01-15 11:28:00 +10:00
Ryan Lerch
462176464b ansiblelint fixes-- fqcn[action-core] - command to ansible.builtin.command
Replaces many references to  command: with ansible.builtin.command

Signed-off-by: Ryan Lerch <rlerch@redhat.com>
2025-01-15 11:26:47 +10:00
Ryan Lerch
6a3816dfdc ansiblelint fixes-- fqcn[action-core] - copy to ansible.builtin.copy
Replaces many references to 'copy' with ansible.builtin.copy

Signed-off-by: Ryan Lerch <rlerch@redhat.com>
2025-01-15 10:43:31 +10:00
Ryan Lerch
62952df107 ansiblelint fixes-- fqcn[action-core] - file to ansible.builtin.file
Replaces many references to  file: with ansible.builtin.file

Signed-off-by: Ryan Lerch <rlerch@redhat.com>
2025-01-15 10:41:52 +10:00
Ryan Lerch
691adee6ee Fix name[casing] ansible-lint issues
fix 1900 failures of the following case issue:

`name[casing]: All names should start with an uppercase letter.`

Signed-off-by: Ryan Lerch <rlerch@redhat.com>
2025-01-14 20:20:07 +10:00
Ryan Lerch
89f6f1fc32 Fix majority of remaining yamllint warnings and errors
Signed-off-by: Ryan Lerch <rlerch@redhat.com>
2024-11-28 17:31:45 +10:00
Kevin Fenzi
c04dd50fbf certificates: move to new 2024 wildcard fedoraproject.org cert
The old one expires in about 57 days, but might as well just renew it
early and avoid problems later.

Signed-off-by: Kevin Fenzi <kevin@scrye.com>
2024-10-03 16:50:01 -07:00
Kevin Fenzi
e3e2cb1d93 odcs: retire service ( infra 12192 )
Time to retire ODCS. ELN is moved off and that was the last thing using
it. Thanks for all the service ODCS!

Signed-off-by: Kevin Fenzi <kevin@scrye.com>
2024-09-24 18:21:51 +00:00
Stephen Smoogen
969bbfcf2a Add blockers to dl.fedoraproject.org
Looked at logs of servers being hit by the 'non-responsive' bots and
the following were hit heavily every day multiple times a day:

100006 nagios.fedoraproject.org-access.log
102150 koschei.fedoraproject.org-access.log
162296 lists.fedoraproject.org-access.log
495776 fedoraproject.org-access.log
850471 dl.fedoraproject.org-access.log

Added bloks to dl.fedoraproject to try and lower its hit rate. Others
need review from people who know their internals more.

Signed-off-by: Stephen Smoogen <ssmoogen@redhat.com>
2024-07-09 09:18:56 +00:00
Stephen Smoogen
432a3a497b Go through and remove entries for EL6 and EL7
Using `git grep el6` and `git grep el7` and variants like EL-7 or
el-7, I found various entries and files which were no longer needed
with the current ansible. I updated text or tests to later versions of
RHEL as needed.

found entries for the fedora ami's for the original cloud and removed
those entries also.

Signed-off-by: Stephen Smoogen <ssmoogen@redhat.com>
2024-07-03 22:20:30 +00:00
Kevin Fenzi
480fbe3951 download: adjust tcp_rmem/tcp_wmem to improve downloads
See https://pagure.io/fedora-infrastructure/issue/11929
for more info. This helps out download speeds.

Signed-off-by: Kevin Fenzi <kevin@scrye.com>
2024-05-22 15:13:52 -07:00
Patrick Creech
ee4df11e44 Remove MultiViews from web configs
Signed-off-by: Patrick Creech <pcreech@redhat.com>
2023-07-20 17:23:40 -04:00
Kevin Fenzi
e0cb1c5188 download: move centos items out of /srv/pub
We had centos stream and altarches and centos linux under /srv/pub on
external download servers. However, this breaks people who sync buffet
or the like from them because they suddenly get centos content that they
want to just get directly elsewhere. So, just move these up a leave so
they are out of the buffet target and people who want them can get them
elsewhere.

Signed-off-by: Kevin Fenzi <kevin@scrye.com>
2023-07-12 15:53:43 -07:00
Kevin Fenzi
47cf07184e wildcard-2023.fedoraproject.org: new wildcard ssl cert
Signed-off-by: Kevin Fenzi <kevin@scrye.com>
2023-01-11 08:48:40 -08:00
Stephen Smoogen
95c6eea54a Add octet-stream for qcow2 on dl.fedoraproject.org 2022-06-14 12:19:48 -04:00
Kevin Fenzi
1e712cdc30 Revert "Revert "wildcard-2022.fedoraproject.org cert""
This reverts commit 4430178b29.

It's time to put this back before the cert expires and before we go into
Beta freeze. Hopefully the odd issue with armv7 qemu guests having a
time behind real time is not still happening.
2022-02-21 10:19:17 -08:00
Kevin Fenzi
4430178b29 Revert "wildcard-2022.fedoraproject.org cert"
This reverts commit 57f0d4fdb6.

For an anoying reason, armv7 image builds come up with the time as 10
days ago, which makes this cert invalid. So, move back to the old cert
for a week or so and then switch to the new one again. ;(
2022-01-31 12:39:49 -08:00
Kevin Fenzi
57f0d4fdb6 wildcard-2022.fedoraproject.org cert
This is the renewed version of the old 2020 cert.

Signed-off-by: Kevin Fenzi <kevin@scrye.com>
2022-01-27 10:37:27 -08:00
Kevin Fenzi
a6558b4b35 download: do not make a /mnt/koji/compose as it is handled by symlink later
Signed-off-by: Kevin Fenzi <kevin@scrye.com>
2021-05-18 13:56:54 -07:00
Kevin Fenzi
e0662c5f2d rsyncd / download: adjust odcs to allow package rsyncs
odcs just links to the packages in a compose on the /mnt/koji volume
with relative symlinks. ie (
../../../../../../../../mnt/koji/packages/zip/3.0/28.eln109/data/signed/9867c58f/x86_64/zip-3.0-28.eln109.x86_64.rpm
)
Change odcs on download servers to mount on /mnt like koji and then tell
rsync to chroot at /mnt, so it can follow those links and copy the file
from koji volume.

Signed-off-by: Kevin Fenzi <kevin@scrye.com>
2021-05-17 13:46:36 -07:00
Kevin Fenzi
1b3258ef49 download: mount fedora_odcs on download servers for easier internal sync
The fedora_odcs volume is available on odcs-frontend01, but it's easier
for internal people to get it via dl servers since they already get some
content there. So, we just mount it (ro) there so they can do so.

Signed-off-by: Kevin Fenzi <kevin@scrye.com>
2020-07-07 13:41:04 -07:00
Kevin Fenzi
4b7c31a882 cleanup: remove all the duplicate tests for selinux python bindings in favor of the ones in base.
Signed-off-by: Kevin Fenzi <kevin@scrye.com>
2020-05-16 10:54:58 -07:00
Stephen Smoogen
f10f66ef82 httpd: download servers fix to 408's
The Fedora download servers are experiencing a large number of 408's
every day. This is causing timeouts and breaks on yum update. I talked
with the CentOS admins and they pointed me to
https://github.com/CentOS/ansible-role-httpd/ which I shameless borrowed
some code for just the dl. box.
2020-04-30 09:57:16 +00:00
Stephen Smoogen
37915eaf25 put in patches to use wildcard2020 2020-04-24 21:34:26 +02:00
Stephen Smoogen
c80f5071c2 add directory back for downloads 2020-04-24 21:34:11 +02:00
Stephen Smoogen
ffdc193701 removing koji/compose from downloads as nothing seems to be getting packages from it 2020-04-24 21:34:07 +02:00
Kevin Fenzi
67971513c9 download-phx2: Also allow indexes for /mnt/koji/compose on phx2 download.
Signed-off-by: Kevin Fenzi <kevin@scrye.com>
2019-05-03 20:00:15 +00:00
Kevin Fenzi
b023b19fe8 download-phx2: Also serve /compose
Signed-off-by: Kevin Fenzi <kevin@scrye.com>
2019-05-03 19:50:29 +00:00
Patrick Uiterwijk
0c7449ea1d Add sslciphers tags
Signed-off-by: Patrick Uiterwijk <patrick@puiterwijk.org>
2019-04-08 21:41:17 +02:00
Sinny Kumari
419fac6c17 Necessary changes to accommodate ostree repo move from atomic/ to ostree/
Use metalink url for AH ISO creation

Signed-off-by: Sinny Kumari <sinny@redhat.com>
2019-02-07 10:46:40 +01:00
Patrick Uiterwijk
db0375b8b6 Move kojipkgs/atomic to kojipkgs/ostree
Signed-off-by: Patrick Uiterwijk <patrick@puiterwijk.org>
2019-02-06 16:00:28 +01:00
Patrick Uiterwijk
cd9adb1c40 Remove the split cloudfront instances, and switch to the combined one
Signed-off-by: Patrick Uiterwijk <patrick@puiterwijk.org>
2019-01-30 20:34:53 +01:00
Patrick Uiterwijk
acf6f6587b Remove workaround for very old ostree
Signed-off-by: Patrick Uiterwijk <patrick@puiterwijk.org>
2019-01-30 20:27:44 +01:00
Sinny Kumari
af761fda7d Add CDN testing cloudfront redirect for atomic repo
Signed-off-by: Sinny Kumari <sinny@redhat.com>
Signed-off-by: Mikolaj Izdebski <mizdebsk@redhat.com>
2019-01-04 15:35:56 +00:00
Stephen Smoogen
5700b8b2ed and you should use a variable that is already in existance versus make up your own 2018-09-18 19:14:49 +00:00
Stephen Smoogen
473f39a3c2 spaces matter 2018-09-18 18:05:06 +00:00
Stephen Smoogen
fc99885d6f and Ill get your little dog too 2018-09-18 17:59:46 +00:00
Stephen Smoogen
a92ab94c06 add items for rsync table 2018-09-18 17:58:27 +00:00
Stephen Smoogen
3ff1649a8a and we will try to get this to work 2018-07-01 23:39:54 +00:00
Kevin Fenzi
90b34f3440 pong 2018-06-15 20:06:48 +00:00