Commit Graph

136 Commits

Author SHA1 Message Date
Kevin Fenzi
a754144f19 Update infra pagure.io links to forge.fp.o (WIP)
This should update all the references we have to
https://pagure.io/fedora-infrastructure to the
new https://forge.fedoraproject.org/infra/tickets/ area.

Do not merge this before the migration on tuesday.

Signed-off-by: Kevin Fenzi <kevin@scrye.com>
2026-01-20 14:39:40 -08:00
Kevin Fenzi
443cac3cb1 varnish: remove commented block from 11 years ago
I can't recall why we disabled this at the time, but it's been disabled
for 11 years, so the likelyhood of us needing it now is low.

So, lets just delete it.

See https://pagure.io/fedora-infrastructure/issue/13002 for discussion.

Signed-off-by: Kevin Fenzi <kevin@scrye.com>
2026-01-12 12:50:31 -08:00
Adam Williamson
d7fbddc338 varnish: drop kerneltest
It was moved to openshift in 2024 (see e.g. 0e5f679). Dropped
from haproxy config in 55056c6.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2025-12-26 19:39:02 +00:00
Adam Williamson
8801582e01 varnish: drop blockerbugs
Moved to openshift in 2022 (see e.g. ab4db44) and was dropped from
the haproxy config in 55056c6, nothing listens on 10022 on the
proxies these days.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2025-12-26 19:39:02 +00:00
Adam Williamson
3ef38feb21 varnish: remove askbot
See cb22afd (removed ask config in 2018). It's been gone since
then. Nothing listens on 10021 on the proxies.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2025-12-26 19:39:02 +00:00
Adam Williamson
4f6c6f7460 varnish: remove packages
See 5413a21 (noting it was moved to openshift in 2020) and
55056c6 (removed it from haproxy config).

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2025-12-26 19:39:02 +00:00
Adam Williamson
bee72cf44d varnish: drop bodhi
Was moved to openshift long ago. All of these URLs are now just
302s to bodhi.fedoraproject.org in the httpd config. Nothing
listens on port 10009 on the proxies.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2025-12-26 19:39:02 +00:00
Adam Williamson
13eeea6d6a varnish: drop mirrormanager (not mirrorlists)
Was moved to openshift. Was dropped from haproxy config in
55056c6, but not from varnish.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2025-12-26 19:39:02 +00:00
Adam Williamson
ae1dfd09d2 Drop fas backend from varnish config
I'm pretty sure this is a vestige of FAS2. 'fas01' resolves on
*most* proxies, but to an IP address that doesn't exist. On
proxy01.stg (but not proxy02.stg for some reason?) it does not
resolve at all, and this causes varnish to fail to start up.
Let's just get rid of it.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2025-12-23 23:26:50 -08:00
Kevin Fenzi
22a321a6a1 Revert "kojipkgs / varnish: cache also ostree repo objects dir listings"
This reverts commit 267cbc3c74.

Perhaps this needs some more work to match these requests.
2025-12-15 18:14:39 -08:00
Kevin Fenzi
267cbc3c74 kojipkgs / varnish: cache also ostree repo objects dir listings
Signed-off-by: Kevin Fenzi <kevin@scrye.com>
2025-12-15 18:03:50 -08:00
Kevin Fenzi
b61fef52f4 varnish: also cache ttf files
These fonts are kind of hit a lot, no need to send to the pkgs01 backend
for them, we can just cache them in varnish for clients.

Signed-off-by: Kevin Fenzi <kevin@scrye.com>
2025-12-06 10:10:35 -08:00
Kevin Fenzi
6730ba02a6 proxies / varnish / src: do not try and cache large archive files
This seems to cause a problem for some super large archives,
as seen in https://pagure.io/fedora-infrastructure/issue/12930

So, lets just tell varnish not to cache these sorts of archive
files and just pass them through.

Signed-off-by: Kevin Fenzi <kevin@scrye.com>
2025-11-22 11:31:06 -08:00
Kevin Fenzi
fe549b1c82 proxies / varnish: try and avoid caching *crate files
This seems to mess up downloading crates from fedpkg-minimal/fedpkg.
See https://pagure.io/fedora-infrastructure/issue/12812

Signed-off-by: Kevin Fenzi <kevin@scrye.com>
2025-11-21 08:54:29 -08:00
Kevin Fenzi
41e260526d proxies / varnish / src: also cache /static/
Signed-off-by: Kevin Fenzi <kevin@scrye.com>
2025-11-16 12:40:20 -08:00
Kevin Fenzi
56fd203ece proxies / varnish / src: unset the pagure cookie on reply from themes or static content
Signed-off-by: Kevin Fenzi <kevin@scrye.com>
2025-11-16 12:34:26 -08:00
Kevin Fenzi
f1483f1f39 proxies / varnish / src: also cache all static theme
Signed-off-by: Kevin Fenzi <kevin@scrye.com>
2025-11-16 11:32:04 -08:00
Kevin Fenzi
64229b15f2 proxies / varnish: drop cookies for static files so varnish will cache them
varnish won't cache things with cookies (as they might be dependent on
those). So, lets drop cookies for static files that dont care about
that.

Signed-off-by: Kevin Fenzi <kevin@scrye.com>
2025-11-16 11:23:36 -08:00
Kevin Fenzi
46f9bcb797 src: try putting src behind varnish in staging.
The scrapers are now downloading js and css files at a really high rate,
and thats causing a lot of load on pkgs01.

So, lets see if we can just move src behind the varnish on proxies.
This should allow it to return those pretty static files a lot
faster and not cause load on the backend.

However, putting varnish in the path might mess up something, so
lets just test in staging first.

Signed-off-by: Kevin Fenzi <kevin@scrye.com>
2025-11-16 10:05:33 -08:00
Kevin Fenzi
5c4d62ca23 kojipkgs: cache /compose/iot
Currently we are not caching anything under /compose/ in varnish.
This was desired in case there was some change that got cached when
there were updates.

However, we are hitting an issue currently where clients are requesting
large amounts of "/compose/iot/repo/objects/ABC/" directory listings.
These directories have nearly 65k entries in them and when apache has
to stat 65k files to get attributes it takes a long time.
Sometimes they seem to just get stuck because there are so many.

Caching this tree should allow varnish to cache things and prevent
high load issues.

Signed-off-by: Kevin Fenzi <kevin@scrye.com>
2025-11-14 08:49:44 -08:00
Nils Philippsen
6c85fda0c9 Mass remove/replace iad2 -> rdu3, 10.3. -> 10.16.
Signed-off-by: Nils Philippsen <nils@redhat.com>
2025-07-03 20:05:02 +02:00
Kevin Fenzi
895f72aa43 kojipkgs: adjust varnish for rdu3
Signed-off-by: Kevin Fenzi <kevin@scrye.com>
2025-07-03 05:39:20 -07:00
Kevin Fenzi
e987aa7267 s390kojipkgs: increase timeout
This was done in trying to get caching more stable for s390x builds.
Pushing it now to match the deployed state.

Signed-off-by: Kevin Fenzi <kevin@scrye.com>
2025-03-19 13:47:07 -07:00
Kevin Fenzi
b50b776cb5 varnish / s390x cache: move to memory based instead of disk
This was done last week to help out with builds that were failing
due to s390x cache issues. Moving to memory based seems to have
helped this stop happening, possibly along with other changes.

I'm pushing it now because it reflects the current state
after outages last week.

Signed-off-by: Kevin Fenzi <kevin@scrye.com>
2025-03-12 14:21:43 -07:00
Michal Konecny
2ec055db6f Use first uppercase letter for all handlers
This will unify all the handlers to use first uppercase letter for
ansible-lint to stop complaining.

I went through all `notify:` occurrences and fixed them by running
```
set TEXT "text_to_replace"; set REPLACEMENT "replacement_text"; git grep
-rlz "$TEXT" . | xargs -0 sed -i "s/$TEXT/$REPLACEMENT/g"
```

Then I went through all the changes and removed the ones that wasn't
expected to be changed.

Fixes https://pagure.io/fedora-infrastructure/issue/12391

Signed-off-by: Michal Konecny <mkonecny@redhat.com>
2025-02-10 20:31:49 +00:00
Ryan Lerch
47c68f478d ansiblelint fixes - fqcn[action-core] - template to ansible.builtin.template
Replaces references to template: with ansible.builtin.template

Signed-off-by: Ryan Lerch <rlerch@redhat.com>
2025-01-15 11:30:29 +10:00
Ryan Lerch
25391e95b7 ansiblelint fixes - fqcn[action-core] - package to ansible.builtin.package
Replaces many references to  package: with ansible.builtin.package

Signed-off-by: Ryan Lerch <rlerch@redhat.com>
2025-01-15 11:28:00 +10:00
Ryan Lerch
691adee6ee Fix name[casing] ansible-lint issues
fix 1900 failures of the following case issue:

`name[casing]: All names should start with an uppercase letter.`

Signed-off-by: Ryan Lerch <rlerch@redhat.com>
2025-01-14 20:20:07 +10:00
Ryan Lerch
89f6f1fc32 Fix majority of remaining yamllint warnings and errors
Signed-off-by: Ryan Lerch <rlerch@redhat.com>
2024-11-28 17:31:45 +10:00
Stephen Smoogen
432a3a497b Go through and remove entries for EL6 and EL7
Using `git grep el6` and `git grep el7` and variants like EL-7 or
el-7, I found various entries and files which were no longer needed
with the current ansible. I updated text or tests to later versions of
RHEL as needed.

found entries for the fedora ami's for the original cloud and removed
those entries also.

Signed-off-by: Stephen Smoogen <ssmoogen@redhat.com>
2024-07-03 22:20:30 +00:00
Michal Konecny
80366bda57 [varnish] Fix the lists.fedoraproject.org
The lists are now returning 302 instead of 301. I forgot to change that in varnish.

Signed-off-by: Michal Konecny <mkonecny@redhat.com>
2024-06-27 16:29:22 +02:00
Kevin Fenzi
6589d38032 varnish: this should be a string comparison
Signed-off-by: Kevin Fenzi <kevin@scrye.com>
2024-05-02 15:21:55 -07:00
Kevin Fenzi
02bae04d01 varnish: try using the right syntatic sugar
Signed-off-by: Kevin Fenzi <kevin@scrye.com>
2024-05-02 15:19:47 -07:00
Michal Konecny
563eb6658a [varnish] Update the expected response for new mailman deployment
New mailman staging deployment is giving 302 as a default response instead of
301. Let's reflect that in varnish config.

Signed-off-by: Michal Konecny <mkonecny@redhat.com>
2024-04-08 14:10:22 +02:00
Kevin Fenzi
a6a82ac806 Ajdust kojipkgs and varnish to allow new s390x network
Signed-off-by: Kevin Fenzi <kevin@scrye.com>
2024-02-20 16:05:19 -08:00
Kevin Fenzi
a60ca7159f nuancier: retire and remove from ansible
See https://pagure.io/fedora-infrastructure/issue/11371
This service is retired.

Signed-off-by: Kevin Fenzi <kevin@scrye.com>
2023-11-15 10:44:00 -08:00
Pavel Raiskup
8caaee2b08 kojipkgs: repomd.xml (the small one) should never be cached
We can cache any other file in the repo, even the repository metadata.
But repomd.xml is the smallest part (glue) that needs to be always
up2date to correctly reference the actual repofiles.

Fixes: https://pagure.io/fedora-infrastructure/issue/10531
2022-02-09 18:36:49 +00:00
Kevin Fenzi
5166f80efc fedocal: remove varnish config also
Signed-off-by: Kevin Fenzi <kevin@scrye.com>
2021-06-23 12:46:40 -07:00
Pierre-Yves Chibon
2b46beed2c fedocal: drop everything related to fedocal in VM
Signed-off-by: Pierre-Yves Chibon <pingou@pingoured.fr>
2021-06-23 17:30:27 +02:00
Kevin Fenzi
5ac17bc51a varnish: adjust for f33 changes
Signed-off-by: Kevin Fenzi <kevin@scrye.com>
2020-11-10 12:20:50 -08:00
Stephen Smoogen
00cb5ef564 Put in up to date limits for the proxies so that varnish does not consume all ram 2020-07-22 09:30:27 -04:00
Stephen Smoogen
db5e633e86 move varnish ips to proxy. this doesnt fix the oom problem caused by registry 2020-07-22 08:32:37 -04:00
Stephen Smoogen
1b487b34a0 replace some hardcoded phx2 items with hardcoded iad2 items for koji, pdc, and nagios 2020-06-10 07:25:38 -04:00
Kevin Fenzi
7bbd1bd030 add iad2 networks to kojipkgs varnish config
Signed-off-by: Kevin Fenzi <kevin@scrye.com>
2020-05-27 17:50:37 -07:00
Rick Elrod
ea96618bd4 Get rid of modernpaste everywhere, redirect it to paste.centos.org everywhere
Signed-off-by: Rick Elrod <relrod@redhat.com>
2020-04-24 21:34:18 +02:00
Kevin Fenzi
bfcaa2ff94 varnish: don't specify libsemanage-python, we install it (or python3-libsemanage) in base.
Signed-off-by: Kevin Fenzi <kevin@scrye.com>
2020-04-24 21:34:15 +02:00
Mikolaj Izdebski
4155463f1c varnish: Drop Koschei backend 2020-04-24 21:34:11 +02:00
Kevin Fenzi
81fb4582e7 ansible: change when conditions to use == instead of is when checking strings.
Signed-off-by: Kevin Fenzi <kevin@scrye.com>
2020-04-24 21:34:10 +02:00
Kevin Fenzi
a562b8a3f8 ansible_distribution_version: address FIXME's/review tweaks.
download: mod_limitipconn isn't used anyone, dropped the entire line.
transient_cloud: just dropped the dnf part and use 'package' entirely.
sshd_config: UsePrivilegeSeparation isn't used in Fedora at all.
koji_hub: no fedora or rhel8 hubs yet, so just 7 is fine for now.
openvpn: changes look ok
packages3: Should get cverna to review, packages is using fedora now.
varnish: no rhel8 varnish servers yet.

Signed-off-by: Kevin Fenzi <kevin@scrye.com>
2020-04-24 21:34:10 +02:00
Karsten Hopp
c9ed62ac32 update ansible_distribution_major_version conditionals
Signed-off-by: Karsten Hopp <karsten@redhat.com>
2020-04-24 21:34:10 +02:00