Commit Graph

44430 Commits

Author SHA1 Message Date
Kevin Fenzi
ce1307f427 Revert "anubis: disable entirely on proxy110/101"
This reverts commit 1c8ff36a0f.

This won't work because it's too weak in precidence.
2025-10-13 10:31:55 -07:00
Kevin Fenzi
1c8ff36a0f anubis: disable entirely on proxy110/101
These are internal proxies, they don't need to bother running anubis at
all, since they don't get any external traffic.

Just doing this to rule out some problem with additional proxy layer
and anubis causing the timeouts we are seeing.

Signed-off-by: Kevin Fenzi <kevin@scrye.com>
2025-10-13 09:47:25 -07:00
Kevin Fenzi
ace7783530 copr_hypervisor: also set host_group
Signed-off-by: Kevin Fenzi <kevin@scrye.com>
2025-10-13 07:56:59 -07:00
Kevin Fenzi
6723e95cba copr_hypervisor: add hosts file
We need this to setup hosts for vpn in rdu3 fedora-isolated

Signed-off-by: Kevin Fenzi <kevin@scrye.com>
2025-10-13 07:45:54 -07:00
Alice Frosi
c7bcfa3801 Add access to afrosi to the fedora-coreos-pipeline
Signed-off-by: Alice Frosi <afrosi@redhat.com>
2025-10-13 12:21:21 +00:00
Ryan Lerch
6ce56fb5a9 Update config for staging forge to enable email
This also sets two other email privacy settings for both prod and stg

Signed-off-by: Ryan Lerch <rlerch@redhat.com>
2025-10-13 22:14:10 +10:00
Ryan Lerch
244a7fbf17 Set APP_NAME to 'Fedora Forge' in Forgejo config
Resolves: https://codeberg.org/fedora/forgejo-deployment/issues/225
2025-10-13 11:57:58 +10:00
Kevin Fenzi
d861b438cc proxies / src: enable anubis to prevent outage
Signed-off-by: Kevin Fenzi <kevin@scrye.com>
2025-10-12 17:39:41 -07:00
Jiri Kyjovsky
ecebfd4753 copr: switch dist-git to fedora-infra default anubis role 2025-10-12 20:02:04 +00:00
Pavel Raiskup
fbb355425a copr-be: whitespace fix 2025-10-12 09:34:51 +02:00
Pavel Raiskup
ab0dc78638 copr-be: high-performance ppc64le builders for rathann
Relates: https://github.com/fedora-copr/copr/issues/3944
2025-10-12 09:34:05 +02:00
Pavel Raiskup
79e47c7018 vmhost-p09-copr01: experiment with nftables
Relates: https://github.com/fedora-copr/copr/issues/3945
This reverts commit 0a3fc8d4a1.
2025-10-12 09:08:03 +02:00
Kevin Fenzi
bc878b56ba vmhost-p09-copr03: fix mac address copypasta
Signed-off-by: Kevin Fenzi <kevin@scrye.com>
2025-10-11 14:34:30 -07:00
Kevin Fenzi
87d350504a haproxy: retry failed connections to pkgs01/src
This seems to be a similar case to the kojipkgs one, where we see from
time to time timeouts from proxies to pkgs01.

If it's a health check, haproxy will mark the backend down.
If it's a user request they will get a timeout and a 503 back.

This will help mitigate the second problem and retry those.

Signed-off-by: Kevin Fenzi <kevin@scrye.com>
2025-10-11 01:20:49 +00:00
Kevin Fenzi
b5cbcb0536 vmhost-p09-copr02/03/04: add 3 power9 machines in rdu3 for copr
This adds 3 power9 machines in the new 'fedora-isolated' vlan
in rdu3. This is the vlan thats going to house the moved rdu2-cc
hardware in rdu3. We already moved these 3 machines from iad2
so we can use them to try out the new vlan and acls and such.

This adds host vars for the 3 new machines (mac address, ips, etc)
It adds them to the copr_hypervisor group in inventory
It adds their mgmt to dhcpd config so they get known ip's for
their mgmt interfaces instead of dynamic ones.
It adds a 8 disk ppc64le kickstart to install them with.

It also fixes the dhcpd config for the bvmhost-p09-01-stg mgmt
interface, it's off by one.

Signed-off-by: Kevin Fenzi <kevin@scrye.com>
2025-10-10 19:05:37 +00:00
Kevin Fenzi
a8628c6934 src / staging: re-enable anubis on src.stg
We want to reenable this so we can test solutions to
https://pagure.io/fedora-infrastructure/issue/12812

Signed-off-by: Kevin Fenzi <kevin@scrye.com>
2025-10-10 10:45:24 -07:00
Pavel Raiskup
0a3fc8d4a1 p09 host no longer works with nftables
Revert "vmhost-p09-copr01: try to go with nftables"

This reverts commit c1f51e0f32.
2025-10-10 12:25:01 +02:00
Pavel Raiskup
331c64b76f copr-be: the enable-swap service has been renamed
2895ed83b9
2025-10-09 12:15:30 +02:00
Pavel Raiskup
57cf017758 copr: high-perf builders for ppc64le @kernel-vanilla projects 2025-10-09 10:26:54 +02:00
Kevin Fenzi
46fd68d504 proxies / haproxy: setup some retry for kojipkgs
We are having problems with connections sometimes hanging from proxies
to kojipkgs. Lets try and mitigate that at the haproxy level and
hopefully improve things while we try and figure out what the underlying
cause is.

This should retry connections that failed for any 'retryable' output
(including timeout) and also it should try a _different_ backend than
the one that returned the error. This will not eliminate errors, but
should reduce them.

Signed-off-by: Kevin Fenzi <kevin@scrye.com>
2025-10-08 13:39:38 -07:00
Kevin Fenzi
fd53786d35 f43 final freeze
Signed-off-by: Kevin Fenzi <kevin@scrye.com>
2025-10-07 17:55:46 -07:00
Kevin Fenzi
ea19684eba handlers: add missing restart rsyslog handler
Signed-off-by: Kevin Fenzi <kevin@scrye.com>
2025-10-07 15:10:42 -07:00
Greg Sutcliffe
69645f5da5 HAProxy/Rsyslog: fix logging to the rsyslog UDP port that haproxy expects
Signed-off-by: Greg Sutcliffe <fedora@emeraldreverie.org>
2025-10-07 21:21:02 +00:00
Greg Sutcliffe
9b38df0550 Certs: Use renewed *.fedorapeople.org cert
Signed-off-by: Greg Sutcliffe <fedora@emeraldreverie.org>
2025-10-07 22:00:26 +01:00
Aashish Radhakrishnan
a54e3fb728 Remove user gallen from the pipeline users list
The testing of JMS-Messaging plugin is done, we can now remove gallen
from the list of users

Ref: https://github.com/coreos/fedora-coreos-pipeline/issues/1181
2025-10-07 12:37:58 -07:00
Samyak Jain
1952af5713 F43 final freeze is under process
Signed-off-by: Samyak Jain <samyak.jn11@gmail.com>
2025-10-07 14:18:31 +00:00
Greg Sutcliffe
bfedcf64b7 Zabbix: Hostgroups seem to work, enabling for prod too
Signed-off-by: Greg Sutcliffe <fedora@emeraldreverie.org>
2025-10-07 12:34:57 +01:00
Greg Sutcliffe
3d70d99b96 Zabbix: (staging) Try out defining *all* hostgroups as per Nagios
Signed-off-by: Greg Sutcliffe <fedora@emeraldreverie.org>
2025-10-07 12:30:44 +01:00
Aurélien Bompard
825afa22f1 Remove unused OSCI pipelines queues in RabbitMQ
See: https://pagure.io/fedora-infrastructure/issue/12810

Signed-off-by: Aurélien Bompard <aurelien@bompard.org>
2025-10-07 12:38:37 +02:00
James Antill
12cc938618 kojipkgs: Add rsyncd role for transfering log files. issue#12833
Signed-off-by: James Antill <james@and.org>
2025-10-06 16:13:02 -04:00
James Antill
6f7a1f12de log01: Add /usr/local/bin to combineHttpLogs PATH. issue#12833
Signed-off-by: James Antill <james@and.org>
2025-10-06 15:53:18 -04:00
James Antill
26b373d066 bastion: Fix empty package-owner entries. issue#12834
Signed-off-by: James Antill <james@and.org>
2025-10-06 15:49:03 -04:00
James Antill
d5c0412c7b updates-uptimes: Tiny fix for showing dates in host-u.
Signed-off-by: James Antill <james@and.org>
2025-10-06 15:45:23 -04:00
Anton Medvedev
5c7984f0f8 Revert "ref: this it part of releng repository refactoring, which affects logger scripts used in this config fedora-messaging-logger"
This reverts commit 099cfd03ca.
2025-10-06 16:15:11 +00:00
Anton Medvedev
6a825eb3d5 ref: part of releng repo refactory affecting critpath.py
Signed-off-by: Anton Medvedev <amedvede@redhat.com>
2025-10-06 16:15:11 +00:00
Anton Medvedev
68d298720c ref: this it part of releng repository refactoring, which affects logger scripts used in this config fedora-messaging-logger
Signed-off-by: Anton Medvedev <amedvede@redhat.com>
2025-10-06 16:15:11 +00:00
Anton Medvedev
728d6959ce ref: part of releng repo refactory affecting ftbfs_weekly_reminder.py
Signed-off-by: Anton Medvedev <amedvede@redhat.com>
2025-10-06 16:15:11 +00:00
Anton Medvedev
8a26675cb4 ref: part of releng repo refactory affecting get_retired_packages.sh
Signed-off-by: Anton Medvedev <amedvede@redhat.com>
2025-10-06 16:15:11 +00:00
Anton Medvedev
63476e7fc3 ref: part of releng repo refactory affecting sig_policy.py
Signed-off-by: Anton Medvedev <amedvede@redhat.com>
2025-10-06 16:15:10 +00:00
Kevin Fenzi
271598a0b6 virthost: collectd is not available in epel10 yet
Signed-off-by: Kevin Fenzi <kevin@scrye.com>
2025-10-06 08:21:48 -07:00
Pavel Raiskup
1f1bf582b4 copr-be-dev: pre-allocate one (normal) aarch64 machine
Fixes: https://github.com/fedora-copr/copr/issues/3865
2025-10-06 15:33:30 +02:00
David Kirwan
3cda3377ee forgejo: update with prod/stg quay image and tag variables
Signed-off-by: David Kirwan <davidkirwanirl@gmail.com>
2025-10-06 13:48:01 +01:00
Greg Sutcliffe
3fe44802f6 Zabbix: Add ping-only non-Ansible hosts
We have a bunch of hosts that don't run Ansible or aren't reachable,
such as builders or OpenShift workers. These are currently defined in
group_vars/nagios:rdu3_management_hosts.

This commit replicates the function for Zabbix, defining hosts with
ping-only checks as part of the server role.

I'm not *super happy* about how I've included this, but I'm putting it
on an refactor todo list along with some other things - this works for
now.

Signed-off-by: Greg Sutcliffe <fedora@emeraldreverie.org>
2025-10-06 13:40:47 +01:00
Kevin Fenzi
cafb5514e8 bodhi: increasing warning threshold for queue
Signed-off-by: Kevin Fenzi <kevin@scrye.com>
2025-10-05 13:04:34 -07:00
Kevin Fenzi
34f41fe5f4 ipatura: enable nagios_client
Signed-off-by: Kevin Fenzi <kevin@scrye.com>
2025-10-04 16:47:59 -07:00
Greg Sutcliffe
f565c59e45 Zabbix: Increase disk thresholds for copr hypervisors
Signed-off-by: Greg Sutcliffe <fedora@emeraldreverie.org>
2025-10-03 16:01:03 +01:00
Aurélien Bompard
fdfddc6e1f First of a probably long line of fixes to the ipa-tuura playbook
Signed-off-by: Aurélien Bompard <aurelien@bompard.org>
2025-10-03 15:15:59 +02:00
Aurélien Bompard
991a0a81eb Add the new VM for IPA-tuura
Signed-off-by: Aurélien Bompard <aurelien@bompard.org>
2025-10-03 14:50:34 +02:00
Greg Sutcliffe
e30e0e2114 Zabbix: Rework how PSKs are defined in Ansible
The "file+env_suffix" is a problem when dealing with hosts like
pagure-stg01 that actually exists in prod. We can't override env_suffix
without breaking many things.

Instead, the PSKs are now defined directly in the private vars, instead
of in a file, and the variable name is then read from inventory vars.
This means we can override it for a group/host.

Signed-off-by: Greg Sutcliffe <fedora@emeraldreverie.org>
2025-10-03 13:27:05 +01:00
David Kirwan
42f295d968 forgejo: update cronjob for db prune job
Signed-off-by: David Kirwan <davidkirwanirl@gmail.com>
2025-10-03 13:17:16 +01:00