Commit Graph

456 Commits

Author SHA1 Message Date
Simon de Vlieger
1e777285e6 koji: image-builder for production
Enables the `image-builder` plugin from `koji-image-builder` in the
production environment for both the koji hub, and the koji builder
(kojid).

This is based on the earlier enablement in staging where I've
succesfully tested some builds and it didn't seem to bring down all of
the staging instance.

Signed-off-by: Simon de Vlieger <supakeen@redhat.com>
2025-04-28 18:58:22 +00:00
Simon de Vlieger
9f15884401 koji: image-builder for staging
Enables the `image-builder` plugin from `koji-image-builder` in the
staging environment for both the koji hub, and the koji builder (kojid).

Signed-off-by: Simon de Vlieger <supakeen@redhat.com>
2025-04-23 23:53:51 +00:00
Kevin Fenzi
fc5425c07f koji_builder: add a iptables tag to the osbuildapi scripting
Signed-off-by: Kevin Fenzi <kevin@scrye.com>
2025-04-19 09:17:09 -07:00
Kevin Fenzi
feb1bf9a97 koji_builder: syntax tweak
Signed-off-by: Kevin Fenzi <kevin@scrye.com>
2025-04-10 17:53:26 -07:00
James Antill
6af1918415 Conditionalize osbuild*.cron based on osbuild in group_names.
Signed-off-by: James Antill <james@and.org>
2025-04-11 00:33:11 +00:00
James Antill
50d04f6e95 Remove nftables cron and disable service, when using iptables (for backout).
Signed-off-by: James Antill <james@and.org>
2025-04-11 00:33:11 +00:00
James Antill
af90bbb6c5 Nice error for osbuildapi-update-nft.sh and comment explaining issues.
Signed-off-by: James Antill <james@and.org>
2025-04-11 00:29:23 +00:00
Kevin Fenzi
5a44707cf4 koji_builder: install linux-firmware, not kernel-firmware
kernel-firmware is the old provide and it's no longer provided by newer
versions of linux-firmware. This is causing our builders to downgrade to
an older linux-firmware, then dnf-automatic just updates it the next
time to the newer one (because it's a security update).

Signed-off-by: Kevin Fenzi <kevin@scrye.com>
2025-04-01 13:54:51 -07:00
James Antill
e83b42b572 Remove iptables cron and stop/disable services, when using nftables.
Signed-off-by: James Antill <james@and.org>
2025-03-04 14:14:37 -05:00
James Antill
ca18224faa Change osbuildapi set table to the ip filter table.
Signed-off-by: James Antill <james@and.org>
2025-03-03 17:08:20 -05:00
James Antill
1c6c65844d Add new osbuildapi-update-nft.cron entries, and get it installed when nftables.
Signed-off-by: James Antill <james@and.org>
2025-03-03 21:20:30 +00:00
James Antill
b322316be5 Don't flush old osbuildapi entries in nftables land either.
Signed-off-by: James Antill <james@and.org>
2025-03-03 21:20:30 +00:00
Kevin Fenzi
de1fae51d8 osbuildapi-update: supress mention of duplicate ipts
Signed-off-by: Kevin Fenzi <kevin@scrye.com>
2025-02-14 16:58:28 -08:00
Kevin Fenzi
e7b50aaee4 osbuildapi-update: just keep adding to ipset
It seems sso.redhat.com has a 20 second time to live, so it changes
often. However, it seems to only change the pool of ips from a small
(5-10) number. So, lets just add to the set so we allow any of the ips
we have seen. The set will grow, but if the pool is small it should
stablize to have all the ips in the pool.

Signed-off-by: Kevin Fenzi <kevin@scrye.com>
2025-02-14 09:32:26 -08:00
Kevin Fenzi
487e07450f builders: drop loading containerbuild plugin, we do not use it anymore
Signed-off-by: Kevin Fenzi <kevin@scrye.com>
2025-02-11 11:14:00 -08:00
Michal Konecny
2ec055db6f Use first uppercase letter for all handlers
This will unify all the handlers to use first uppercase letter for
ansible-lint to stop complaining.

I went through all `notify:` occurrences and fixed them by running
```
set TEXT "text_to_replace"; set REPLACEMENT "replacement_text"; git grep
-rlz "$TEXT" . | xargs -0 sed -i "s/$TEXT/$REPLACEMENT/g"
```

Then I went through all the changes and removed the ones that wasn't
expected to be changed.

Fixes https://pagure.io/fedora-infrastructure/issue/12391

Signed-off-by: Michal Konecny <mkonecny@redhat.com>
2025-02-10 20:31:49 +00:00
Kevin Fenzi
8a545a7e75 buildvm-x86-riscv: fix principal for kojid
Signed-off-by: Kevin Fenzi <kevin@scrye.com>
2025-02-07 10:40:54 -08:00
Kevin Fenzi
d710450269 buildvm-x86-riscv: adjust principal for riscv secondary koji hub
Signed-off-by: Kevin Fenzi <kevin@scrye.com>
2025-02-06 16:19:31 -08:00
Kevin Fenzi
8140d863f0 koji_builder: no longer install koji-containerbuild packages
These packages were used when we were building containers in OSBS, and
since we don't do that anymore, drop installing that anywhere.

Signed-off-by: Kevin Fenzi <kevin@scrye.com>
2025-01-20 14:13:31 -08:00
Kevin Fenzi
d4523c609d koji_builder: fix another handler case
Signed-off-by: Kevin Fenzi <kevin@scrye.com>
2025-01-16 15:06:57 -08:00
James Antill
80aa4bbbc2 Initial version of iptables to nftables conversion. 2025-01-16 11:28:24 -05:00
Ryan Lerch
47c68f478d ansiblelint fixes - fqcn[action-core] - template to ansible.builtin.template
Replaces references to template: with ansible.builtin.template

Signed-off-by: Ryan Lerch <rlerch@redhat.com>
2025-01-15 11:30:29 +10:00
Ryan Lerch
25391e95b7 ansiblelint fixes - fqcn[action-core] - package to ansible.builtin.package
Replaces many references to  package: with ansible.builtin.package

Signed-off-by: Ryan Lerch <rlerch@redhat.com>
2025-01-15 11:28:00 +10:00
Ryan Lerch
6a3816dfdc ansiblelint fixes-- fqcn[action-core] - copy to ansible.builtin.copy
Replaces many references to 'copy' with ansible.builtin.copy

Signed-off-by: Ryan Lerch <rlerch@redhat.com>
2025-01-15 10:43:31 +10:00
Ryan Lerch
62952df107 ansiblelint fixes-- fqcn[action-core] - file to ansible.builtin.file
Replaces many references to  file: with ansible.builtin.file

Signed-off-by: Ryan Lerch <rlerch@redhat.com>
2025-01-15 10:41:52 +10:00
Ryan Lerch
691adee6ee Fix name[casing] ansible-lint issues
fix 1900 failures of the following case issue:

`name[casing]: All names should start with an uppercase letter.`

Signed-off-by: Ryan Lerch <rlerch@redhat.com>
2025-01-14 20:20:07 +10:00
Kevin Fenzi
82a8e8dbc9 buildvm_s390x: cleanup and add 7 new builders.
We no longer need to keep any config around from boston, so nuke that.
All the buildvm's are now kvm, so we don't need a seperate group/config
for that, so remove it.

Consolidate the variables down to buildvm_s390x group and only have ip
address for host vars.

Signed-off-by: Kevin Fenzi <kevin@scrye.com>
2024-12-10 10:50:25 -08:00
Kevin Fenzi
ccb3e81b62 koji_builder: don't try and run rngd on aarch64 either
It tries to start on aarch64, but fails.
So, only run rngd on x86_64

Signed-off-by: Kevin Fenzi <kevin@scrye.com>
2024-12-09 17:42:27 -08:00
Ryan Lerch
89f6f1fc32 Fix majority of remaining yamllint warnings and errors
Signed-off-by: Ryan Lerch <rlerch@redhat.com>
2024-11-28 17:31:45 +10:00
Kevin Fenzi
5b9d067a31 koji_builder: don't restart the old monolythic libvirtd
In Fedora libvirt switched to a collection of socket activated services
instead of a large single libvirtd service. Restarting that service
caused the socket activated ones to die and then libvirtd exited on
idle, leaving nothing handling virt connections.

So, lets stop trying to restart that and no need to notify other things
because they should idle out/restart on socket activation.

Signed-off-by: Kevin Fenzi <kevin@scrye.com>
2024-11-23 08:56:43 -08:00
Kevin Fenzi
f5089257fd koji_builder: use iptables backend for libvirt
In f41+ libvirt defaults to using nftables if both it and iptables
are installed, but it doesn't seem to work with imagefactory/oz
virt instances and our iptables setup.
So, lets revert back to iptables for now.
We can switch back if we can fix the incompatiblity, switch builders
to nftables, or stop using oz/IF

Signed-off-by: Kevin Fenzi <kevin@scrye.com>
2024-11-22 19:01:31 -08:00
Ondřej Budai
6d1c03d0eb osbuildapi-update: update the osbuildapi ipset atomically
Prior this commit, the script flushed the content of the osbuildapi
set before adding the newly resolved IP addresses into it. Even worse,
the DNS resolve for sso.redhat.com happened after the flush, so there
was no IP address for sso.redhat.com for quite some time (resolving
sso.redhat.com without caching takes 30 ms on my machine).

This commit fixes that by introducing a secondary ipset that is firstly
filled with the resolved IP addresses, and then its content is swapped
with the main set. This should hopefully reduce the likelihood of
random races.
2024-11-19 22:56:13 +00:00
Carl George
f40ad8262a koji_builder / mock site defaults: remove filelists option
An explicit provides for /usr/libexec/platform-python was added to
platform-python in RHEL 8.

https://access.redhat.com/errata/RHSA-2024:6975

This solves the original reason for needing the filelists option, so it
should be safe to remove.  This will make bootstrap chroot creation
faster for all builds, not just EPEL 8.

https://pagure.io/releng/issue/12199

Signed-off-by: Carl George <carlwgeorge@gmail.com>
2024-10-08 20:13:58 +00:00
Kevin Fenzi
e3e2cb1d93 odcs: retire service ( infra 12192 )
Time to retire ODCS. ELN is moved off and that was the last thing using
it. Thanks for all the service ODCS!

Signed-off-by: Kevin Fenzi <kevin@scrye.com>
2024-09-24 18:21:51 +00:00
Nils Philippsen
e46308a1a2 Switch to rpmautospec mock plugin in prod
Signed-off-by: Nils Philippsen <nils@redhat.com>
2024-08-16 09:49:40 +02:00
Nils Philippsen
7ce68f8a4c koji: Fix typo 🫣
Signed-off-by: Nils Philippsen <nils@redhat.com>
2024-08-15 19:41:34 +02:00
Nils Philippsen
4ac0bfac91 koji: Remove rpmautospec_builder plugin in stg
Signed-off-by: Nils Philippsen <nils@redhat.com>
2024-08-15 19:32:34 +02:00
Nils Philippsen
44876b117d koji: Also remove python3-/rpmautospec pkgs
These were only needed for the rpmautospec koji plugin.

Signed-off-by: Nils Philippsen <nils@redhat.com>
2024-08-15 19:06:01 +02:00
Nils Philippsen
d566528276 koji: Switch to rpmautospec mock plugin in staging
Signed-off-by: Nils Philippsen <nils@redhat.com>
2024-08-15 18:15:51 +02:00
Kevin Fenzi
d1c3d4496a buildhw-a64: override max tasks on aarch64 builders. See ticket 12090
Signed-off-by: Kevin Fenzi <kevin@scrye.com>
2024-07-29 14:15:21 -07:00
Kevin Fenzi
84b71edf51 koji_builder: try telling dnf to download filelists in prod
This sort of seemed to work in staging (although there is some issue
with staging koji).

So, lets try it in production. It will make all the boostrap repo regens
a little slower, but it should get epel8 back working hopefully for now.

Signed-off-by: Kevin Fenzi <kevin@scrye.com>
2024-07-13 11:04:47 -07:00
Kevin Fenzi
28d03c6145 koji_builder / staging / mock site defaults: try adding option for fileslists for epel8
lets try setting the opt to download filelists for the bootstrap chroot.
This is needed for epel8 because the deps for dnf need to resolve
/usr/libexec/platform-python and cannot due to f40 dnf not downloading
filelists by default anymore.

This will affect all bootstrap chroot creation, but it seems the
simpilest solution without changes in koji.

Signed-off-by: Kevin Fenzi <kevin@scrye.com>
2024-07-13 10:26:50 -07:00
Kevin Fenzi
c84b99223c osbs: raise a glass for it's service
This removes osbs and allmost all it's associated playbooks and files.

It served long and well, but we no longer need it.
flatpaks are building with a koji-flatpak plugin.
base/minimal/toolbox containers are building with kiwi.
We aren't building any other containers right now, and we did they could
be added to kiwi.

This is the end of an era... I look with nostolga on
ansible-ansible-openshift-ansible (a role to setup ansible on a control
host and run it from our ansible).

Good bye osbs!

Signed-off-by: Kevin Fenzi <kevin@scrye.com>
2024-03-28 12:52:07 -07:00
Kevin Fenzi
4a6cb460ca buildvm_s390x in boston: retire
We have moved over to the rdu mainframe, drop all the bos kvm hosts.

Signed-off-by: Kevin Fenzi <kevin@scrye.com>
2024-02-27 08:33:41 -08:00
Kevin Fenzi
bafa98897a kojid / koji_hub: enable kiwi plugin
We need to still setup a bug tag and target for this (which needs old
mock chroot) and a group, but this enables the plugin and allows us to
download blueprints.

Signed-off-by: Kevin Fenzi <kevin@scrye.com>
2024-02-21 13:03:10 -08:00
Kevin Fenzi
334219e706 buildvm-s390x: move rest of old zvm builders to rdu and kvm
We want to move (well, really re-install) all these over on the new lpar
in rdu. This will have much higher stats and be in general faster by
both network and cpu. Hopefully all these will replace all the old
boston ones.

We may need to break these up some more into smaller vm's if the number
isn't able to keep up ok. We can adjust after things are all working.

Signed-off-by: Kevin Fenzi <kevin@scrye.com>
2024-02-21 09:51:24 -08:00
Kevin Fenzi
7ecb1b1895 buildvm-s390: fix missing host in statement
Signed-off-by: Kevin Fenzi <kevin@scrye.com>
2024-02-20 18:33:30 -08:00
Kevin Fenzi
1c4408ebe5 buildvm-s390x-14: move to rdu and setup as new varnish cache
Lets move this vm over to rdu, and set it up as a new varnish cache.
This way we can test 01 doing builds before moving others.

Signed-off-by: Kevin Fenzi <kevin@scrye.com>
2024-02-20 17:38:34 -08:00
Kevin Fenzi
584101ce0e koji / staging: enable kiwi
First cut at enabling kiwi plugins

Signed-off-by: Kevin Fenzi <kevin@scrye.com>
2024-02-15 15:17:29 -08:00
Kevin Fenzi
456ddc8658 koji_builder: switch sleeptime back to default
Since the database is pretty happy now, lets return this to normal and
see how it does.

Signed-off-by: Kevin Fenzi <kevin@scrye.com>
2024-02-07 15:52:08 -08:00