Commit Graph

220 Commits

Author SHA1 Message Date
Kevin Fenzi
c84b99223c osbs: raise a glass for it's service
This removes osbs and allmost all it's associated playbooks and files.

It served long and well, but we no longer need it.
flatpaks are building with a koji-flatpak plugin.
base/minimal/toolbox containers are building with kiwi.
We aren't building any other containers right now, and we did they could
be added to kiwi.

This is the end of an era... I look with nostolga on
ansible-ansible-openshift-ansible (a role to setup ansible on a control
host and run it from our ansible).

Good bye osbs!

Signed-off-by: Kevin Fenzi <kevin@scrye.com>
2024-03-28 12:52:07 -07:00
Kevin Fenzi
4a6cb460ca buildvm_s390x in boston: retire
We have moved over to the rdu mainframe, drop all the bos kvm hosts.

Signed-off-by: Kevin Fenzi <kevin@scrye.com>
2024-02-27 08:33:41 -08:00
Kevin Fenzi
334219e706 buildvm-s390x: move rest of old zvm builders to rdu and kvm
We want to move (well, really re-install) all these over on the new lpar
in rdu. This will have much higher stats and be in general faster by
both network and cpu. Hopefully all these will replace all the old
boston ones.

We may need to break these up some more into smaller vm's if the number
isn't able to keep up ok. We can adjust after things are all working.

Signed-off-by: Kevin Fenzi <kevin@scrye.com>
2024-02-21 09:51:24 -08:00
Kevin Fenzi
2159c95c39 koji_builder: fix misleading task name
Signed-off-by: Kevin Fenzi <kevin@scrye.com>
2024-02-07 11:45:37 -08:00
Kevin Fenzi
c6d175f414 koji_builder: try and allow coredumps on buildhw-a64 builders
We want to get core dumps from these builders in order to try and track
down livemedia failures in python with SIGILL.
https://bugzilla.redhat.com/show_bug.cgi?id=2247319
We just enable this on those builders for now and we set it so it is the
limit for the systemd-nspawn containers that mock uses.

Signed-off-by: Kevin Fenzi <kevin@scrye.com>
2023-11-03 16:41:59 +00:00
Owen W. Taylor
aaec95b064 Enable koji-flatpak on production
Enable the plugin on production, not just on staging.

Signed-off-by: Owen W. Taylor <otaylor@fishsoup.net>
2023-08-17 01:49:25 +00:00
Owen W. Taylor
f3c44a3ca3 Enable koji-flatpak plugin for staging
Just for staging for now:
 - enable 'podman-login' role for the buildvm group, so built Flatpaks
   can be pushed to the skopeo registry.
 - add the koji-flatpak hub plugin to koji_hub role
 - add the koji-flatpak builder plugin to the koji_builder role
   and configure it.

Signed-off-by: Owen W. Taylor <otaylor@fishsoup.net>
2023-08-14 19:27:31 +00:00
Kevin Fenzi
b3c2a39e1f koji_builder / osbuild: adjustments for osbuild api scripting
Right now we run a script on all builders once a minute to update the
api/auth ip's for osbuild. This has a number of problems:
* Sometimes osbuild jobs land on s390x builders that have no internet
  access and hang or fail.
* Sometimes the update script hangs or takes a long time to run because
  the builder is heavily loaded with builds, resulting in locking emails
  to sysadmin-main folks.

So, in this commit we:
* make a new koji channel called 'osbuild' with all the buildhw-x86's in
  it. They are usually not too overloaded and there are 16 of them so it
  should be available all the time.
* Leave the cron job on all builders for now in case, but make them only
  update once a day since they won't be getting jobs. If this works out
  we can remove it entirely there.
* Make the buildhw-x86s only update every 5min. This opens a larger
  window for it being wrong, but it's still pretty small and should
  reduce the number of emails for stalled processes we get.

See https://pagure.io/fedora-infrastructure/issue/10982

Signed-off-by: Kevin Fenzi <kevin@scrye.com>
2022-12-06 14:44:03 -08:00
Kevin Fenzi
75ddfcd201 koji_builder: mask systemd-oomd entirely
Signed-off-by: Kevin Fenzi <kevin@scrye.com>
2022-08-06 17:22:36 -07:00
Kevin Fenzi
688ca64361 koji_builder: add tag for oz.cfg so we can easily change it.
Signed-off-by: Kevin Fenzi <kevin@scrye.com>
2022-08-01 12:38:42 -07:00
Kevin Fenzi
76fbf76d1b koji_builders: add tag to be able to do just these
Signed-off-by: Kevin Fenzi <kevin@scrye.com>
2022-07-28 16:40:16 -07:00
Kevin Fenzi
20e0e74096 koji_builder: require ipset
Signed-off-by: Kevin Fenzi <kevin@scrye.com>
2022-07-28 12:07:00 -07:00
Kevin Fenzi
f545ece040 koji_builder: move update to templates for stg/prod
Signed-off-by: Kevin Fenzi <kevin@scrye.com>
2022-07-28 11:59:30 -07:00
Kevin Fenzi
e13df4173b koji_builder: fix typo and add tags
Signed-off-by: Kevin Fenzi <kevin@scrye.com>
2022-07-28 11:40:29 -07:00
Kevin Fenzi
1951c7fb1b koji_builder: first cut at a script to update osbuild api ip for builder firewalls
This is a quick, hacked up script that just runs once per minute and
updates the ip addresses for the osbuild koji plugin. The script calls
systemd's resolvectl without cache and puts the ips in a ipset. The
koji_builder firewall has a added rule to check that ipset for outgoing
connections that are allowed.

TODO: add some kind of error checking
TODO: probibly won't work on s390x builders as they can't reach the host
even with open firewalls, but should work for others.

Signed-off-by: Kevin Fenzi <kevin@scrye.com>
2022-07-28 11:29:07 -07:00
Kevin Fenzi
debbc13616 koji_builder: disable/stop systemd-oomd on builders
systemd-oomd seems to be a bit eager and kills builds before the kernel
OOM would have. Disable it for now and see if it helps memory hungry
builds any.

Signed-off-by: Kevin Fenzi <kevin@scrye.com>
2022-07-19 11:26:38 -07:00
Mark O Brien
20afa16aa8 install osbuild rpm on prod builders
Signed-off-by: Mark O Brien <markobri@redhat.com>
2022-06-08 11:29:32 +01:00
Mark O Brien
b3cacaaee6 set builder conf file per env
Signed-off-by: Mark O Brien <markobri@redhat.com>
2022-06-02 14:35:28 +01:00
David Kirwan
3d8b3faf0a image-builder: add task to create config directory
Signed-off-by: James Richardson <jamricha@redhat.com>
Signed-off-by: Emma Kidney <ekidney@redhat.com>
Signed-off-by: David Kirwan <dkirwan@redhat.com>
Signed-off-by: Stephen Coady <scoady@redhat.com>
2022-03-16 12:04:12 +00:00
David Kirwan
89e9a698e0 image-builder: add tag to koji-builder dependencies install task
Signed-off-by: James Richardson <jamricha@redhat.com>
Signed-off-by: Emma Kidney <ekidney@redhat.com>
Signed-off-by: David Kirwan <dkirwan@redhat.com>
Signed-off-by: Stephen Coady <scoady@redhat.com>
2022-03-16 11:10:47 +00:00
David Kirwan
9fbd26a83a image-builder: Adding osbuild to koji builders
- configuring koji builders to use image builder
- configure koji hub to handle osbuild jobs
- Separate prod/stg koji builder osbuild plugin config

Signed-off-by: James Richardson <jamricha@redhat.com>
Signed-off-by: Emma Kidney <ekidney@redhat.com>
Signed-off-by: David Kirwan <dkirwan@redhat.com>
Signed-off-by: Stephen Coady <scoady@redhat.com>
2022-03-16 10:38:20 +00:00
Kevin Fenzi
3d121ae5ee bkernel: drop nosync here too and fix logic to not change site-defaults in kojibuilder role
This caused a bit of trouble since I disabled nosync in the kojibuilder
role. I think applied that with -t site-defaults, which updated
everything, _including_ bkernel machines. Sadly, bkernel machines have
additional config in site-defaults to allow for secure boot signing and
this was lost. So, make sure only the bkernel role changes site-defaults
on bkernel machines and also drop nosync from it's private config.

Signed-off-by: Kevin Fenzi <kevin@scrye.com>
2021-12-10 09:04:18 -08:00
Nils Philippsen
9a5d550570 Koji: prepare for prod deployment of rpmautospec
The relevant parts were made conditional and only applied in the staging
environment, change that. Alongside, ensure the obsolete hub plugin
package and plugin configuration files are removed and don't
automatically update any of the involved packages.

Signed-off-by: Nils Philippsen <nils@redhat.com>
2021-06-17 15:45:19 +02:00
Kevin Fenzi
9a09a926ab drop ntp/ntpdate, no longer in f34
Signed-off-by: Kevin Fenzi <kevin@scrye.com>
2021-05-24 18:24:17 -07:00
Kevin Fenzi
e3e490786c koji_builder / staging: drop ntp/ntpdate for f34
Split out the koji_builder package installs so we can drop ntp/ntpdate
for f34 (they were replaced by ntpsec and we use chrony anyhow).
After we move prod to f34 we should merge these back.

Signed-off-by: Kevin Fenzi <kevin@scrye.com>
2021-04-09 10:21:40 -07:00
Kevin Fenzi
342ad36321 koji_builder: and conditional for rngd starting
Signed-off-by: Kevin Fenzi <kevin@scrye.com>
2021-02-17 10:38:42 -08:00
Kevin Fenzi
681fa8550c koji_builder: ppc64le builders also dont want rngd
Signed-off-by: Kevin Fenzi <kevin@scrye.com>
2021-02-12 16:00:12 -08:00
Kevin Fenzi
e870936ebe koji_builder: add a tag for site-defaults for mock
Signed-off-by: Kevin Fenzi <kevin@scrye.com>
2020-12-06 11:54:31 -08:00
Kevin Fenzi
d7c69fe880 koji_builder / staging: only setup libvirtd.conf in prod
Signed-off-by: Kevin Fenzi <kevin@scrye.com>
2020-10-01 14:20:03 -07:00
Mohan Boddu
7914f6c00f Install imagefactory-plugins-GCE on koji builders to generate GCP Cloud images
Signed-off-by: Mohan Boddu <mboddu@bhujji.com>
2020-09-18 19:47:35 +00:00
Kevin Fenzi
da387d0b20 koji_builder: we need to force this link because the mount may not be there(yet)
Signed-off-by: Kevin Fenzi <kevin@scrye.com>
2020-06-16 15:46:43 -07:00
Kevin Fenzi
708e5952d8 koji_builder: do not exclude bkernel builders from the normal mock site_defaults.
Signed-off-by: Kevin Fenzi <kevin@scrye.com>
2020-06-04 09:20:28 -07:00
Kevin Fenzi
b8c7d13fb7 koji_builder: remove last remnant of old hotfix for oz
Signed-off-by: Kevin Fenzi <kevin@scrye.com>
2020-05-28 17:05:08 -07:00
Kevin Fenzi
d0fd4a2e16 iad2: drop python-krbV, not needed anymore. Drop auth.py patch file thats not needed anymore.
Signed-off-by: Kevin Fenzi <kevin@scrye.com>
2020-05-28 16:53:17 -07:00
Pierre-Yves Chibon
984b570422 koji/builder: fix path to the rpmautospec config file - Take #2
Signed-off-by: Pierre-Yves Chibon <pingou@pingoured.fr>
2020-04-24 21:34:28 +02:00
Pierre-Yves Chibon
419e8701a3 koji/builder: fix path to the rpmautospec config file
Signed-off-by: Pierre-Yves Chibon <pingou@pingoured.fr>
2020-04-24 21:34:28 +02:00
Pierre-Yves Chibon
4c85106614 koji/builder: install the rpmautospec configuration file
Signed-off-by: Pierre-Yves Chibon <pingou@pingoured.fr>
2020-04-24 21:34:28 +02:00
Pierre-Yves Chibon
3f77fb4857 koji/builder: Ensure we always have the latest version of the rpmautospec plugin
Signed-off-by: Pierre-Yves Chibon <pingou@pingoured.fr>
2020-04-24 21:34:28 +02:00
Pierre-Yves Chibon
bcf66ba6d4 koji/builder: attempt to fix the jinja template in kojid.
Signed-off-by: Pierre-Yves Chibon <pingou@pingoured.fr>
2020-04-24 21:34:28 +02:00
Pierre-Yves Chibon
80cba71063 koji-builders: install and configure the rpmautospec plugin
Signed-off-by: Pierre-Yves Chibon <pingou@pingoured.fr>
2020-04-24 21:34:28 +02:00
Kevin Fenzi
1dfb013f96 koji_builder: drop the EC2 imagefactory plugin.
We don't (as far as I can tell) use this, and it pulls python2 into the builders.

Signed-off-by: Kevin Fenzi <kevin@scrye.com>
2020-04-24 21:34:19 +02:00
Kevin Fenzi
4e04d027ab buildvm-s390x-17: add to list that gets the /mnt/koji link.
Signed-off-by: Kevin Fenzi <kevin@scrye.com>
2020-04-24 21:34:18 +02:00
Kevin Fenzi
692c99395d koji_builder: python3-kickstart now.
Signed-off-by: Kevin Fenzi <kevin@scrye.com>
2020-04-24 21:34:14 +02:00
Kevin Fenzi
54b885ed51 koji_builder: drop a few more things that are python2 only and no longer needed.
Signed-off-by: Kevin Fenzi <kevin@scrye.com>
2020-04-24 21:34:14 +02:00
Kevin Fenzi
37fe0f9924 koji_builders: should be using python3-koji here.
Signed-off-by: Kevin Fenzi <kevin@scrye.com>
2020-04-24 21:34:14 +02:00
Kevin Fenzi
8315ba9108 koji / buildvm-s390x-01.s390: Move this to a normal builder, remove from compose channel
Signed-off-by: Kevin Fenzi <kevin@scrye.com>
2020-04-24 21:34:12 +02:00
Kevin Fenzi
3475f76169 buildvm / koji_builder: Also install sshfs and links on buildvm-s390x-15/16.
Signed-off-by: Kevin Fenzi <kevin@scrye.com>
2019-07-08 22:42:36 +00:00
Karsten Hopp
49346c1f88 use dnf for enablerepo 2019-06-11 17:48:35 +02:00
Karsten Hopp
e61cf74291 koji_builder: dnf -> package, with_item changes 2019-06-11 14:55:12 +00:00
Mikolaj Izdebski
99e63e1e1c koji_builder: Always install koji-builder-plugins 2019-06-06 10:55:42 +02:00