Commit Graph

220 Commits

Author SHA1 Message Date
Kevin Fenzi
4b31ac5152 ansible: Change all our group names from foo-bar to foo_bar or foo-bar-baz to foo_bar_baz
In ansible 2.8 the - character isn't supposed to be valid in group names.
While we could override this, might has well just bite the bullet and change it.
So, just switch all group names to use _ instead of -

Signed-off-by: Kevin Fenzi <kevin@scrye.com>
2019-05-20 17:38:09 +00:00
Adam Williamson
ed4f45b314 openqa/server: set config option not to cancel whole job cluster
This is the config option added in the most recent openqa build
which prevents it cancelling an entire cluster of parallel jobs
if just one of the children fails. See:

https://progress.opensuse.org/issues/46295

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2019-03-05 10:04:48 -08:00
Peter Robinson
a3b174ccf7 aarch64: add edk2-arm UEFI firmware for oz/imagefactory/openqa for armhfp on aarch64 processes 2019-02-28 20:59:49 +00:00
Adam Williamson
5a902d0cca Make ifcfg change for openqa-ppc64le as well, and drop hack
Hopefully this bit in tap-setup.yml can now go away, as this
approach of using ansible_ifcfg_whitelist and _disabled does the
same thing in a cleaner way.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2018-12-15 10:06:54 -08:00
Adam Williamson
fb01e9ad79 openqa/worker: install network-scripts on F29+ tap workers
network.service isn't in initscripts any more.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2018-12-14 16:19:23 -08:00
Adam Williamson
983e39abff openqa/dispatcher: improve 'extra arches' implementation
These bits were still named and described as if they were ppc64
specific, even though they actually cover aarch64 too. Also I
decided I don't like the implementation of cueing *directly* off
the infra deployment type here, it feels wrong. Instead let's
just make it work from a config variable, and set that variable
to false by default and true in group_vars/openqa-stg.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2018-11-30 10:34:04 -08:00
Adam Williamson
98645f5435 openqa/dispatcher: remove old wiki 'credentials' file
This is no longer used (we use OIDC token auth now), so let's
not leave the plain text password file sitting around for no
reason.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2018-11-30 10:24:54 -08:00
Adam Williamson
b30732e722 openqa etc.: drop Python 2 -> 3 migration bits
Both stg and prod are migrated now, so let's clean up the plays
to be pure Python 3.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2018-11-30 10:13:56 -08:00
Adam Williamson
e293bc91d4 ...or, you know, I just messed up the conditional
Signed-off-by: Adam Williamson <awilliam@redhat.com>
2018-11-27 15:47:52 -08:00
Adam Williamson
958ddd9e62 openqa/dispatcher: perhaps we can't register to the same var?
Signed-off-by: Adam Williamson <awilliam@redhat.com>
2018-11-27 15:42:11 -08:00
Adam Williamson
31115c12ab openqa: Enable openqa-livehandler.service for prod too
...since I'm about to upgrade it. Whee

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2018-11-27 14:42:00 -08:00
Adam Williamson
2426ab6e5c Use new --nodeps for Python 3 setup.py installs (oqa etc)
This should hopefully avoid an awkward problem I noticed with
'python3 setup.py install' dumping replacements in /usr/local
for packaged scripts (e.g. fedmsg-logger)...

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2018-11-27 14:13:30 -08:00
Adam Williamson
11fdb6b643 oqa/fedmsg3: trim python2 package removals, still need fedmsg
openQA fedmsg plugin still needs python2-fedmsg for now...

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2018-11-26 14:10:14 -08:00
Adam Williamson
56d689d31a Fix Py2 install detection and trim py2 package removals
Signed-off-by: Adam Williamson <awilliam@redhat.com>
2018-11-26 12:57:10 -08:00
Adam Williamson
43db2ee9fc Fix Python 2 removal for oqa, rvc and acr as well
Signed-off-by: Adam Williamson <awilliam@redhat.com>
2018-11-26 12:35:25 -08:00
Adam Williamson
0233052858 Some fixups for oqa fedmsg 3 (prev commit)
Signed-off-by: Adam Williamson <awilliam@redhat.com>
2018-11-26 11:09:31 -08:00
Adam Williamson
6c390c669b First cut at migrating openqa-stg to fedmsg-3
This includes some tweaks to the core fedmsg roles to allow a
'generic' way of indicating that a box should use fedmsg-hub-3
not fedmsg-hub, and make the restart notification work for that.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2018-11-26 10:53:16 -08:00
Adam Williamson
4f684bf9e1 openqa/server: enable additional service for new openqa
Only on stg for now (as we're only deploying new openqa there
for now).

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2018-11-19 15:30:26 -08:00
Adam Williamson
c69c2fd485 openqa/relvalconsumer: fix all other dnf loop cases to use lists
Signed-off-by: Adam Williamson <awilliam@redhat.com>
2018-10-09 13:50:39 -07:00
Adam Williamson
5dea458a23 openqa/dispatcher: tweak package installs a bit more
Don't need u-t as much any more, switch to lists for the others.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2018-10-09 13:32:17 -07:00
Adam Williamson
99a2f7dd01 Let's play some more syntax bingo
Signed-off-by: Adam Williamson <awilliam@redhat.com>
2018-10-09 13:17:18 -07:00
Adam Williamson
1e96a516ea Maybe with quotes? Why doesn't the example page explain this?
Signed-off-by: Adam Williamson <awilliam@redhat.com>
2018-10-09 13:15:12 -07:00
Adam Williamson
7a26cc1313 openqa/dispatcher: use list not loop for package names
The loop style is apparently deprecated, we're supposed to use a
list of package names now. Doing just one task as a test to see
if I got the syntax right.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2018-10-09 13:07:13 -07:00
Kevin Fenzi
52a99301de do not overwrite this for now 2018-10-05 16:50:47 +00:00
Adam Williamson
81ffb2d7fd openqa/dispatcher: Correct wikitcms OIDC token permissions
These were correct in relvalconsumer, but not here...

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2018-08-27 15:42:11 -07:00
Kevin Fenzi
1a52ec827c 2. 2 is the number. 2018-07-11 22:33:49 +00:00
Kevin Fenzi
e231493b1e Fix typo. I have no idea how this worked or ran since march. 2018-07-11 22:10:01 +00:00
Adam Williamson
9a7dc2b145 openqa: Add libsemanage-python to worker createhdds packages
Signed-off-by: Adam Williamson <awilliam@redhat.com>
2018-06-11 15:01:41 -07:00
Adam Williamson
543ffa4c20 openqa/worker: add withlock to packages needed for createhdds
Signed-off-by: Adam Williamson <awilliam@redhat.com>
2018-05-28 17:09:49 -07:00
Adam Williamson
8b561f12a6 Correct a stray extra line in previous commit
Signed-off-by: Adam Williamson <awilliam@redhat.com>
2018-05-09 15:12:07 -07:00
Adam Williamson
38a6abeae5 openqa_worker: install and enable rngd on some worker hosts
Some of the worker hosts have hardware RNGs (but not the x86_64
ones). Install rng-tools and enable rngd.service on these to
hopefully help with the Rawhide RNG issue.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2018-05-09 15:03:15 -07:00
Kevin Fenzi
a8714caab3 first cut at changing all the old |changed to is changed per ansible deprecations 2018-05-07 23:51:48 +00:00
Adam Williamson
a8ee935cbe Fix 'when' condition for previous commits
Signed-off-by: Adam Williamson <awilliam@redhat.com>
2018-03-22 16:14:10 -07:00
Adam Williamson
e6fbc29d42 Try and fix previous commit (I hate sql)
Signed-off-by: Adam Williamson <awilliam@redhat.com>
2018-03-22 16:11:12 -07:00
Adam Williamson
e069489ecc Tweak openQA asset size settings again
The UI makes this easier to investigate now, and it looks like
we could give x86_64 a bit more space, but other arches less.
So let's tweak things to do that. This should also reduce
overall usage on staging a bit, as it's up against its limits.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2018-03-22 16:06:42 -07:00
Adam Williamson
4017e9ebdc openqa: update ppc64 images.json for Atomic variant renames
Signed-off-by: Adam Williamson <awilliam@redhat.com>
2018-03-06 16:09:02 -08:00
Adam Williamson
f7c87b0f75 openqa/worker: make some file existence checks safer
Signed-off-by: Adam Williamson <awilliam@redhat.com>
2018-03-06 15:24:37 -08:00
Paul Whalen
970640e4f4 Add aarch64 server boot, dvd to images. 2018-03-06 09:47:32 +00:00
Paul Whalen
d05660192c Add aarch64 to workers template. 2018-03-06 09:47:01 +00:00
Paul Whalen
888c66f52e Add edk2-aarch64 to aarch64 workers. 2018-03-06 09:46:30 +00:00
Adam Williamson
fdecceb571 openqa: Fix a check in createhdds worker
Signed-off-by: Adam Williamson <awilliam@redhat.com>
2018-02-23 17:21:55 -08:00
Adam Williamson
672bf06b04 openqa: do createhdds on x86_64 workers for now
1539330 is turning out to be pretty intransigent and the images
are getting very old, plus we need f28 branched base images. So
let's do image builds on the x86_64 workers for now. Also re-
enable image builds on workers - I never should've turned that
off in the first place, as they shouldn't be susceptible to the
bug.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2018-02-23 17:14:28 -08:00
Adam Williamson
69ed1bb554 openqa: disable createhdds cron jobs (#1539330)
Yeah, daily crashes are bad.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2018-01-28 01:08:44 +01:00
Adam Williamson
3f284aed9e openqa/worker: run the ppc64 script hourly
The /dev/kvm permissions just seem to keep getting reset somehow
and I'm sick of it. Let's see if this helps.
2017-12-21 16:55:35 -08:00
Adam Williamson
25d1c79a4b Tweak openQA asset size settings again
Staging is running out of space...let's kick it back down to
300, and also create a separate setting for update group asset
size. We test lots of updates, and for each update we only need
to upload one disk image, so we really don't need 300GB of
asset space for update job groups, that just means we'll keep
like 300 update disk images lying around. If PPC starts getting
incompletions again I'll have to, uh, do something? Yeahhh.
Something.
2017-11-30 11:48:22 -08:00
Adam Williamson
aa6a0c7071 wikitcms: ensure openidc-client is available for token auth
Signed-off-by: Adam Williamson <awilliam@redhat.com>
2017-11-16 13:36:17 -08:00
Adam Williamson
d3356663d8 wikitcms token: create directory, install for fedmsg and root
Previous commit didn't work as the directory doesn't exist.
Also, I think we need the file in two places, one for root
(for if an admin runs something wikitcms-ish manually while
logged in as root) and one for fedmsg (for the usual case
when the wiki is updated by fedmsg consumers). So do that.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2017-11-16 13:24:05 -08:00
Adam Williamson
c5450c9cfe openqa, relvalconsumer: write wikitcms token file for new auth
Unattended wiki interaction with the new openidc auth method
requires a special token file which @puiterwijk created and
put in the private store for us. Have the appropriate roles
install it.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2017-11-16 12:59:30 -08:00
Adam Williamson
4a6d33d863 openqa, relvalconsumer: need fedfind/wikitcms from u-t for now 2017-11-10 18:34:10 -08:00
Kevin Fenzi
afef097a3d switch all the include tasks to import tasks 2017-10-17 17:37:03 +00:00