Commit Graph

264 Commits

Author SHA1 Message Date
Kevin Fenzi
81fb4582e7 ansible: change when conditions to use == instead of is when checking strings.
Signed-off-by: Kevin Fenzi <kevin@scrye.com>
2020-04-24 21:34:10 +02:00
Karsten Hopp
c9ed62ac32 update ansible_distribution_major_version conditionals
Signed-off-by: Karsten Hopp <karsten@redhat.com>
2020-04-24 21:34:10 +02:00
Adam Williamson
57bc370035 I swear to Christ json must die
Signed-off-by: Adam Williamson <awilliam@redhat.com>
2020-04-24 21:34:09 +02:00
Adam Williamson
9b35d4fffd openqa/dispatcher: fix extraarches wanted image config syntax
Gah, JSON.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2020-04-24 21:34:09 +02:00
Adam Williamson
cc5a23960a openqa roles: fix fedora-messaging key permissions
geekotest needs to be able to read the key files or else openQA
cannot publish messages.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2020-04-24 21:34:09 +02:00
Adam Williamson
11136b796a openqa/dispatcher: add Silverblue installer to ppc64le WANTED
This means we will test it now. By request of Michel Normand.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2020-04-24 21:34:08 +02:00
Adam Williamson
45b6adb9e1 openqa/server: fixes for the AMQP publishing config
Signed-off-by: Adam Williamson <awilliam@redhat.com>
2020-04-24 21:34:07 +02:00
Adam Williamson
ab4a46bf9e openQA: try and set up fedora-messaging publishing on staging
Also tweak how we do the plugin config a bit, I don't like the
whole 'do special stuff if deployment_mode is set' thing any
more.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2020-04-24 21:34:07 +02:00
Adam Williamson
2a1dd41542 openqa/dispatcher: drop ppc64 (BE) expected images
We no longer build big-endian ppc64 images, so no point looking
for them. ppc64le remains of course.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2019-07-10 14:16:08 -07:00
Adam Williamson
42359a80c0 openqa/dispatcher: fix Silverblue name in extraaraches JSON
We use a 'wanted images' config file for staging, which makes
us look for images from aarch64 and ppc64le arches; this was not
updated when AtomicWorkstation was renamed Silverblue, so we
haven't been scheduling Silverblue tests on staging at all...

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2019-06-28 10:25:29 -07:00
Adam Williamson
b4b28d98ad openqa/dispatcher: fix bare boolean
Signed-off-by: Adam Williamson <awilliam@redhat.com>
2019-06-24 15:18:48 -07:00
Adam Williamson
2602d052b0 openqa/dispatcher: fix respin test scheduler
It broke because python3 setup.py install installs binaries
to /usr/local/bin , not /usr/bin, so fedora-openqa is no longer
where the script expects it to be...

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2019-06-24 15:11:04 -07:00
Adam Williamson
3b6e6fea7a openqa/dispatcher: set up fedora-messaging restart handlers
This should handle consumer service restarts elegantly. I hope.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2019-06-17 17:05:23 -07:00
Adam Williamson
6360a231cb openqa/dispatcher: add missing quote mark
...sigh.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2019-06-17 16:36:53 -07:00
Adam Williamson
97dd8ae650 openqa/dispatcher: always use fedora-messaging, ditch fedmsg
This ditches the ability to choose between fedora-messaging and
fedmsg and always uses fedora-messaging; with this, we'll switch
the prod instance to fedora-messaging also (fingers crossed).

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2019-06-17 16:13:43 -07:00
Adam Williamson
9315d19e8a openqa/dispatcher: drop rate_limit from email log config
I cargo-culted this from the Bodhi config but it's a special
Bodhi thing we don't have, so drop it.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2019-06-17 11:35:37 -07:00
Adam Williamson
b5ed2ce4e2 openqa/dispatcher: set up email error reporting
We had this for fedmsgs and it's pretty important, so let's try
and do it for fedora-messaging. The role has a generic setup,
infra-appropriate values are set in the group vars.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2019-06-17 11:24:22 -07:00
Adam Williamson
5759ecd1b6 openqa/worker: try and avoid failures in the NFS mount
I thought just having it WantedBy remote-fs.target should be
enough, but in fact this mount often fails on boot, and I forget
to check all the worker boxes until a bunch of tests fail and
everyone is sad. Let's try After=network-online.target and see
if that helps.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2019-06-15 09:11:40 -07:00
Adam Williamson
b8eeff1d9c openqa/dispatcher: use conditional-restart for the restarts
Signed-off-by: Adam Williamson <awilliam@redhat.com>
2019-06-14 15:46:08 -07:00
Adam Williamson
927897eae9 openqa/dispatcher: restart messaging servers on config changes
Signed-off-by: Adam Williamson <awilliam@redhat.com>
2019-06-14 15:43:40 -07:00
Adam Williamson
94791dd7aa openqa/dispatcher: add more info to messaging client config
jcline said it'd be nice for consumers to provide more info
about themselves, so here's some more info!

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2019-06-14 15:36:32 -07:00
Adam Williamson
9fc61c17bd openqa/dispatcher: fix AMQP URL variable usage
Signed-off-by: Adam Williamson <awilliam@redhat.com>
2019-06-14 15:10:14 -07:00
Adam Williamson
f6b2ae6b53 Fix stray syntax error in previous commit
Signed-off-by: Adam Williamson <awilliam@redhat.com>
2019-06-14 15:07:56 -07:00
Adam Williamson
db1a847517 openqa/dispatcher: use more role vars for messaging config
Now I've built the whole thing and it works, I feel like this
is a cleaner design: we use a lot more role variables in the
messaging config files, set defaults for them that are
appropriate for non-infra use, and set the correct values for
the infra servers in the group vars. Let's just hope I got it
all right...

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2019-06-14 15:05:23 -07:00
Adam Williamson
42a9b50f05 openqa/dispatcher: add zmq exchange binding to messaging configs
Otherwise we don't get messages from the ZMQ->AMQP bridge.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2019-06-14 12:16:17 -07:00
Adam Williamson
267a4510c0 openqa/dispatcher: set passive_declares for AMQP
This is needed for private auth to work...sigh...

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2019-06-14 09:13:55 -07:00
Adam Williamson
513ff61eaa Revert "openqa: disable private fedora-messaging auth for now"
This reverts commit 18f7398ca0.
Let's try with auth again now jcline is around to help out.
2019-06-14 08:36:46 -07:00
Adam Williamson
18f7398ca0 openqa: disable private fedora-messaging auth for now
well, this just isn't working and no-one's around to debug it.
So turn it off for now. Will try and fix it tomorrow.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2019-06-13 16:08:18 -07:00
Adam Williamson
6853dbb181 openqa/dispatcher: correct fedora-messaging priv auth vhost
Signed-off-by: Adam Williamson <awilliam@redhat.com>
2019-06-13 14:47:13 -07:00
Adam Williamson
acfd9f7b81 openqa/dispatcher: quote-wrap the queue name in the config
Signed-off-by: Adam Williamson <awilliam@redhat.com>
2019-06-13 14:29:07 -07:00
Adam Williamson
848f81fa36 openqa: use openqa_env instead of env, just like env_suffix...
Signed-off-by: Adam Williamson <awilliam@redhat.com>
2019-06-13 14:24:35 -07:00
Adam Williamson
440e0fd91e openqa: rejig env_suffix handling
env_suffix isn't actually set to .stg on openQA staging because
it's not a normal staging host. Let's not set it in case it
breaks other plays, but use a custom var instead.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2019-06-13 14:19:41 -07:00
Adam Williamson
700fb3c1ae openqa/dispatcher: use private auth in infra
The keys and certs have been created for us to use private auth
so let's do it. This tries to keep things working for non-infra
deployments somehow.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2019-06-13 13:55:04 -07:00
Paul W. Frields
7ef3be1d94 openqa: all roles change dnf -> package 2019-06-11 14:39:52 +00:00
Adam Williamson
4b183e75ca openqa/dispatcher: don't use staging auth for scheduler
As it listens to the prod broker.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2019-06-07 19:14:24 -07:00
Adam Williamson
37d272d1ff openqa/dispatcher: fix some more bare bools
Signed-off-by: Adam Williamson <awilliam@redhat.com>
2019-06-07 19:08:03 -07:00
Adam Williamson
e5d34dd9d3 openqa/dispatcher: fix staging AMQP broker setup
The correct auth bits are missing from the package so I'll ship
them here for now, and correct the config.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2019-06-07 19:01:01 -07:00
Adam Williamson
d63581157a openqa/dispatcher: add logging config for fedora-messaging
Signed-off-by: Adam Williamson <awilliam@redhat.com>
2019-06-07 18:46:43 -07:00
Adam Williamson
547f669cde openqa/dispatcher: fix indentation issue
Signed-off-by: Adam Williamson <awilliam@redhat.com>
2019-06-07 18:46:09 -07:00
Adam Williamson
c0e3a085f8 openqa/dispatcher: fix ansible bare boolean deprecation warning
Signed-off-by: Adam Williamson <awilliam@redhat.com>
2019-06-07 18:08:45 -07:00
Adam Williamson
5e9b3f5348 openqa: fix resultsdb reporter fedora-messaging config
Missing some quotes...

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2019-06-07 18:08:29 -07:00
Adam Williamson
1c5be7ac3e openqa: set the UUIDs for the fedora-messaging staging queues
These should really be secrets, but no-one's around to help me
set up new secrets right now, and it shouldn't matter a lot in
the short term at least.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2019-06-07 18:01:11 -07:00
Adam Williamson
348145dbfa openqa/dispatcher: first cut at supporting fedora-messaging
This is a big change to support fedora-messaging based consumers
instead of fedmsg ones in the openqa/dispatcher role. This needs
the fedora-messaging branch of fedora_openqa, until that is
merged to stable. For now this is all conditionalized so prod
will continue to use fedmsg. This also improves some variable
usage and documentation in the fedmsg path too.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2019-06-07 17:44:42 -07:00
Adam Williamson
4f202be131 openqa: drop all use of wikitcms_user and wikitcms_password
It's all wikitcms_token now, this was all just outdated cruft.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2019-06-07 16:56:11 -07:00
Kevin Fenzi
4b31ac5152 ansible: Change all our group names from foo-bar to foo_bar or foo-bar-baz to foo_bar_baz
In ansible 2.8 the - character isn't supposed to be valid in group names.
While we could override this, might has well just bite the bullet and change it.
So, just switch all group names to use _ instead of -

Signed-off-by: Kevin Fenzi <kevin@scrye.com>
2019-05-20 17:38:09 +00:00
Adam Williamson
ed4f45b314 openqa/server: set config option not to cancel whole job cluster
This is the config option added in the most recent openqa build
which prevents it cancelling an entire cluster of parallel jobs
if just one of the children fails. See:

https://progress.opensuse.org/issues/46295

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2019-03-05 10:04:48 -08:00
Peter Robinson
a3b174ccf7 aarch64: add edk2-arm UEFI firmware for oz/imagefactory/openqa for armhfp on aarch64 processes 2019-02-28 20:59:49 +00:00
Adam Williamson
5a902d0cca Make ifcfg change for openqa-ppc64le as well, and drop hack
Hopefully this bit in tap-setup.yml can now go away, as this
approach of using ansible_ifcfg_whitelist and _disabled does the
same thing in a cleaner way.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2018-12-15 10:06:54 -08:00
Adam Williamson
fb01e9ad79 openqa/worker: install network-scripts on F29+ tap workers
network.service isn't in initscripts any more.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2018-12-14 16:19:23 -08:00
Adam Williamson
983e39abff openqa/dispatcher: improve 'extra arches' implementation
These bits were still named and described as if they were ppc64
specific, even though they actually cover aarch64 too. Also I
decided I don't like the implementation of cueing *directly* off
the infra deployment type here, it feels wrong. Instead let's
just make it work from a config variable, and set that variable
to false by default and true in group_vars/openqa-stg.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2018-11-30 10:34:04 -08:00