Commit Graph

254 Commits

Author SHA1 Message Date
Adam Williamson
b4b28d98ad openqa/dispatcher: fix bare boolean
Signed-off-by: Adam Williamson <awilliam@redhat.com>
2019-06-24 15:18:48 -07:00
Adam Williamson
2602d052b0 openqa/dispatcher: fix respin test scheduler
It broke because python3 setup.py install installs binaries
to /usr/local/bin , not /usr/bin, so fedora-openqa is no longer
where the script expects it to be...

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2019-06-24 15:11:04 -07:00
Adam Williamson
3b6e6fea7a openqa/dispatcher: set up fedora-messaging restart handlers
This should handle consumer service restarts elegantly. I hope.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2019-06-17 17:05:23 -07:00
Adam Williamson
6360a231cb openqa/dispatcher: add missing quote mark
...sigh.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2019-06-17 16:36:53 -07:00
Adam Williamson
97dd8ae650 openqa/dispatcher: always use fedora-messaging, ditch fedmsg
This ditches the ability to choose between fedora-messaging and
fedmsg and always uses fedora-messaging; with this, we'll switch
the prod instance to fedora-messaging also (fingers crossed).

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2019-06-17 16:13:43 -07:00
Adam Williamson
9315d19e8a openqa/dispatcher: drop rate_limit from email log config
I cargo-culted this from the Bodhi config but it's a special
Bodhi thing we don't have, so drop it.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2019-06-17 11:35:37 -07:00
Adam Williamson
b5ed2ce4e2 openqa/dispatcher: set up email error reporting
We had this for fedmsgs and it's pretty important, so let's try
and do it for fedora-messaging. The role has a generic setup,
infra-appropriate values are set in the group vars.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2019-06-17 11:24:22 -07:00
Adam Williamson
5759ecd1b6 openqa/worker: try and avoid failures in the NFS mount
I thought just having it WantedBy remote-fs.target should be
enough, but in fact this mount often fails on boot, and I forget
to check all the worker boxes until a bunch of tests fail and
everyone is sad. Let's try After=network-online.target and see
if that helps.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2019-06-15 09:11:40 -07:00
Adam Williamson
b8eeff1d9c openqa/dispatcher: use conditional-restart for the restarts
Signed-off-by: Adam Williamson <awilliam@redhat.com>
2019-06-14 15:46:08 -07:00
Adam Williamson
927897eae9 openqa/dispatcher: restart messaging servers on config changes
Signed-off-by: Adam Williamson <awilliam@redhat.com>
2019-06-14 15:43:40 -07:00
Adam Williamson
94791dd7aa openqa/dispatcher: add more info to messaging client config
jcline said it'd be nice for consumers to provide more info
about themselves, so here's some more info!

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2019-06-14 15:36:32 -07:00
Adam Williamson
9fc61c17bd openqa/dispatcher: fix AMQP URL variable usage
Signed-off-by: Adam Williamson <awilliam@redhat.com>
2019-06-14 15:10:14 -07:00
Adam Williamson
f6b2ae6b53 Fix stray syntax error in previous commit
Signed-off-by: Adam Williamson <awilliam@redhat.com>
2019-06-14 15:07:56 -07:00
Adam Williamson
db1a847517 openqa/dispatcher: use more role vars for messaging config
Now I've built the whole thing and it works, I feel like this
is a cleaner design: we use a lot more role variables in the
messaging config files, set defaults for them that are
appropriate for non-infra use, and set the correct values for
the infra servers in the group vars. Let's just hope I got it
all right...

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2019-06-14 15:05:23 -07:00
Adam Williamson
42a9b50f05 openqa/dispatcher: add zmq exchange binding to messaging configs
Otherwise we don't get messages from the ZMQ->AMQP bridge.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2019-06-14 12:16:17 -07:00
Adam Williamson
267a4510c0 openqa/dispatcher: set passive_declares for AMQP
This is needed for private auth to work...sigh...

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2019-06-14 09:13:55 -07:00
Adam Williamson
513ff61eaa Revert "openqa: disable private fedora-messaging auth for now"
This reverts commit 18f7398ca0.
Let's try with auth again now jcline is around to help out.
2019-06-14 08:36:46 -07:00
Adam Williamson
18f7398ca0 openqa: disable private fedora-messaging auth for now
well, this just isn't working and no-one's around to debug it.
So turn it off for now. Will try and fix it tomorrow.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2019-06-13 16:08:18 -07:00
Adam Williamson
6853dbb181 openqa/dispatcher: correct fedora-messaging priv auth vhost
Signed-off-by: Adam Williamson <awilliam@redhat.com>
2019-06-13 14:47:13 -07:00
Adam Williamson
acfd9f7b81 openqa/dispatcher: quote-wrap the queue name in the config
Signed-off-by: Adam Williamson <awilliam@redhat.com>
2019-06-13 14:29:07 -07:00
Adam Williamson
848f81fa36 openqa: use openqa_env instead of env, just like env_suffix...
Signed-off-by: Adam Williamson <awilliam@redhat.com>
2019-06-13 14:24:35 -07:00
Adam Williamson
440e0fd91e openqa: rejig env_suffix handling
env_suffix isn't actually set to .stg on openQA staging because
it's not a normal staging host. Let's not set it in case it
breaks other plays, but use a custom var instead.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2019-06-13 14:19:41 -07:00
Adam Williamson
700fb3c1ae openqa/dispatcher: use private auth in infra
The keys and certs have been created for us to use private auth
so let's do it. This tries to keep things working for non-infra
deployments somehow.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2019-06-13 13:55:04 -07:00
Paul W. Frields
7ef3be1d94 openqa: all roles change dnf -> package 2019-06-11 14:39:52 +00:00
Adam Williamson
4b183e75ca openqa/dispatcher: don't use staging auth for scheduler
As it listens to the prod broker.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2019-06-07 19:14:24 -07:00
Adam Williamson
37d272d1ff openqa/dispatcher: fix some more bare bools
Signed-off-by: Adam Williamson <awilliam@redhat.com>
2019-06-07 19:08:03 -07:00
Adam Williamson
e5d34dd9d3 openqa/dispatcher: fix staging AMQP broker setup
The correct auth bits are missing from the package so I'll ship
them here for now, and correct the config.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2019-06-07 19:01:01 -07:00
Adam Williamson
d63581157a openqa/dispatcher: add logging config for fedora-messaging
Signed-off-by: Adam Williamson <awilliam@redhat.com>
2019-06-07 18:46:43 -07:00
Adam Williamson
547f669cde openqa/dispatcher: fix indentation issue
Signed-off-by: Adam Williamson <awilliam@redhat.com>
2019-06-07 18:46:09 -07:00
Adam Williamson
c0e3a085f8 openqa/dispatcher: fix ansible bare boolean deprecation warning
Signed-off-by: Adam Williamson <awilliam@redhat.com>
2019-06-07 18:08:45 -07:00
Adam Williamson
5e9b3f5348 openqa: fix resultsdb reporter fedora-messaging config
Missing some quotes...

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2019-06-07 18:08:29 -07:00
Adam Williamson
1c5be7ac3e openqa: set the UUIDs for the fedora-messaging staging queues
These should really be secrets, but no-one's around to help me
set up new secrets right now, and it shouldn't matter a lot in
the short term at least.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2019-06-07 18:01:11 -07:00
Adam Williamson
348145dbfa openqa/dispatcher: first cut at supporting fedora-messaging
This is a big change to support fedora-messaging based consumers
instead of fedmsg ones in the openqa/dispatcher role. This needs
the fedora-messaging branch of fedora_openqa, until that is
merged to stable. For now this is all conditionalized so prod
will continue to use fedmsg. This also improves some variable
usage and documentation in the fedmsg path too.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2019-06-07 17:44:42 -07:00
Adam Williamson
4f202be131 openqa: drop all use of wikitcms_user and wikitcms_password
It's all wikitcms_token now, this was all just outdated cruft.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2019-06-07 16:56:11 -07:00
Kevin Fenzi
4b31ac5152 ansible: Change all our group names from foo-bar to foo_bar or foo-bar-baz to foo_bar_baz
In ansible 2.8 the - character isn't supposed to be valid in group names.
While we could override this, might has well just bite the bullet and change it.
So, just switch all group names to use _ instead of -

Signed-off-by: Kevin Fenzi <kevin@scrye.com>
2019-05-20 17:38:09 +00:00
Adam Williamson
ed4f45b314 openqa/server: set config option not to cancel whole job cluster
This is the config option added in the most recent openqa build
which prevents it cancelling an entire cluster of parallel jobs
if just one of the children fails. See:

https://progress.opensuse.org/issues/46295

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2019-03-05 10:04:48 -08:00
Peter Robinson
a3b174ccf7 aarch64: add edk2-arm UEFI firmware for oz/imagefactory/openqa for armhfp on aarch64 processes 2019-02-28 20:59:49 +00:00
Adam Williamson
5a902d0cca Make ifcfg change for openqa-ppc64le as well, and drop hack
Hopefully this bit in tap-setup.yml can now go away, as this
approach of using ansible_ifcfg_whitelist and _disabled does the
same thing in a cleaner way.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2018-12-15 10:06:54 -08:00
Adam Williamson
fb01e9ad79 openqa/worker: install network-scripts on F29+ tap workers
network.service isn't in initscripts any more.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2018-12-14 16:19:23 -08:00
Adam Williamson
983e39abff openqa/dispatcher: improve 'extra arches' implementation
These bits were still named and described as if they were ppc64
specific, even though they actually cover aarch64 too. Also I
decided I don't like the implementation of cueing *directly* off
the infra deployment type here, it feels wrong. Instead let's
just make it work from a config variable, and set that variable
to false by default and true in group_vars/openqa-stg.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2018-11-30 10:34:04 -08:00
Adam Williamson
98645f5435 openqa/dispatcher: remove old wiki 'credentials' file
This is no longer used (we use OIDC token auth now), so let's
not leave the plain text password file sitting around for no
reason.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2018-11-30 10:24:54 -08:00
Adam Williamson
b30732e722 openqa etc.: drop Python 2 -> 3 migration bits
Both stg and prod are migrated now, so let's clean up the plays
to be pure Python 3.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2018-11-30 10:13:56 -08:00
Adam Williamson
e293bc91d4 ...or, you know, I just messed up the conditional
Signed-off-by: Adam Williamson <awilliam@redhat.com>
2018-11-27 15:47:52 -08:00
Adam Williamson
958ddd9e62 openqa/dispatcher: perhaps we can't register to the same var?
Signed-off-by: Adam Williamson <awilliam@redhat.com>
2018-11-27 15:42:11 -08:00
Adam Williamson
31115c12ab openqa: Enable openqa-livehandler.service for prod too
...since I'm about to upgrade it. Whee

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2018-11-27 14:42:00 -08:00
Adam Williamson
2426ab6e5c Use new --nodeps for Python 3 setup.py installs (oqa etc)
This should hopefully avoid an awkward problem I noticed with
'python3 setup.py install' dumping replacements in /usr/local
for packaged scripts (e.g. fedmsg-logger)...

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2018-11-27 14:13:30 -08:00
Adam Williamson
11fdb6b643 oqa/fedmsg3: trim python2 package removals, still need fedmsg
openQA fedmsg plugin still needs python2-fedmsg for now...

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2018-11-26 14:10:14 -08:00
Adam Williamson
56d689d31a Fix Py2 install detection and trim py2 package removals
Signed-off-by: Adam Williamson <awilliam@redhat.com>
2018-11-26 12:57:10 -08:00
Adam Williamson
43db2ee9fc Fix Python 2 removal for oqa, rvc and acr as well
Signed-off-by: Adam Williamson <awilliam@redhat.com>
2018-11-26 12:35:25 -08:00
Adam Williamson
0233052858 Some fixups for oqa fedmsg 3 (prev commit)
Signed-off-by: Adam Williamson <awilliam@redhat.com>
2018-11-26 11:09:31 -08:00