Commit Graph

32 Commits

Author SHA1 Message Date
Adam Williamson
5da2faac67 openqa/server: allow OAuth2 authentication, enable on lab
OpenID support in FAS is going away. openQA has OAuth2 support.
I've tested this config to work with manual edits on lab, now
ansiblizing it (for lab only to start with).

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2025-03-28 13:40:57 -07:00
Adam Williamson
374956365e openqa: drop the results_min_free_disk_space_percentage cleanup
It is extremely slow to run, and we figured out that the problem
on openqa01 was excessive space being used by Netapp snapshots,
so we don't need this any more. It was actually deleting old
jobs before their time, because it had already wiped every
video file and didn't know what else to do...

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2023-07-25 15:13:07 -07:00
Adam Williamson
1e26a28c2c openqa/server: try setting a limit on test result disk usage
We're having issues with test results eating up all the disk
space we can throw at them (prod is over 4T, stg is over 2T -
I don't know why prod is bigger, that's odd, but it may be an
odd effect of having more arches on stg, maybe aarch64 and
ppc64le tests generally have smaller videos, or something).
This config setting should make openQA keep the space usage
on the partition at a max of 85%, by deleting videos from older
tests as required.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2023-07-21 10:19:54 -07:00
Adam Williamson
1c95ec9a35 Revert "openQA: set higher LimitRequestLine in httpd vhost config"
This reverts commit 892453da7e.
openQA still had problems with the very long request, so I just
did an ugly hack to get the request under the limit instead.
2022-10-21 17:12:15 -07:00
Adam Williamson
892453da7e openQA: set higher LimitRequestLine in httpd vhost config
The openQA job scheduler was hitting 414 errors today because
an update has so many builds there are more than 8190 characters
(the default limit) in the POST request. Let's bump the limit
to 16000.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2022-10-21 08:38:05 -07:00
Adam Williamson
ccf3b23cd4 openqa/server: skip openqa.ini amqp section if vars not set
We don't want to include this section if the vars aren't set.
Not every openQA server has to be an AMQP publisher.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2022-06-07 15:21:15 -07:00
Adam Williamson
b5be505576 openqa/server: don't hide ISO assets any more
We were hiding these because in the past the only ISO assets
were those from the compose under test, and we wanted to avoid
people downloading them from openQA when we'd rather they get
them from dl.fp.o or the mirror system. But these days we have
tests that generate ISOs (update netinst and live image build
tests) and we often want to download the generated images to
test them locally.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2022-05-25 09:12:10 -07:00
Adam Williamson
55be7c05f6 openQA: update AMQP config settings for lab
These need to change with the newer version of openQA.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2021-11-30 10:30:20 -08:00
Adam Williamson
61af6f34ca openQA: update server config (disable audit, tweak cleanup)
We never use the auditing stuff, so let's turn it off (and set
short limits for audit event duration so we can run the cleanup
and get rid of existing audit events). Let's also use the new
setting that only runs asset cleanup if free space is low.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2021-04-08 09:24:23 -07:00
Adam Williamson
aa2a002a96 Change how we get the HTML file accessible in fedora_nightlies
Just can't get Apache config Alias to work for some reason, so
let's go with the flow and stick the file in openQA's public
directory. This works!

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2020-11-21 18:37:03 -08:00
Adam Williamson
efb353bc02 Let's make that IncludeOptional so lab doesn't die
Signed-off-by: Adam Williamson <awilliam@redhat.com>
2020-11-21 17:47:23 -08:00
Adam Williamson
4851dc8d65 Try and do fedora_nightlies Apache config without breaking openQA
Er, oops. This involves a hack, but at least it doesn't take the
openQA web UI offline.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2020-11-21 17:43:55 -08:00
Adam Williamson
61251d0b11 More syntax...sigh
Signed-off-by: Adam Williamson <awilliam@redhat.com>
2020-11-05 16:24:27 -08:00
Adam Williamson
95f062c07a openQA: allow all workers NFS write access, other tweaks
The main goal of these changes is to allow all workers in each
deployment NFS write access to the factory share. This is because
I want to try using os-autoinst's at-job-run-time decompression
of disk images instead of openQA's at-asset-download-time
decompression; it avoids some awkwardness with the asset file
name, and should also actually allow us to drop the decompression
code from openQA I think.

I also rejigged various other things at the same time as they
kinda logically go together. It's mostly cleanups and tweaks to
group variables. I tried to handle more things explicitly with
variables, as it's better for use of these plays outside of
Fedora infra.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2020-11-05 16:10:32 -08:00
Adam Williamson
45b6adb9e1 openqa/server: fixes for the AMQP publishing config
Signed-off-by: Adam Williamson <awilliam@redhat.com>
2020-04-24 21:34:07 +02:00
Adam Williamson
ab4a46bf9e openQA: try and set up fedora-messaging publishing on staging
Also tweak how we do the plugin config a bit, I don't like the
whole 'do special stuff if deployment_mode is set' thing any
more.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2020-04-24 21:34:07 +02:00
Kevin Fenzi
4b31ac5152 ansible: Change all our group names from foo-bar to foo_bar or foo-bar-baz to foo_bar_baz
In ansible 2.8 the - character isn't supposed to be valid in group names.
While we could override this, might has well just bite the bullet and change it.
So, just switch all group names to use _ instead of -

Signed-off-by: Kevin Fenzi <kevin@scrye.com>
2019-05-20 17:38:09 +00:00
Adam Williamson
ed4f45b314 openqa/server: set config option not to cancel whole job cluster
This is the config option added in the most recent openqa build
which prevents it cancelling an entire cluster of parallel jobs
if just one of the children fails. See:

https://progress.opensuse.org/issues/46295

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2019-03-05 10:04:48 -08:00
Adam Williamson
e6ee55eb78 openqa/server: no root squash for rw access to factory share
Might be better to do this with some other account, but uh, for
now...
2017-08-17 14:22:42 -07:00
Adam Williamson
b5f825741a openqa/server: allow rw access to nfs share for ppc workers
We need to create the ppc hard disk images from the ppc workers,
so they need rw access to the share.
2017-08-17 14:17:18 -07:00
Adam Williamson
e9ba26289a openqa/server: *REALLY* fix the Apache status thing
OK, this version actually seems to work.
2017-03-14 13:10:27 -07:00
Adam Williamson
db1150c824 Revert "openqa/server: try fixing the Apache status thing again"
This reverts commit d6e32c9901.
It didn't work.
2017-03-14 12:55:51 -07:00
Adam Williamson
d6e32c9901 openqa/server: try fixing the Apache status thing again
Seems like the config needs to be in the VirtualHost definition.
2017-03-14 12:53:38 -07:00
Adam Williamson
518ff32b8d openqa/server: enable update test restart plugin on prod
Seems to be working fine in staging, so let's do it.
2017-03-04 15:36:13 -08:00
Adam Williamson
a412d4f47c openqa: install the 'update restarter' plugin, enable on stg
For now, just enable this on staging to check it works okay.
2017-03-01 13:36:06 -08:00
Adam Williamson
f65b0d0b03 openqa: drop prod/stg variance for fixed asset location 2016-10-24 17:15:20 -07:00
Adam Williamson
33fae65883 openqa: adjust to new 'fixed' asset stuff on staging
The capability to handle a variance between prod and staging
here is just temporary while I'm testing the new fixed asset
handling stuff by deploying it on staging. Once it's tested
and merged we'll just have prod and staging do the same thing.
But for now we need to cleanly handle them having the static
disk images in different places.
2016-10-19 11:17:58 -07:00
Adam Williamson
a0a335ed4d openqa/server: hide asset download links
this will only work with the new openqa package builds I just
did, but won't break anything with older ones. With a new enough
openQA package, it'll prevent the web UI from showing download
links for ISOs and HDD files.
2016-05-24 11:08:35 -07:00
Adam Williamson
5de040a201 openqa/server: enable fedmsg plugin 2016-03-10 16:56:47 -08:00
Adam Williamson
016f04c30d openqa: enable asset downloading from fedoraproject.org 2016-02-18 12:06:46 -08:00
Adam Williamson
8f44bd34b7 openqa: set base_url in openqa.ini
this is needed for openID auth to work properly - otherwise
ipsilon thinks the request is coming from 'https://localhost'
and redirect after auth fails. openQA uses this config setting
for the openID base URL if it's set.
2015-12-01 14:53:46 -08:00
Adam Williamson
2b098b34bd set up for openQA deployment
This adds openQA server, worker and dispatcher roles, and
applies them to the appropriate hosts. A few secret vars are
required. See trac #4958 for discussion.
2015-11-13 09:49:00 -08:00