Commit Graph

8674 Commits

Author SHA1 Message Date
Kevin Fenzi
ee244ae706 data_reports: create a new data-reports vm
This vm is to allow the creation of reports about contibutor numbers
from datanommer db. It should be short lived. Once the reports are
developed, they can be moved to openshift or some other place.

Signed-off-by: Kevin Fenzi <kevin@scrye.com>
2023-04-11 17:45:46 +00:00
Andrew Heath
517d175dae Adding sysadmin-noc to busgateway to clean alerts 2023-04-11 17:32:49 +00:00
Kevin Fenzi
bbce51960d buildhw-x86: all these hosts are 10G and should use a 9000 mtu
The last time they were re-installed they defaulted to 1500 and it's
causing some problems for some of them at least (01-08 for sure).

Signed-off-by: Kevin Fenzi <kevin@scrye.com>
2023-04-03 14:47:31 -07:00
Kevin Fenzi
6030f92f4a db-datanommer: some more backups adjustments
First we need to pipe stderr into the grep to filter out the timescaledb
warnings. So, |& does that.

Then, there's no reason to backup the staging database. Disable that.

Signed-off-by: Kevin Fenzi <kevin@scrye.com>
2023-04-01 11:23:01 -07:00
Kevin Fenzi
af2ddc228c db-datanommer02: switch backups to 02 and copy public db from there too
We switched a while ago to db-datanommer02 which is a timescaledb from
the old db-datanommer01. However, backups were not working right until
recently. Now that they are, switch backups to backup 02 instead of 01
and also copy that one public. This should allow us to retire
db-datanommer01 entirely now.

Signed-off-by: Kevin Fenzi <kevin@scrye.com>
2023-03-30 11:23:14 -07:00
Kevin Fenzi
3fc94c29fc bastion01: move to rhel9
Signed-off-by: Kevin Fenzi <kevin@scrye.com>
2023-03-29 17:09:39 -07:00
Adam Williamson
29395d0c96 openqa: report queued 'results' on prod too
It seems to work OK on staging, so let's try it out on prod and
see how it looks in Bodhi.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2023-03-29 08:47:14 -07:00
Kevin Fenzi
30ae0ea40b dl: move 04/03/02/01 all to rhel9
Signed-off-by: Kevin Fenzi <kevin@scrye.com>
2023-03-28 17:06:36 -07:00
Kevin Fenzi
c14873010d ipsilon02: move to f37
Signed-off-by: Kevin Fenzi <kevin@scrye.com>
2023-03-28 16:48:24 -07:00
Kevin Fenzi
4a90c1a152 Revert "batcave02: add a new batcave02 that is rhel9"
This reverts commit a195bce0b3.

We need to get fedora-messaging into epel9 and then we can try this
again.
2023-03-28 15:20:01 -07:00
Kevin Fenzi
52ec43c2a9 bodhi: set version correctly for openshift to 7.1.1
Signed-off-by: Kevin Fenzi <kevin@scrye.com>
2023-03-28 15:02:53 -07:00
Kevin Fenzi
a195bce0b3 batcave02: add a new batcave02 that is rhel9
Signed-off-by: Kevin Fenzi <kevin@scrye.com>
2023-03-28 14:16:22 -07:00
Kevin Fenzi
5143b86c51 ns05: fix resolv.conf
Signed-off-by: Kevin Fenzi <kevin@scrye.com>
2023-03-28 13:38:25 -07:00
Kevin Fenzi
b85fc1665c bastion02: move to rhel9
Signed-off-by: Kevin Fenzi <kevin@scrye.com>
2023-03-27 16:42:15 -07:00
Kevin Fenzi
0ac87cbe9f inventory: add copr p8/p9 vmhosts to hardware
Signed-off-by: Kevin Fenzi <kevin@scrye.com>
2023-03-27 12:59:10 -07:00
Pavel Raiskup
bed537ce09 Revert "inventory/cloud: drop Copr boxes that we don't want to monitor by Nagios"
This reverts commit e870a80c32.
2023-03-21 11:48:50 +01:00
Pavel Raiskup
e870a80c32 inventory/cloud: drop Copr boxes that we don't want to monitor by Nagios 2023-03-21 10:41:16 +01:00
Jakub Kadlcik
6ca17906b7 copr: don't check copr-db-stg and copr-pulp in nagios yet 2023-03-21 09:57:13 +01:00
Kevin Fenzi
421fcf65f1 autosign02: fix network config to not step on autosign01
Sadly I made a mistake here and autosign02 had the same IP as
autosign01. ;(

Signed-off-by: Kevin Fenzi <kevin@scrye.com>
2023-03-17 19:49:59 -07:00
Kevin Fenzi
2003d70bc9 download-iad2: try nfsv4 also
Signed-off-by: Kevin Fenzi <kevin@scrye.com>
2023-03-15 15:16:02 -07:00
Kevin Fenzi
6b2b76b528 dl05: move to rhel9 and lots more memory
Signed-off-by: Kevin Fenzi <kevin@scrye.com>
2023-03-15 15:15:14 -07:00
Kevin Fenzi
d25329ed6f vmhost-x86-09.stg: use correct network port on bridge
Signed-off-by: Kevin Fenzi <kevin@scrye.com>
2023-03-14 17:43:03 -07:00
Adam Williamson
b1ba072e8d openQA: drop createhdds branch on staging
This branch was merged months ago, but I forgot to drop this,
so the staging hdd workers keep using the outdated branch and
building bad images...

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2023-03-14 14:33:00 -07:00
Kevin Fenzi
e5abe02282 download: add mirror.fcix.net to tier1 mirrors
fcix.net is a network of small mirrors that cache/serve popular content
from a number of free software projects. They mirror fedora and would
like to have access to tier0 mirrors. This adds them with their hostname
(so they can adjust the ips later if needed).

Thanks for mirroring!

Signed-off-by: Kevin Fenzi <kevin@scrye.com>
2023-03-07 23:18:56 +00:00
Kevin Fenzi
2fd9695820 nagios: remove some no longer existant machines from nagios trying to monitor their mgmt interfaces
Signed-off-by: Kevin Fenzi <kevin@scrye.com>
2023-03-07 18:43:30 +00:00
Kevin Fenzi
e6c3ebc283 Add 3 new hardware machines
This adds a new bvmhost in stg ( bvmhost-x86-02.stg ) a new vmhost in
stg ( vmhost-x86-09.stg ) and a new autosign box (that will be
autosign02 to allow us to set it up and migrate to it).

It also adds dhcp config for those and their mgmt interfaces

Signed-off-by: Kevin Fenzi <kevin@scrye.com>
2023-03-07 18:43:30 +00:00
Kevin Fenzi
4c378b075a backup01: new server
Pushing this now as it's an outage of our backups and I want to get it
going asap. It's only affecting backup01.

Add dhcp entries for backup01's mgmt and eth0 interface.
Use eth0 instead of eno1.

Signed-off-by: Kevin Fenzi <kevin@scrye.com>
2023-03-06 14:10:43 -08:00
Kevin Fenzi
4d1d4350a1 virthosts / staging: remove some old staging virthosts
These staging virthosts have no vm's on them anymore and are going to be
replaced with new hardware. So, remove them from inventory and shut them
down in prep for them being removed.

Signed-off-by: Kevin Fenzi <kevin@scrye.com>
2023-03-03 11:01:38 -08:00
Adam Williamson
180138b5b9 openQA worker hosts: switch 03 and 06, cut workers on 05
openqa-x86-worker03 seems to be a bit poorly lately, it quite
often fails jobs in 'hardware blip' looking ways, even after a
reboot. It's also the equal-worst hardware in the worker host
pool with 05. So let's swap 03 and 06 so prod has most of the
best hardware, and lab has the poorly box. Also while doing a
quick hardware survey I noticed 05 is equally as underpowered
as 03 (it has 2x E5-2680v3, total 24 physical CPUs, all the
other hosts aside from those two have 2x16 core CPUs), so this
cuts its worker count to the same as 03 (and makes the comment
more accurate for both). Added comments to inventory with the
CPU info for each box for future reference.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2023-03-03 10:00:14 -08:00
Kevin Fenzi
90a5092834 proxies / staging: update wildcard cert with a new shiny one.
Signed-off-by: Kevin Fenzi <kevin@scrye.com>
2023-03-01 14:40:31 -08:00
Jakub Kadlcik
0c95c99ffa copr: drop birthday for copr-pulp-dev 2023-02-27 00:11:25 +01:00
Jakub Kadlcik
24914b35eb copr: add birthday for pulp instances 2023-02-26 23:45:44 +01:00
Jakub Kadlcik
b600748659 copr: add playbooks for copr-pulp and copr-pulp-dev instances 2023-02-26 22:11:13 +01:00
Kevin Fenzi
93043d8f74 proxies / openshift: add new cert for apps.ocp
Signed-off-by: Kevin Fenzi <kevin@scrye.com>
2023-02-19 08:46:42 -08:00
Frank Ch. Eigler
f3a095d430 sort inventory/group_vars/all 2023-02-15 15:51:09 -05:00
Frank Ch. Eigler
21d24f7e69 Add host variable dnf_automatic_type to influence dnf-automatic-install mode
Set it to "security" for status quo ante for most hosts,
and "default" for debuginfod* hosts.
2023-02-15 15:27:16 -05:00
Matěj Grabovský
e8d9a73e3e retrace: Branch F38, EOL F35 2023-02-15 11:06:40 +01:00
Kevin Fenzi
4a4cee449b add a buildvm-ppc64le-41 compose builder on bvmhost-p09-05
Signed-off-by: Kevin Fenzi <kevin@scrye.com>
2023-02-14 12:03:12 -08:00
Kevin Fenzi
8155cfa018 builders: move compose builders out to different virthosts
Signed-off-by: Kevin Fenzi <kevin@scrye.com>
2023-02-14 11:54:47 -08:00
Adam Williamson
c3974fc8c5 openqa: test reporting non-complete 'results' on lab
Signed-off-by: Adam Williamson <awilliam@redhat.com>
2023-02-08 15:55:18 -08:00
Kevin Fenzi
0801e0fdd5 pkgs01: sync ansible up with reality on memory and switch procs to 8 to try and get a bit better performance
Signed-off-by: Kevin Fenzi <kevin@scrye.com>
2023-02-07 16:47:08 -08:00
Pavel Raiskup
2b4e3c2f0e copr: incremental backup: preserve hardlinks
Relates: https://github.com/fedora-copr/copr/pull/2526
2023-02-06 10:34:04 +01:00
Pavel Raiskup
6dac8b3a1b copr: incremental backup: more readable rsync progress 2023-02-05 11:27:28 +01:00
Pavel Raiskup
c79930b602 copr: incremental backup: backup real data 2023-02-05 11:20:00 +01:00
Pavel Raiskup
558ad3a1d0 copr: incremental backup to storinator, part 5
Install the "push" rsync action.
2023-02-05 09:26:04 +01:00
Pavel Raiskup
2c86047667 copr: incremental backup to storinator, part 4
Fix the timing specs once more.
2023-02-04 20:47:39 +01:00
Pavel Raiskup
0411ecda7d copr: incremental backup to storinator, part 3
Fixup timing plan specs.
2023-02-04 20:45:18 +01:00
Pavel Raiskup
c1335a72d9 copr: incremental backup to storinator, part 1
These scripts are based on my personal "Don't Delay Backups" project,
which is not yet available as a public role.
2023-02-04 20:29:21 +01:00
Kevin Fenzi
8152927cf0 debuginfod01.stg: increase memory to 16gb
Signed-off-by: Kevin Fenzi <kevin@scrye.com>
2023-02-03 11:14:39 -08:00
Kevin Fenzi
503729f7cf f37-test: add missing host vars file
I made this the other day but forgot to push it.

Signed-off-by: Kevin Fenzi <kevin@scrye.com>
2023-01-31 14:04:30 -08:00