WarlockFish/fedora-infra_ansible
1
0
Fork 0
mirror of https://pagure.io/fedora-infra/ansible.git synced 2026-04-27 12:03:38 +08:00
Code Issues Packages Projects Releases Wiki Activity
33,145 Commits 9 Branches 0 Tags
f8a5720535e8801fcce3dcb8d78fddf84ffb56f0
Commit Graph

33145 Commits

This Branch
This Branch
All Branches
Author SHA1 Message Date
Will Woods
f8a5720535 add 'countme' stuff to web-data-analysis role 
This should automate running the "countme" scripts every day to parse
new log data and publish updated totals.

Here's what I've added to the ansible role:

* install package deps for `mirrors-countme`
* make "countme" user with home /srv/countme
* clone 'prod' branch of https://pagure.io/mirrors-countme to /srv/countme
  * if changed: pip install /srv/countme/mirrors-countme
* make web subdir /var/www/html/csv-reports/countme
* make local data dir /var/lib/countme
* install `countme-update.sh` to /usr/local/bin
* install `countme-update.cron` to /etc/cron.d
  * runs /usr/local/bin/countme-update.sh daily, as user `countme`

That should make sure `countme-update.sh` runs every day.
That script works like this:

1. Run `countme-update-rawdb.sh`
  * parse new mirrors.fp.o logs in /var/log/hosts/proxy*
  * write data to /var/lib/countme/raw.db
2. Run `countme-update-totals.sh`
  * parse raw data from /var/lib/countme/raw.db
  * write updated totals to /var/lib/countme/totals.{db,csv}
3. Track changes in updated totals
  * set up /var/lib/countme as git repo (if needed)
  * commit new `totals.csv` (if changed)
4. Make updated totals public
  * Copy totals.{db,csv} to /var/www/html/csv-reports/countme

For safety's sake, I've tried to set up everything so it runs as the
`countme` user rather than running everything as `root`. This might be
an unnecessary complication but it seemed like the right thing to do.

Similarly, keeping totals.csv in a git repo isn't _required_, but it
seemed like a good idea to keep historical records in case we want/need
to change the counting algorithm or something.

I checked the YAML with ansible-lint and tested that all the scripts
work as expected when run as `wwoods`, so unless I've missed something
this should do the trick.
 2020-10-13 16:17:00 +00:00
Aurélien Bompard
5868f77c53 IPA: fix the new tasks 
Signed-off-by: Aurélien Bompard <aurelien@bompard.org>
 2020-10-13 17:02:18 +02:00
Aurélien Bompard
cd2e75bc4f IPA: syntax 
Signed-off-by: Aurélien Bompard <aurelien@bompard.org>
 2020-10-13 16:50:08 +02:00
Aurélien Bompard
d208e3a087 IPA: attempt to create a certificate profile & ACL 
Signed-off-by: Aurélien Bompard <aurelien@bompard.org>
 2020-10-13 16:27:07 +02:00
Stephen Smoogen
c1014c4a8c Change download-sync location and update script. 
The download-sync for rdu-cc needs to use the /root versus default
quick-fedora-mirror git repository. This allows for it to only copy
the modules needed.

Signed-off-by: Stephen Smoogen <ssmoogen@redhat.com>
 2020-10-12 17:07:33 -04:00
Aurélien Bompard
9f94667b1f Missing dependency for fasjson 
Signed-off-by: Aurélien Bompard <aurelien@bompard.org>
 2020-10-12 15:26:13 +02:00
Miroslav Suchý
4c4b63516d copr: really restart lighttpd 
Otherwise there are some mapped files on / volume and keep consuming the storage.
I do not know what is actually consuming the storage, but the restart instead of reload helps.
 2020-10-12 14:07:13 +02:00
Jan Kaluza
32e4f83062 ODCS: Configure ODCS releng backend as separate task. 
Signed-off-by: Jan Kaluza <jkaluza@redhat.com>
 2020-10-12 07:40:38 +02:00
Jan Kaluza
e720bfc73c ODCS: Add support for scratch_modules to pungi.conf. 
Signed-off-by: Jan Kaluza <jkaluza@redhat.com>
 2020-10-12 07:18:09 +02:00
Nick Bebout
87779c2821 Quota for jibecfed to 10g 2020-10-11 18:58:30 -05:00
Pierre-Yves Chibon
b1fbe9fb97 toddlers: bump the logs for pdc_import_compose to debug 
Signed-off-by: Pierre-Yves Chibon <pingou@pingoured.fr>
 2020-10-09 17:17:11 +02:00
Aurélien Bompard
1ca3aff8f1 Ipsilon: configure SSSd 
Signed-off-by: Aurélien Bompard <aurelien@bompard.org>
 2020-10-08 12:29:37 +02:00
Aurélien Bompard
f4684a1f07 Ipsilon: fix config files 
Signed-off-by: Aurélien Bompard <aurelien@bompard.org>
 2020-10-08 10:11:36 +02:00
Aurélien Bompard
3a1885bcc9 Ipsilon in staging: deploy config files 
Signed-off-by: Aurélien Bompard <aurelien@bompard.org>
 2020-10-08 09:48:31 +02:00
Kevin Fenzi
cf6f1a8b52 mediawiki: in staging, fix the port and password 
Signed-off-by: Kevin Fenzi <kevin@scrye.com>
 2020-10-07 12:13:41 -07:00
Pierre-Yves Chibon
542cc75a07 koji sync from stg: attempt to fix the migration 
Signed-off-by: Pierre-Yves Chibon <pingou@pingoured.fr>
 2020-10-07 16:24:15 +02:00
Aurélien Bompard
1a1f7d79e4 Ipsilon: fix files location 
Signed-off-by: Aurélien Bompard <aurelien@bompard.org>
 2020-10-07 14:53:45 +02:00
Aurélien Bompard
fa6eaf9f42 get rid of phx2 in krb5.conf 
Signed-off-by: Aurélien Bompard <aurelien@bompard.org>
 2020-10-07 14:14:06 +02:00
Aurélien Bompard
62823f5fee Ipsilon: the custom admin db path must exist, let's set it later 
Signed-off-by: Aurélien Bompard <aurelien@bompard.org>
 2020-10-07 13:47:39 +02:00
Aurélien Bompard
e73a1bd501 Fix ipsilon config and install script in staging 
Signed-off-by: Aurélien Bompard <aurelien@bompard.org>
 2020-10-07 12:19:00 +02:00
Aurélien Bompard
38cc67731b Proxy: attempt to move ipsilon back to a VM in staging 
Signed-off-by: Aurélien Bompard <aurelien@bompard.org>
 2020-10-07 10:59:41 +02:00
Aurélien Bompard
7e7399fb50 Syntax. 
Signed-off-by: Aurélien Bompard <aurelien@bompard.org>
 2020-10-07 10:07:49 +02:00
Aurélien Bompard
ba82363e78 Add a role for ipa clients and use it in Ipsilon 
Signed-off-by: Aurélien Bompard <aurelien@bompard.org>
 2020-10-07 10:05:19 +02:00
Aurélien Bompard
3ae9b4bd65 We need this plugin obviously 
Signed-off-by: Aurélien Bompard <aurelien@bompard.org>
 2020-10-07 09:08:52 +02:00
Adam Williamson
b2df8df27d Change openQA x86 worker 04 host vars again to use biosdevname 
sigh. This time should be the pip.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
 2020-10-06 13:14:03 -07:00
Adam Williamson
8bd17b0e15 openqa: tweak x86 worker 04 network variables 
Primary interface names are ethX, have to use those for firewall
config to work right.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
 2020-10-06 12:24:33 -07:00
Francois Andrieu
73363264b6 docstranslation: add darknao to app owners 2020-10-06 17:34:03 +00:00
Adam Williamson
e3c5b5194f openqa: update x86 worker 04 network host vars 
Signed-off-by: Adam Williamson <awilliam@redhat.com>
 2020-10-06 09:31:36 -07:00
Stephen Smoogen
522c62c273 try to make the postfix milter part better searched and some debugging to opendkim and turn off the sending of reports 2020-10-06 12:20:09 -04:00
Aurélien Bompard
47d4923de9 Undefined variable 
Signed-off-by: Aurélien Bompard <aurelien@bompard.org>
 2020-10-06 17:06:44 +02:00
Pierre-Yves Chibon
65c85dd5ec nagios: Fix the check_supybot_pugin 
Signed-off-by: Pierre-Yves Chibon <pingou@pingoured.fr>
 2020-10-06 17:03:57 +02:00
Aurélien Bompard
373d9385e1 Missing dep 
Signed-off-by: Aurélien Bompard <aurelien@bompard.org>
 2020-10-06 16:50:13 +02:00
Mohan Boddu
82fcea6c6f RelEng is frozen for F33 Final 
Signed-off-by: Mohan Boddu <mboddu@bhujji.com>
 2020-10-06 10:06:14 -04:00
Pierre-Yves Chibon
c0f7fa3e8c proxy: bring back pdc-backend, this one doesn't have anything to do with the pdc-backend hosts 
Signed-off-by: Pierre-Yves Chibon <pingou@pingoured.fr>
 2020-10-06 15:49:06 +02:00
Aurélien Bompard
ae35433095 Missing dep 
Signed-off-by: Aurélien Bompard <aurelien@bompard.org>
 2020-10-06 10:54:25 +02:00
Clement Verna
86a0240758 Update OSBS buildroot container to use Fedora 33 
Signed-off-by: Clement Verna <cverna@tutanota.com>
 2020-10-06 10:49:33 +02:00
Pierre-Yves Chibon
342c056ae4 nagios_client: Fix the check_ipa_replication plugin 
It looks like the data it retrieves is in bytes and thus needs to be
decoded into a unicode string so we can use it as a regular string
in our code later.

Fixes https://pagure.io/fedora-infrastructure/issue/9372

Signed-off-by: Pierre-Yves Chibon <pingou@pingoured.fr>
 2020-10-06 10:46:45 +02:00
František Zatloukal
be88870830 Testdays: Use non-destructive init 2020-10-06 10:17:01 +02:00
František Zatloukal
0733cab1c8 Testdays: Let's specify only one command 2020-10-06 08:59:35 +02:00
Adam Williamson
1b30b0ab44 openqa: move x86_64 worker 04 from prod to lab 
We need an x86_64 worker for lab, apparently there are no more
boxes spare right now, so we have to steal one from prod.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
 2020-10-05 17:46:13 -07:00
Kevin Fenzi
71c650baff nagios / server: drop checking for fas fedmsgs, they likely wont be back 
Signed-off-by: Kevin Fenzi <kevin@scrye.com>
 2020-10-05 17:21:08 -07:00
Kevin Fenzi
9a080eae0f ipa / server: add pynag on ipa servers to allow nagios replication check to work 
Signed-off-by: Kevin Fenzi <kevin@scrye.com>
 2020-10-05 17:11:55 -07:00
Kevin Fenzi
8f81933dec sundries: mount nfs volumes on sundries02 also 
We want to have all the same nfs mounts on sundries02.
It will not normally be running any scripts or crons, but if 01 dies, we
can just start them on 02 and everything should work.

Signed-off-by: Kevin Fenzi <kevin@scrye.com>
 2020-10-05 17:04:02 -07:00
Kevin Fenzi
f650eab7ee nagios_server / fedmsg: pkgs01 does not run any fedmsg-hub anymore. 
Signed-off-by: Kevin Fenzi <kevin@scrye.com>
 2020-10-05 17:00:15 -07:00
Kevin Fenzi
0c85e1a2e1 nagios / client / check_ipa_replication: 2to3 on the script. 
Signed-off-by: Kevin Fenzi <kevin@scrye.com>
 2020-10-05 16:59:22 -07:00
Kevin Fenzi
73a501a933 roles / mariadb: add boolean to allow nagios checks and collectd 
Signed-off-by: Kevin Fenzi <kevin@scrye.com>
 2020-10-05 16:38:36 -07:00
Stephen Smoogen
0dbc8a95eb add openqa-p09-worker02 to inventory. I dont think it needs to be any other groups but adamw can fix that. 2020-10-05 19:11:49 -04:00
Kevin Fenzi
c5f4e27746 roles/base/postfix: add a rdu-cc postfix main.cf 
This one just uses the vpn endpoint for bastion to avoid dns and ipv6
issues.

Signed-off-by: Kevin Fenzi <kevin@scrye.com>
 2020-10-05 16:03:55 -07:00
Kevin Fenzi
87b4b24535 inventory / db-koji01: allow pgsql checks from noc01 
Signed-off-by: Kevin Fenzi <kevin@scrye.com>
 2020-10-05 15:51:06 -07:00
Adam Williamson
2a3231025e openqa lab: add aarch64 and ppc64 boxes to hdd workers group 
Signed-off-by: Adam Williamson <awilliam@redhat.com>
 2020-10-05 14:13:22 -07:00