Commit Graph

180 Commits

Author SHA1 Message Date
Miroslav Suchý
7d77eb3917 retrace: this is not needed
mock group does not exists in this time, and we do not need it any more as we moved to podman instead of mock
2020-04-24 21:34:27 +02:00
Miroslav Suchý
7444b7b72c retrace: group retrace already exists in ldap/nis or whatever 2020-04-24 21:34:27 +02:00
Miroslav Suchý
ebc6835f7b retrace: create user/group in advance
addressing:
TASK [abrt/retrace-pre : file] ******************************************************************************************
Friday 20 March 2020  09:02:34 +0000 (0:00:00.056)       0:05:28.187 **********
fatal: [retrace-stg.aws.fedoraproject.org]: FAILED! => {"ansible_facts": {"discovered_interpreter_python": "/usr/libexec/platform-python"}, "changed": false, "gid": 0, "group": "root", "mode": "0755", "msg": "chown failed: failed to look up user retrace", "owner": "root", "path": "/srv/retrace/repos", "secontext": "unconfined_u:object_r:var_t:s0", "size": 4096, "state": "directory", "uid": 0}
2020-04-24 21:34:27 +02:00
Miroslav Suchý
21170d4680 retrace: remove f29 from faf 2020-04-24 21:34:26 +02:00
Michal Fabik
ce47bc3544 retrace: Add Fedora 32 to retrace
Signed-off-by: Michal Fabik <mfabik@redhat.com>
Signed-off-by: Miroslav Suchý <msuchy@redhat.com>
2020-04-24 21:34:26 +02:00
Miroslav Suchý
6fc7230adb retrace: create /srv/faf
addressing:
TASK [abrt/faf : run database migrations] *******************************************************************************
Friday 06 March 2020  07:56:21 +0000 (0:00:00.045)       0:04:59.958 **********
fatal: [retrace-stg.aws.fedoraproject.org]: FAILED! => {"ansible_facts": {"discovered_interpreter_python": "/usr/libexec/platform-python"}, "changed": true, "cmd": ["faf-migrate-db"], "delta": "0:00:01.301859", "end": "2020-03-06 07:56:23.505802", "msg": "non-zero return code", "rc": 1, "start": "2020-03-06 07:56:22.203943", "stderr": "[2020-03-06 07:56:23] ERROR:faf.SaveReports: Required directories can't be created: Required directory '/srv/faf/reports/incoming' does not exist and can't be created: Permission denied\nTraceback (most recent call last):\n  File \"/usr/lib/python3.6/site-packages/pyfaf/common.py\", line 140, in ensure_dirs\n    os.makedirs(dirname)\n  File \"/usr/lib64/python3.6/os.py\", line 210, in makedirs\n    makedirs(head, mode, exist_ok)\n  File \"/usr/lib64/python3.6/os.py\", line 210, in makedirs\n    makedirs(head, mode, exist_ok)\n  File \"/usr/lib64/python3.6/os.py\", line 220, in makedirs\n    mkdir(name, mode)\nPermissionError: [Errno 13] Permission denied: '/srv/faf'\n\nDuring handling of the above exception, another exception occurred:\n\nTraceback (most recent call last):\n  File \"/bin/faf-migrate-db\", line 27, in <module>\n    from pyfaf.common import get_connect_string\n  File \"/usr/lib/python3.6/site-packages/pyfaf/__init__.py\", line 25, in <module>\n    from . import cmdline\n  File \"/usr/lib/python3.6/site-packages/pyfaf/cmdline.py\", line 22, in <module>\n    from pyfaf.actions import actions\n  File \"/usr/lib/python3.6/site-packages/pyfaf/actions/__init__.py\", line 106, in <module>\n    load_plugins(Action, actions)\n  File \"/usr/lib/python3.6/site-packages/pyfaf/common.py\", line 113, in load_plugins\n    result[plugin.name] = plugin()\n  File \"/usr/lib/python3.6/site-packages/pyfaf/actions/save_reports.py\", line 69, in __init__\n    self.dir_attach_saved, self.dir_attach_deferred])\n  File \"/usr/lib/python3.6/site-packages/pyfaf/common.py\", line 145, in ensure_dirs\n    .format(dirname, ex.strerror))\npyfaf.common.FafError: Required directory '/srv/faf/reports/incoming' does not exist and can't be created: Permission denied", "stderr_lines": ["[2020-03-06 07:56:23] ERROR:faf.SaveReports: Required directories can't be created: Required directory '/srv/faf/reports/incoming' does not exist and can't be created: Permission denied", "Traceback (most recent call last):", "  File \"/usr/lib/python3.6/site-packages/pyfaf/common.py\", line 140, in ensure_dirs", "    os.makedirs(dirname)", "  File \"/usr/lib64/python3.6/os.py\", line 210, in makedirs", "    makedirs(head, mode, exist_ok)", "  File \"/usr/lib64/python3.6/os.py\", line 210, in makedirs", "    makedirs(head, mode, exist_ok)", "  File \"/usr/lib64/python3.6/os.py\", line 220, in makedirs", "    mkdir(name, mode)", "PermissionError: [Errno 13] Permission denied: '/srv/faf'", "", "During handling of the above exception, another exception occurred:", "", "Traceback (most recent call last):", "  File \"/bin/faf-migrate-db\", line 27, in <module>", "    from pyfaf.common import get_connect_string", "  File \"/usr/lib/python3.6/site-packages/pyfaf/__init__.py\", line 25, in <module>", "    from . import cmdline", "  File \"/usr/lib/python3.6/site-packages/pyfaf/cmdline.py\", line 22, in <module>", "    from pyfaf.actions import actions", "  File \"/usr/lib/python3.6/site-packages/pyfaf/actions/__init__.py\", line 106, in <module>", "    load_plugins(Action, actions)", "  File \"/usr/lib/python3.6/site-packages/pyfaf/common.py\", line 113, in load_plugins", "    result[plugin.name] = plugin()", "  File \"/usr/lib/python3.6/site-packages/pyfaf/actions/save_reports.py\", line 69, in __init__", "    self.dir_attach_saved, self.dir_attach_deferred])", "  File \"/usr/lib/python3.6/site-packages/pyfaf/common.py\", line 145, in ensure_dirs", "    .format(dirname, ex.strerror))", "pyfaf.common.FafError: Required directory '/srv/faf/reports/incoming' does not exist and can't be created: Permission denied"], "stdout": "", "stdout_lines": []}
2020-04-24 21:34:26 +02:00
Miroslav Suchý
a41c1c217f retrace: checkpoint_segments does not exists in PG10 2020-04-24 21:34:26 +02:00
Miroslav Suchý
b7ccda8f59 retrace: do not init pg twice 2020-04-24 21:34:26 +02:00
Miroslav Suchý
103e5fd3f0 retrace: make sure posgresql data dir is available 2020-04-24 21:34:26 +02:00
Ernestas Kulik
45d448ae5b Rename local retrace roles
The “local” bit is quite redundant and they are otherwise confusingly
named.
2020-04-24 21:34:23 +02:00
Patrick Uiterwijk
c5e8c7a64a Hide ServerTokens for retrace
Signed-off-by: Patrick Uiterwijk <patrick@puiterwijk.org>
2020-04-24 21:34:22 +02:00
Martin Kutlak
ffb27fd09d Update abrt/retrace playbook
Switched from epel7 to master branch in upstream playbook.

Brings a new name, Python3 and Python3 packages from new repo.

Signed-off-by: Martin Kutlak <mkutlak@redhat.com>
2020-04-24 21:34:21 +02:00
Martin Kutlak
a1b45f3d2a retrace: Raise number of workers for retracing
Signed-off-by: Martin Kutlak <mkutlak@redhat.com>
2020-04-24 21:34:14 +02:00
Martin Kutlak
193dd2f12c retrace: Remove unused cronjobs
Signed-off-by: Martin Kutlak <mkutlak@redhat.com>
2020-04-24 21:34:14 +02:00
Martin Kutlak
36ce7c2d71 retrace: Run pull-associates daily
watch list, package owners/commiters should be updated more frequently.

Signed-off-by: Martin Kutlak <mkutlak@redhat.com>
2020-04-24 21:34:14 +02:00
Martin Kutlak
e646ed2dd9 retrace: Update retrace playbook with upstream changes
Signed-off-by: Martin Kutlak <mkutlak@redhat.com>
2020-04-24 21:34:14 +02:00
Miroslav Suchý
e94715317a add f31 to retrace 2020-04-24 21:34:10 +02:00
Miroslav Suchý
86566f37f4 retrace: lower the db caches 2019-07-15 13:11:38 +02:00
Martin Kutlak
dcc308d2b2 abrt: Capitalize/lowercase the first letter of opsys
Signed-off-by: Martin Kutlak <mkutlak@redhat.com>
2019-07-11 10:30:24 +02:00
Martin Kutlak
692a746f72 abrt: Replace with_nested with loop product combo
See
https://docs.ansible.com/ansible/latest/user_guide/playbooks_loops.html?highlight=nested%20loops#id30

Signed-off-by: Martin Kutlak <mkutlak@redhat.com>
2019-07-09 07:44:51 +02:00
Martin Kutlak
26cbd7b91e abrt: Fix bare variables and lists
Add bool filter for variables and with_items replaced with loop.

Signed-off-by: Martin Kutlak <mkutlak@redhat.com>
2019-07-09 07:44:51 +02:00
Martin Kutlak
99524e819e abrt: Unify the style of the faf-local role
Signed-off-by: Martin Kutlak <mkutlak@redhat.com>
2019-07-09 07:44:51 +02:00
Martin Kutlak
b2b06dfe23 abrt: Update faf-local-post cron task
- Removed crons that are already in upstream playbook
- Changed formatting of actions
- Put actions into block to check the "not devel" only once
- Fixed bare variable evaluation

Signed-off-by: Martin Kutlak <mkutlak@redhat.com>
2019-07-09 07:44:51 +02:00
Martin Kutlak
4b0be54c6b abrt: Update faf playbook from upstream
Signed-off-by: Martin Kutlak <mkutlak@redhat.com>
2019-07-09 07:44:51 +02:00
Martin Kutlak
f9c7357519 abrt: Update retrace-server playbook from upstream
Signed-off-by: Martin Kutlak <mkutlak@redhat.com>
2019-07-09 07:44:51 +02:00
Martin Kutlak
887f68e35f abrt: Pull upstream roles from el7 branches
Signed-off-by: Martin Kutlak <mkutlak@redhat.com>
2019-07-09 07:44:51 +02:00
Martin Kutlak
1ffe6955d8 abrt: delete EOLed repos from faf
grep || true to not fail the task because of empty matches.

Signed-off-by: Martin Kutlak <mkutlak@redhat.com>
2019-07-03 10:05:40 +02:00
Martin Kutlak
abef057fa7 retrace: Install cron for archiving reports
Archiving saved,deferred reports and attachments every day saves more space than
deleting reports older than X days.

Signed-off-by: Martin Kutlak <mkutlak@redhat.com>
2019-06-12 11:25:59 +02:00
Ryan Lerch
4154c97593 abrt/faf: remove with_items
Signed-off-by: Ryan Lerch <rlerch@redhat.com>
2019-06-11 15:40:48 +00:00
Ryan Lerch
6647ce2082 faf-local: update package command to not use items
Signed-off-by: Ryan Lerch <rlerch@redhat.com>
2019-06-11 14:42:10 +00:00
Ernestas Kulik
25a9c69ee0 ABRT: Drop F28
Signed-off-by: Ernestas Kulik <ekulik@redhat.com>
Signed-off-by: Miroslav Suchý <msuchy@redhat.com>
2019-06-04 15:33:06 +02:00
Martin Kutlak
4d1bcd1802 Deploy f-messaging certs for faf
Signed-off-by: Martin Kutlak <mkutlak@redhat.com>
2019-04-29 13:50:52 +02:00
Martin Kutlak
4f48370094 retrace: Correct the action for attaching centos bugs
The action should attach existing mantis bugs to reports.

Signed-off-by: Martin Kutlak <mkutlak@redhat.com>
2019-04-16 11:36:14 +02:00
Martin Kutlak
1c3bce3ab8 retrace: Add and setpassive_declares=t to fed-msg config
Signed-off-by: Martin Kutlak <mkutlak@redhat.com>
2019-04-16 11:36:14 +02:00
Miroslav Suchý
1a36d53dd2 retrace: pull-associates no longer have --opsys-release 2019-04-05 12:23:57 +02:00
Miroslav Suchý
a1b93dd589 retrace: two cronjob cannot have the same name 2019-04-05 12:23:57 +02:00
Miroslav Suchý
2473d37473 retrace: use rabbitmq proxy 2019-04-05 09:03:50 +02:00
Martin Kutlak
06f22add98 Migrate faf from fedmsg to fedora-messging
Signed-off-by: Martin Kutlak <mkutlak@redhat.com>
2019-04-04 15:13:14 +02:00
Miroslav Suchý
c094d85c61 retrace: add f30 2019-03-01 10:24:31 +01:00
Stephen Smoogen
5e9a3403fb I expect retrace will want to follow version 30 also 2019-02-20 21:43:55 +00:00
Patrick Uiterwijk
3ec0d9439a Set a correct, sane, from-email on FAF error emails
Without this, the From would end up as no-reply@localhost.fedoraproject.org, which upstream
mail servers do not appreciate.

Signed-off-by: Patrick Uiterwijk <puiterwijk@redhat.com>
2019-02-19 20:59:20 +00:00
Miroslav Suchý
cc365c67c6 retrace: store db backups only 14 days
it consume too much disk space, be more aggresive
2019-02-15 11:27:28 +01:00
Miroslav Suchý
ae429d9b0f retrace: remove old repos from faf 2018-11-27 14:11:25 +01:00
Miroslav Suchý
c818a1f269 retrace: create the temp files in /tmp 2018-11-27 10:33:03 +01:00
Miroslav Suchý
3a55875be2 retrace: this must be a shell command
additionaly use mktemp so more reposync can run in paralel
2018-11-27 10:27:45 +01:00
Miroslav Suchý
1bbd40217e retrace: run long running tasks in background 2018-11-27 10:00:39 +01:00
Miroslav Suchý
6f365cefa5 retrace: allow more urls for "faf repoadd"
this will allows us to add two urls just after forking:
one with prerelease url, and one with final one
when the release of Fedora happens FAF will automagically start using the correct one
as FAF ignore the url which does not work/exists
2018-11-27 09:12:56 +01:00
Miroslav Suchý
731255e327 retrace: remove f27 2018-11-27 08:52:50 +01:00
Miroslav Suchý
4da1758bff retrace: log crashfn cron 2018-09-07 15:42:58 +02:00
Miroslav Suchý
7a352d34fb retrace: add f29 and remove f26 2018-09-03 10:35:50 +02:00