Commit Graph

162 Commits

Author SHA1 Message Date
Jan Kaluza
8fedf35b6c Log the original exception in consumer before trying to do anything else. Also commit the db.session before doing build.transition 2017-10-26 13:26:43 +02:00
Martin Curlej
60b3d97c97 flake8 cleanup
Signed-off-by: Martin Curlej <mcurlej@redhat.com>

removed some noqa tags
2017-10-25 12:13:59 +02:00
mprahl
a9bf4e9727 Add a sleep in the init handler to protect against a race condition 2017-10-16 14:45:04 -04:00
mprahl
6e8d103a0c Remove unneeded build transition 2017-10-16 14:45:04 -04:00
Jakub Kadlcik
e6a23cfd64 Record components through the backend after module submission 2017-10-16 14:45:04 -04:00
Ralph Bean
7d9edc8f92 Merge #719 Scan for modules stuck in the wait state. 2017-09-29 20:20:42 +00:00
Ralph Bean
6150000d1e Scan for modules stuck in the wait state.
And fake a message to get them building again.

But only if they look to have been stuck for more than 10 minutes.
2017-09-29 14:13:58 -04:00
Ralph Bean
8e27fe16fe Raise a special exception for special messages.
Today, we ignore koji messages with a None `task_id` in two ways.  First
with a conditional, and then with a second check in the message
`__init__` method.  This is a belt-and-suspenders approach.

For other reasons in the UMB messaging plugin, we'd like to put this
check in just one place and use a special exception in the initializer
instead of in a conditional beforehand.
2017-09-29 13:07:06 -04:00
Ralph Bean
f2fb71ccdf Fix NameError.
Here, `task_id` was referenced before it was defined.

This fixes that error and adds a little more color to the log statement.
2017-09-26 14:44:18 -04:00
Jan Kaluza
ad6874b0e6 Fix #670 - Tag Content Generator Koji build to special tag based on the base module stream 2017-09-25 08:36:29 +02:00
Ralph Bean
4d393b9e73 Handle python3 queue rename. 2017-09-19 13:21:29 -04:00
Ralph Bean
5e08d2ffe4 Introduce pluggable backends.
This allows an operator to write a custom messaging backend to handle
whatever transport and format.
2017-09-19 13:13:40 -04:00
Mike Bonnet
1f077a12ea pass the entire message to get_abstracted_msg()
Other messaging backends may use different formats, so pass the
entire message through and let get_abstracted_msg() handle it.
2017-09-19 13:12:45 -04:00
Jan Kaluza
999baa2992 Wait for components to be tagged also in final tag before marking module as done. 2017-09-15 15:25:29 +02:00
Filip Valder
3cb41aa5dc Changes in MBS restful API:
- Refactor MBS API code
- Unify module-/component_build API philosophy/design/approach
- Naming fixes
- _utc_datetime_to_iso moved from ModuleBuildAPI and is now a module-level function.
- Existing v1 API remains unchanged. ComponentBuildAPI now supports individual component build listing + verbose mode.
- documented in README
- various component_build API tests added
2017-09-11 14:48:22 +02:00
Jan Kaluza
83628ec74f Add 'requires' of 'build-required' modules to buildroot when building module. 2017-09-08 09:25:44 +02:00
Jan Kaluza
dfdd924bbf Always regen repository when starting module build to not wait on kojira. 2017-08-18 09:39:07 +02:00
Jan Kaluza
aac4227eb8 Add 'mbs-build local [[--add-local-build n:s:v], ...]' to use local builds as dependency. 2017-08-17 10:00:19 +02:00
Filip Valder
41f5472021 Merge #631 Do not rebuild the -build tag repository for last batch. 2017-08-09 00:40:05 +00:00
Jan Kaluza
4bbb0cc416 Create module-build-macros component just once - do not duplicate it for each resubmition of a module. 2017-08-08 06:52:28 +02:00
Jan Kaluza
15523ac90e Fix the bug when module build stuck in the 'build' state even with failed component builds. 2017-08-07 15:47:06 +02:00
Jan Kaluza
27d249fe17 Do not rebuild the -build tag repository for last batch. 2017-08-07 15:46:38 +02:00
Filip Valder
7ef2975984 PEP8 fixes 2017-07-17 18:29:10 +02:00
Jan Kaluza
439767cbcf Tag the component to final tag in case it is built, but not tagged. 2017-07-13 13:37:10 -04:00
Ralph Bean
a755104bd4 Fix the test suite.
We had some circular imports that caused the tests (and more?) to fail.

I ran into this when looking at the tests for #583 and #595.
2017-07-06 21:02:32 -04:00
Jan Kaluza
93092a43be Add per-module-build logging feature 2017-06-30 16:30:47 +02:00
Jan Kaluza
a07b44411c Set the state_reason when format_mmd raises in frontend and do not overwrite the state_reason in backend. 2017-06-06 14:49:49 +02:00
Stanislav Ochotnicky
b33beb0cef Enable koji content generator code
If the koji_enable_content_generator is configured to True koji instance
has to be configured as follows:
koji call addBType module
koji grant-cg-access <mbs-user> module-build-service --new

Without the above configuration MBS will start failing the builds
2017-05-31 14:48:34 +02:00
Jan Kaluza
f27b0ddb81 Regenerate the repo when module-build-macros is reused to ensure it is in the buildroot. 2017-05-24 14:26:08 +02:00
Jan Kaluža
7d024e17c3 Merge #564 Fix fedmsg issue on Copr 2017-05-22 19:43:26 +00:00
Jakub Kadlčík
4992d97937 Remove leftovers from incomplete copr fedmsg implementation 2017-05-22 18:07:54 +02:00
Jan Kaluza
a819f51549 Change module build state to 'build' even if we reuse all the components, so we handle the buildsys.tag message. 2017-05-22 13:54:08 +02:00
Jan Kaluža
4593ee5d95 Merge #526 Do not tag built components if there is any failed one. 2017-05-17 09:48:05 +00:00
Jan Kaluza
7d7a45f997 Do not tag built components if there is any failed one. 2017-05-12 10:39:48 +02:00
Jan Kaluza
22758419c0 Delete build target after config.koji_target_delete_time seconds. 2017-05-11 14:43:05 +02:00
Jan Kaluza
024877592c Do not build module-build-macros when all the components will be reused from previous module build. 2017-05-02 12:09:23 +02:00
Matt Prahl
dd72504395 Merge #509 Pass the whole ModuleBuild object to the builder 2017-04-13 15:54:18 +00:00
Jakub Kadlčík
b78b0346d2 Pass the module build into builder 2017-04-12 23:53:55 +02:00
Jan Kaluza
9a193c36af Do not start new batch in poller when new_repo is running 2017-04-11 19:51:55 +02:00
Matt Prahl
e3cd821f53 Merge #499 Log message ids every time we try to handle them. 2017-04-10 15:01:45 +00:00
Jan Kaluža
32b363d1a9 Merge #501 Stop using .strip('-build') 2017-04-07 13:37:56 +00:00
Jan Kaluža
a4de06bc40 Merge #493 Start newRepo only when all the COMPLETE components have been tagged and there are no unbuilt components in a batch 2017-04-07 13:25:13 +00:00
mprahl
e7cbce51db Stop using .strip('-build') 2017-04-07 09:20:19 -04:00
Ralph Bean
c432187f92 Log message ids every time we try to handle them. 2017-04-07 08:28:28 -04:00
Jan Kaluza
cdf06ad999 Start newRepo only when all the COMPLETE components have been tagged and there are no unbuilt components in a batch 2017-04-07 11:34:16 +02:00
Jakub Kadlčík
469cbc8846 Fix failing test after separating builders
Thanks to @jkaluza for this patch
2017-04-07 08:22:59 +02:00
Jan Kaluza
11d9fa7148 Do not raise exception in poller, but log it instead. 2017-04-07 07:22:22 +02:00
Jan Kaluža
6307e5a692 Merge #484 Trigger newRepo manually when all components are tagged to buildroot 2017-04-06 15:40:30 +00:00
Jan Kaluza
8bbe2d359f Trigger newRepo by MBS instead of waiting on Kojira in case when we have sucessfully tagged all the components 2017-04-06 17:19:35 +02:00
Jan Kaluza
061d346d7c Revert "Trigger newRepo manually when Kojira does not manage to build it in 20 minutes."
This reverts commit 2fcd66ad53.
2017-04-05 12:41:29 +02:00