Commit Graph

116 Commits

Author SHA1 Message Date
Jan Kaluza
11d9fa7148 Do not raise exception in poller, but log it instead. 2017-04-07 07:22:22 +02:00
Jan Kaluža
6307e5a692 Merge #484 Trigger newRepo manually when all components are tagged to buildroot 2017-04-06 15:40:30 +00:00
Jan Kaluza
8bbe2d359f Trigger newRepo by MBS instead of waiting on Kojira in case when we have sucessfully tagged all the components 2017-04-06 17:19:35 +02:00
Jan Kaluza
061d346d7c Revert "Trigger newRepo manually when Kojira does not manage to build it in 20 minutes."
This reverts commit 2fcd66ad53.
2017-04-05 12:41:29 +02:00
Jan Kaluza
7e5743248e Use Koji multicall when tagging builds. Do not query Koji to get the status of builds which we are reusing from previous module build. 2017-04-05 10:25:45 +02:00
Jan Kaluza
2fcd66ad53 Trigger newRepo manually when Kojira does not manage to build it in 20 minutes. 2017-04-05 10:18:31 +02:00
Jan Kaluža
1df6f8e8ad Merge #470 Try to get the deps from PDC again on ConnectionError exception. 2017-04-03 05:59:25 +00:00
Jan Kaluza
4c5732957c include %module_name, %module_stream and %module_version in the module-build-macros and fix sending active=True in pdc.py 2017-03-31 15:18:53 +02:00
Jan Kaluza
3a25671165 Try to get the deps from PDC again on ConnectionError exception. 2017-03-31 09:06:47 +02:00
Jan Kaluža
f7c8478d9c Merge #448 Copr builder improvements #2 2017-03-29 12:09:43 +00:00
Jakub Kadlčík
70b3782231 Fake repo.done message without publishing it 2017-03-28 19:13:38 +02:00
Jan Kaluza
597973da98 For mock backend, build all the components in batch in single continue_batch_build call. 2017-03-28 15:44:01 +02:00
Matt Prahl
2561930833 Merge #457 Create the builder in components.py handler only when we really need it. 2017-03-23 16:11:18 +00:00
Jan Kaluza
b1217921aa Create the build in components.py handler only when we really need it. 2017-03-23 15:28:24 +01:00
Jan Kaluza
296d69b609 Handle all exceptions in the consumer handlers. 2017-03-23 14:59:38 +01:00
Jan Kaluza
4a6d961d66 Handle situation when all component builds in a batch fail 2017-03-23 14:25:20 +01:00
Jan Kaluza
b4d87c4e25 Retry communication with PDC on RuntimeError exception and increase the timeout to 120 seconds 2017-03-23 12:56:12 +01:00
Ralph Bean
aabd28b148 Fix UnboundLocalError.
I have hotfixed this in production on mbs-backend01::

    Traceback (most recent call last):
      File "module_build_service/scheduler/consumer.py", line 134, in consume
        self.process_message(session, msg)
      File "module_build_service/scheduler/consumer.py", line 224, in process_message
        for event in further_work:
    UnboundLocalError: local variable 'further_work' referenced before assignment
2017-03-22 13:10:34 -04:00
Jan Kaluza
09601cfbb6 Do not allow starting next batch if the Koji is still building new repo. 2017-03-22 14:40:18 +01:00
Jakub Kadlčík
a24b49e162 Generate buildsys.repo.done locally 2017-03-21 07:59:35 +01:00
Jakub Kadlčík
61b74293b1 Rather extend koji message so we can have additional arguments for copr 2017-03-21 07:47:25 +01:00
Jan Kaluza
1c16c78cf9 Try to continue batch build only when there are some components to build 2017-03-17 18:55:54 +01:00
Jan Kaluza
163ee311de Expire the build object to force its refresh from database 2017-03-17 18:50:25 +01:00
Jan Kaluža
25340aecd9 Merge #445 Fix the process_paused_module_builds in poller. 2017-03-17 15:14:25 +00:00
Jan Kaluza
3318f48fc3 Fix the process_paused_module_builds in poller 2017-03-17 15:57:52 +01:00
Jan Kaluža
27e4c3868a Merge #444 Mark module build as failed if one of the components fail 2017-03-17 14:20:31 +00:00
Jan Kaluza
5aa6360595 Mark module build as failed if one of the components fail 2017-03-17 15:14:41 +01:00
Jan Kaluza
10811e41dc Do not tag packages which belong to -build tag to final tag. 2017-03-17 14:41:11 +01:00
Jan Kaluza
97706324a7 Fix the module fail when num_consecutive_builds limit is met and tagging issue when all the builds are reused in a single batch 2017-03-15 11:55:55 +01:00
Jan Kaluža
4afe8e2c5f Merge #413 Fix #409 - Remove koji_tag_inherit_from and whitelist all the components we are going to build instead. 2017-03-14 16:22:38 +00:00
Ralph Bean
3874da7538 Supply component NVR if we know it in the poller.
The poller used to only look for failed or cancelled builds.  In those
cases, there is no way to know the NVR associated with the task.

Now that we also handle completed builds in the poller, we should pass
along the NVR from the koji build.
2017-03-14 11:33:22 -04:00
Jan Kaluža
8bf10c8183 Merge #422 Fix #421 - Build next component immediatelly after the previous component build is finished. 2017-03-14 12:03:32 +00:00
Jan Kaluza
298bf63120 Fix #409 - Remove koji_tag_inherit_from and whitelist all the components we are going to build instead. 2017-03-14 11:28:47 +01:00
Jan Kaluza
0543e2c9ca Fix #421 - Build next component immediatelly after the previous component build is finished. 2017-03-14 08:36:30 +01:00
Ralph Bean
be0ca4ed33 Sometimes (with base-runtime) this can take a long time... 2017-03-13 16:08:09 -04:00
Jan Kaluza
f18925c677 Use compact dist-tag by using DEFAULT_DIST_TAG_PREFIX and first 8 characters of sha1 hash of module name/stream/version. 2017-03-13 16:49:56 +01:00
Ralph Bean
135bd96d7f Merge #410 Recover from errors with completed builds. 2017-03-10 17:49:11 +00:00
Ralph Bean
c4b0f618c6 Recover from errors with completed builds.
The base-runtime build from today had two of its 180 builds that
succeeded, but MBS failed to notice (due to an unhealthy way that I
killed it and restarted it earlier in the day).  The result was that the
component builds were done, but the module stayed stuck in the build
state even though its work was over.

This change alters the poller (which checks for builds that failed in
the buildSRPMFromSCM step which doesn't emit a message for our
consumer), to additionally check for builds that succeeded but which we
didn't notice.
2017-03-07 21:18:10 -05:00
Jakub Kadlčík
2312efce45 Not use PDC for copr builder 2017-03-07 00:43:22 +01:00
Ralph Bean
c0cf9da84d Demote these log statements. 2017-03-03 12:44:29 -05:00
Ralph Bean
5e3ea846f3 Merge #398 Ignore koji messages with a null task id 2017-03-03 15:04:42 +00:00
Ralph Bean
34f779785c Don't handle koji messages with null task_id values.
Otherwise, we query for null==null in our DB and chaos ensues.
2017-03-03 09:53:12 -05:00
Jan Kaluza
cc204e6b62 Fix logging in poller. 2017-03-03 13:16:44 +01:00
Ralph Bean
f12d6e0394 Don't validate internal messages.
These fail the validate check every time (because they're not real
messages; they're not signed).
2017-03-03 06:44:12 -05:00
Ralph Bean
0822df7a30 Better logging here. 2017-03-03 06:25:54 -05:00
Filip Valder
35335a2b23 Merge #389 Fix #386 - Retry until we get build containing xmd data 2017-03-03 11:10:39 +00:00
Filip Valder
689c671551 Retry until we get build containing xmd data. 2017-03-03 11:23:00 +01:00
Jan Kaluza
6d74f32462 Remove 'module_' prefix from the disttag in module-build-macros. 2017-03-03 11:22:58 +01:00
Ralph Bean
c57d52ee56 Simplify this. 2017-03-02 14:30:05 -05:00
Ralph Bean
e9c9097755 Assign further_work either way. 2017-03-02 14:17:22 -05:00