modules/fm-orchestrator
1
0
Fork 0
mirror of https://pagure.io/fm-orchestrator.git synced 2026-04-23 18:21:42 +08:00
Code Issues Actions Packages Projects Releases Wiki Activity
1,119 Commits 4 Branches 137 Tags
ec0ed91d45670fe63ca76894a43141478decce67
Commit Graph

107 Commits

Author SHA1 Message Date
Jan Kaluža
f7c8478d9c Merge #448 Copr builder improvements #2 2017-03-29 12:09:43 +00:00
Jakub Kadlčík
70b3782231 Fake repo.done message without publishing it 2017-03-28 19:13:38 +02:00
Jan Kaluza
597973da98 For mock backend, build all the components in batch in single continue_batch_build call. 2017-03-28 15:44:01 +02:00
Matt Prahl
2561930833 Merge #457 Create the builder in components.py handler only when we really need it. 2017-03-23 16:11:18 +00:00
Jan Kaluza
b1217921aa Create the build in components.py handler only when we really need it. 2017-03-23 15:28:24 +01:00
Jan Kaluza
296d69b609 Handle all exceptions in the consumer handlers. 2017-03-23 14:59:38 +01:00
Jan Kaluza
4a6d961d66 Handle situation when all component builds in a batch fail 2017-03-23 14:25:20 +01:00
Jan Kaluza
b4d87c4e25 Retry communication with PDC on RuntimeError exception and increase the timeout to 120 seconds 2017-03-23 12:56:12 +01:00
Ralph Bean
aabd28b148 Fix UnboundLocalError. 
I have hotfixed this in production on mbs-backend01::

    Traceback (most recent call last):
      File "module_build_service/scheduler/consumer.py", line 134, in consume
        self.process_message(session, msg)
      File "module_build_service/scheduler/consumer.py", line 224, in process_message
        for event in further_work:
    UnboundLocalError: local variable 'further_work' referenced before assignment
 2017-03-22 13:10:34 -04:00
Jan Kaluza
09601cfbb6 Do not allow starting next batch if the Koji is still building new repo. 2017-03-22 14:40:18 +01:00
Jakub Kadlčík
a24b49e162 Generate buildsys.repo.done locally 2017-03-21 07:59:35 +01:00
Jakub Kadlčík
61b74293b1 Rather extend koji message so we can have additional arguments for copr 2017-03-21 07:47:25 +01:00
Jan Kaluza
1c16c78cf9 Try to continue batch build only when there are some components to build 2017-03-17 18:55:54 +01:00
Jan Kaluza
163ee311de Expire the build object to force its refresh from database 2017-03-17 18:50:25 +01:00
Jan Kaluža
25340aecd9 Merge #445 Fix the process_paused_module_builds in poller. 2017-03-17 15:14:25 +00:00
Jan Kaluza
3318f48fc3 Fix the process_paused_module_builds in poller 2017-03-17 15:57:52 +01:00
Jan Kaluža
27e4c3868a Merge #444 Mark module build as failed if one of the components fail 2017-03-17 14:20:31 +00:00
Jan Kaluza
5aa6360595 Mark module build as failed if one of the components fail 2017-03-17 15:14:41 +01:00
Jan Kaluza
10811e41dc Do not tag packages which belong to -build tag to final tag. 2017-03-17 14:41:11 +01:00
Jan Kaluza
97706324a7 Fix the module fail when num_consecutive_builds limit is met and tagging issue when all the builds are reused in a single batch 2017-03-15 11:55:55 +01:00
Jan Kaluža
4afe8e2c5f Merge #413 Fix #409 - Remove koji_tag_inherit_from and whitelist all the components we are going to build instead. 2017-03-14 16:22:38 +00:00
Ralph Bean
3874da7538 Supply component NVR if we know it in the poller. 
The poller used to only look for failed or cancelled builds.  In those
cases, there is no way to know the NVR associated with the task.

Now that we also handle completed builds in the poller, we should pass
along the NVR from the koji build.
 2017-03-14 11:33:22 -04:00
Jan Kaluža
8bf10c8183 Merge #422 Fix #421 - Build next component immediatelly after the previous component build is finished. 2017-03-14 12:03:32 +00:00
Jan Kaluza
298bf63120 Fix #409 - Remove koji_tag_inherit_from and whitelist all the components we are going to build instead. 2017-03-14 11:28:47 +01:00
Jan Kaluza
0543e2c9ca Fix #421 - Build next component immediatelly after the previous component build is finished. 2017-03-14 08:36:30 +01:00
Ralph Bean
be0ca4ed33 Sometimes (with base-runtime) this can take a long time... 2017-03-13 16:08:09 -04:00
Jan Kaluza
f18925c677 Use compact dist-tag by using DEFAULT_DIST_TAG_PREFIX and first 8 characters of sha1 hash of module name/stream/version. 2017-03-13 16:49:56 +01:00
Ralph Bean
135bd96d7f Merge #410 Recover from errors with completed builds. 2017-03-10 17:49:11 +00:00
Ralph Bean
c4b0f618c6 Recover from errors with completed builds. 
The base-runtime build from today had two of its 180 builds that
succeeded, but MBS failed to notice (due to an unhealthy way that I
killed it and restarted it earlier in the day).  The result was that the
component builds were done, but the module stayed stuck in the build
state even though its work was over.

This change alters the poller (which checks for builds that failed in
the buildSRPMFromSCM step which doesn't emit a message for our
consumer), to additionally check for builds that succeeded but which we
didn't notice.
 2017-03-07 21:18:10 -05:00
Jakub Kadlčík
2312efce45 Not use PDC for copr builder 2017-03-07 00:43:22 +01:00
Ralph Bean
c0cf9da84d Demote these log statements. 2017-03-03 12:44:29 -05:00
Ralph Bean
5e3ea846f3 Merge #398 Ignore koji messages with a null task id 2017-03-03 15:04:42 +00:00
Ralph Bean
34f779785c Don't handle koji messages with null task_id values. 
Otherwise, we query for null==null in our DB and chaos ensues.
 2017-03-03 09:53:12 -05:00
Jan Kaluza
cc204e6b62 Fix logging in poller. 2017-03-03 13:16:44 +01:00
Ralph Bean
f12d6e0394 Don't validate internal messages. 
These fail the validate check every time (because they're not real
messages; they're not signed).
 2017-03-03 06:44:12 -05:00
Ralph Bean
0822df7a30 Better logging here. 2017-03-03 06:25:54 -05:00
Filip Valder
35335a2b23 Merge #389 Fix #386 - Retry until we get build containing xmd data 2017-03-03 11:10:39 +00:00
Filip Valder
689c671551 Retry until we get build containing xmd data. 2017-03-03 11:23:00 +01:00
Jan Kaluza
6d74f32462 Remove 'module_' prefix from the disttag in module-build-macros. 2017-03-03 11:22:58 +01:00
Ralph Bean
c57d52ee56 Simplify this. 2017-03-02 14:30:05 -05:00
Ralph Bean
e9c9097755 Assign further_work either way. 2017-03-02 14:17:22 -05:00
Filip Valder
b738e0201b error->warn 2017-03-02 15:50:52 +01:00
Filip Valder
7b63710608 gracefully fail module build if there's an error while processing message handler 2017-03-02 15:39:03 +01:00
Ralph Bean
92990c94a2 Make this a little more quiet. 
Otherwise, it logs for *every single koji build* that comes across the
bus.  Too noisy to see what the MBS is actually doing.
 2017-03-01 16:12:35 -05:00
Filip Valder
6b343896dd s/rida/mbs/ 2017-02-28 17:59:02 +01:00
Matt Prahl
385045d778 Reuse components from previous module builds 2017-02-21 14:22:30 -05:00
Jan Kaluza
6a0e8d0b2e Do not start new batch when component is built when there is already some in progress. 2017-02-20 13:51:10 +01:00
Ralph Bean
6eaf8d7863 Demote this log statement. Way too noisy in production. 2017-02-15 15:43:38 -05:00
Ralph Bean
d093c5eef3 Default needed for this to make sense. 2017-02-02 03:30:25 -05:00
Ralph Bean
e082ff1289 Careful with msg_id here too. 2017-02-01 11:07:21 -05:00