Commit Graph

251 Commits

Author SHA1 Message Date
Jan Kaluza
6a0e8d0b2e Do not start new batch when component is built when there is already some in progress. 2017-02-20 13:51:10 +01:00
Matt Prahl
a7bbfe76f3 Merge #321 Implement list_task_for_components method for CoprModuleBuilder 2017-02-17 00:51:26 +00:00
Matt Prahl
b30a6a8e05 Merge #322 Use requests instead of httplib2 in auth.py 2017-02-17 00:27:42 +00:00
Jakub Kadlčík
fdca6fa6e8 Implement list_task_for_components method for CoprModuleBuilder 2017-02-17 00:52:45 +01:00
Jakub Kadlčík
47924a2688 Use requests instead of httplib2 2017-02-16 21:52:24 +01:00
Ralph Bean
30daab024e Handle odd response from OIDC UserInfo.
By surprise, ipsilon handed me back a response with no groups one time.
Not sure why.  But logging here can hopefully help us catch it next
time.
2017-02-16 14:28:43 -05:00
Ralph Bean
bebf50f78c Haste makes waste. 2017-02-16 10:41:40 -05:00
Ralph Bean
2819b65204 Remove unused import. 2017-02-16 10:30:08 -05:00
Ralph Bean
b37ff40758 Handle still more variations in the pdcclient api. 2017-02-16 10:30:02 -05:00
Ralph Bean
67e3947a9b Handle changing PDCClient API.
I hit this in staging.  Some versions of the pdc-client library have a
different signature for PDCClient.  We need to specify these as keyword
arguments so we don't get spooky failures with accidental values.
2017-02-15 19:42:36 -05:00
Ralph Bean
6eaf8d7863 Demote this log statement. Way too noisy in production. 2017-02-15 15:43:38 -05:00
Ralph Bean
14dee071bc Merge #313 Force MMD's int version to a str when interacting with our db. 2017-02-15 17:52:23 +00:00
Ralph Bean
2a60d1ff20 Also, alembic. 2017-02-15 12:30:31 -05:00
Ralph Bean
92c3c1a90f Drop the modules table. 2017-02-15 12:11:40 -05:00
Ralph Bean
9bb7b8a716 Force MMD's int version to a str when interacting with our db. 2017-02-15 12:09:49 -05:00
Ralph Bean
6bd6aaaf12 Merge #311 Do things in copr as the correct user 2017-02-14 17:25:57 +00:00
Matt Prahl
01e94cb902 Merge #307 Replace query to FAS with OIDC groups scope check. 2017-02-10 21:28:15 +00:00
Ralph Bean
2887e71b29 Mark these functions as "private". 2017-02-10 15:53:36 -05:00
Ralph Bean
88aca055ce Replace query to FAS with OIDC groups scope check.
This removes our query to FAS and fixes #304.

It is more flexible too, where we can now configure production to only
allow in members of the `modularity-wg` group, and then later open it up
to all packagers after F26 is out (as was agreed with FESCo).

In the process of working on this, I discovered that #305 is not
necessary.  We don't need our own scope; we can just use the `groups`
scope as done here.
2017-02-10 15:50:41 -05:00
Filip Valder
818a3feb6f check Koji active tasks for component relicts (same NVR) from previous (terminated) builds 2017-02-08 15:56:41 +01:00
Jakub Kadlčík
c1fe65c16a Do things in copr as the correct user 2017-02-07 00:40:36 +01:00
Ralph Bean
d093c5eef3 Default needed for this to make sense. 2017-02-02 03:30:25 -05:00
Ralph Bean
e082ff1289 Careful with msg_id here too. 2017-02-01 11:07:21 -05:00
Jan Kaluza
0b307550c4 Mock: WIP threading support 2017-02-01 13:20:17 +01:00
Jan Kaluža
c769d481ca Merge #293 Mock: Load the mock.cfg before writing to it to not overwrite it and be able to update it in the middle of build. 2017-02-01 08:29:03 +00:00
Ralph Bean
78bd24b62a Be careful with attribute access here.
I hit a traceback where msg was NoneType and therefore didn't have a
`msg_id` attribute, I therefore wasn't able to see the real exception
that got me there in the first place.
2017-01-31 12:37:50 -05:00
Filip Valder
89351fbc24 Re-factor configuration loading, fix default topics (shall be a list),
update docs.
2017-01-31 14:00:15 +01:00
Jan Kaluza
f7e5dd1f49 Log error message when SRPM cannot be created from SCM 2017-01-28 16:08:30 +01:00
Jan Kaluza
b76d1c9531 Mock: Load the mock.cfg before writing to it to not overwrite it and be able to update it in the middle of build. 2017-01-28 15:46:17 +01:00
Filip Valder
abf37e98e1 in_memory messaging -> fallback to '*' topics 2017-01-12 19:57:34 +01:00
Filip Valder
34ef9ce5fd Add support for message topic prefixes + explicit services/categories (incl. code lints) 2017-01-12 19:30:34 +01:00
Jan Kaluža
59d070df35 Merge #278 Fix #276 - Use PDC to resolve buildroot components instead of MBS database 2017-01-12 14:34:13 +00:00
Jan Kaluza
d7b2b3ad52 Adjust the module ID in build_module_locally, because the fake base-runtime is not in DB anymore. 2017-01-12 13:43:40 +01:00
Jan Kaluza
008f2c9d29 Make SCM check faster by consolidating two SCM checks to single check executed in ThreadPool. Use 'git checkout' instead of HTTP HEAD request, because it is much faster in Fedora cgit case. 2017-01-11 15:09:49 +01:00
Jan Kaluza
ca754903ac Fail in resolve_profiles in case dependency cannot be found in PDC 2017-01-11 10:30:28 +01:00
Ralph Bean
6cfe487d46 Change message topic service to be more short.
This is just so that the topic doesn't end up being super long like
`org.fedoraproject.prod.module_build_service.module.state.change`

The new value will be:
`org.fedoraproject.prod.mbs.module.state.change`

Currently, the only thing listening for this is pdc-updater, which I
will patch.
2017-01-10 12:34:17 -05:00
Jan Kaluza
0f797c2917 Remove fake base-runtime module from DB and old resolve_profiles method because they are not used anymore. Fix the tests to work with remove fake base-runtime. 2017-01-10 15:58:26 +01:00
Jan Kaluza
dda47acab7 Fix #276 - Use PDC to resolve buildroot components instead of MBS database 2017-01-10 14:29:54 +01:00
Jan Kaluza
c6d8198ac8 Mock: Use metadata_expire=1 for localrepo to trigger metadata expire during batches, fix removal of repodata/repomd.xml during the Mock builder init, call create-repo before installing module-build-macros 2017-01-09 17:18:54 +01:00
Filip Valder
4f3a649d3d Merge #275 Fix #266 - Provide man pages using help2man 2017-01-06 16:07:17 +00:00
Filip Valder
a62f2dae18 func wrapper for console scripts (command aliases); fix/add docstrings for proper conversion Flask-Script -> help2man 2017-01-06 16:57:44 +01:00
Jan Kaluza
23802418af Fix tag_artifacts with concurrent build threshold, do not send repo-done in Mock backend after each build, but just after the tag_artifacts call. 2017-01-06 11:04:54 +01:00
Jan Kaluza
ab567803e8 Fix #41 - Tag builds only in the end of the badge to not regen repository all the time. 2017-01-05 15:24:46 +01:00
Jan Kaluza
174e657379 MBSConsumer: Handle initial messages in right order, override validate for non-fedmsg messaging backends. 2016-12-19 12:47:57 +01:00
Ralph Bean
e5270d0932 Some clarifying comments. 2016-12-15 16:45:32 -05:00
Ralph Bean
5c3d46595a Use the same key for this that we used to use. 2016-12-15 16:27:17 -05:00
Ralph Bean
908f440357 Make BaseMessage instances appear a bit more like JSON so they can make it through moksha validation. 2016-12-15 16:27:17 -05:00
Ralph Bean
3bf952cda6 Tell moksha to just listen to /dev/null for local builds. 2016-12-15 16:27:17 -05:00
Ralph Bean
775819e87c Bugfix to shutdown and restart for the test suite. 2016-12-15 16:27:17 -05:00
Ralph Bean
9d3b85426d Bring back the in-memory messaging backend. 2016-12-15 16:27:17 -05:00