Commit Graph

82 Commits

Author SHA1 Message Date
Ralph Bean
cbb75d34e6 Also, only remove the dir if we succeed in passing the buck to koji. 2017-08-03 14:27:26 -04:00
Ralph Bean
dad4500397 Some improved logging for the content generator.
We failed with an error on the first try today, but not enough logging
to figure out why.  This adds more.
2017-08-03 14:26:42 -04:00
Filip Valder
7ef2975984 PEP8 fixes 2017-07-17 18:29:10 +02:00
Ralph Bean
35558f86bc Merge #611 Koji perm_id cache 2017-07-17 14:53:34 +00:00
Neha Prasad
459ffb241d Configure dogpile.cache 2017-07-17 08:56:17 -04:00
Neha Prasad
83b0c1562e fix koji cache 2017-07-14 13:58:16 -04:00
Neha Prasad
df47d3e28c delete setup_memcache.py 2017-07-14 11:44:26 -04:00
Ralph Bean
bb56e4f057 Refactor get_build_by_artifact so that it always returns the same kind of dict. 2017-07-14 09:21:52 -04:00
Jan Kaluza
439767cbcf Tag the component to final tag in case it is built, but not tagged. 2017-07-13 13:37:10 -04:00
Neha Prasad
a05b485c43 Koji perm_id cache 2017-07-07 12:37:48 -04:00
Neha Prasad
5ff58867f4 Koji perm_id cache 2017-07-07 12:37:17 -04:00
Ralph Bean
5ac5ab0c13 Merge #601 Add build log into koji content generator 2017-07-07 15:56:55 +00:00
Ralph Bean
a755104bd4 Fix the test suite.
We had some circular imports that caused the tests (and more?) to fail.

I ran into this when looking at the tests for #583 and #595.
2017-07-06 21:02:32 -04:00
Stanislav Ochotnicky
747b60f4b4 Add build logs into the koji content generator
This change adds another output next to the mmd file - a build.log which
will contain builds collected during the module build
2017-07-03 13:07:43 +02:00
Stanislav Ochotnicky
db44ce8c3c Convert mmd strings to unicode
This makes it easier to spot testsuite issues as well since json.loads
returns unicode strings
2017-07-03 11:48:41 +02:00
Ralph Bean
c907ff1205 Provide a traceback for mohan.
... in case he ever wants it.
2017-06-22 14:12:57 -04:00
Owen W. Taylor
40ececa5a0 MockModuleBuilder: Fix thread safety problem with distgit-clone-wrapper
Multiple build threads would try to write to the same distgit-clone-wrapper
location, which could result in ETXTBSY when one thread tried to execute
a script that another was writing to or vice-versa.

Instead of using a wrapper script, use a sh -c invocation for distgit_get.

https://pagure.io/fm-orchestrator/issue/592
2017-06-16 06:14:07 -04:00
Jan Kaluža
8ac5c67e2c Merge #585 CoprModuleBuider - build from SCM fix 2017-06-16 06:40:40 +00:00
Owen W. Taylor
786dd2f301 MockModuleBuilder: move generated artifacts to the final directory, instead of copying them
There's no good reason to have artifacts in both the thread-specific results directory
and in the main results directory, so just move them across instead of copying them.

https://pagure.io/fm-orchestrator/issue/591
2017-06-15 16:30:04 -04:00
Owen W. Taylor
280facdbe0 MockModuleBuilder: Pass an explicit pkglist to createrepo_c
createrepo_c recursively looks for RPMs in the target directory and
subdirectories, meaning that it was finding RPMs in the thread-specific
directories. Pass in an explicit list of RPMs at the toplevel.

https://pagure.io/fm-orchestrator/issue/591
2017-06-15 16:25:04 -04:00
Jan Kaluza
4b16cf9a64 Fix various bugs in 'mbs-build local' 2017-06-07 13:16:26 +02:00
Jakub Kadlčík
68d9285749 Don't checkout branch if it is HEAD 2017-06-05 22:00:07 +02:00
Jakub Kadlčík
cdb2c50266 foo 2017-06-01 20:48:21 +02:00
Jakub Kadlčík
0aee22b753 Move the hackish code to CoprModuleBuilder 2017-05-30 15:22:34 +02:00
Jakub Kadlčík
c7e8ba2f1d MockModuleBuilder does not use build_from_scm function anymore 2017-05-30 14:50:09 +02:00
Jakub Kadlčík
8c25f6d210 Implement method for submitting a build from distgit source 2017-05-30 14:31:35 +02:00
Jakub Kadlčík
56efd10db9 Allow CoprModuleBuilder to obtain packages from copr-dist-git 2017-05-30 13:13:46 +02:00
Jakub Kadlčík
91e08d723f Allow build_from_scm to build even from custom distgits 2017-05-29 23:32:51 +02:00
Jakub Kadlčík
aee7c0b299 Return proc.communicate() output 2017-05-29 23:28:00 +02:00
Jakub Kadlčík
53c00dc074 Allow stdout and stderr to be something else than file 2017-05-29 23:26:42 +02:00
Petr Šabata
84df0b4ef1 Use modulemd.dump_all to create local repodata
Both pungi and dnf use the new multidocument format, with the
old one not really being supported by anything at this point.
Let's be compatible.

This change requires modulemd-1.2.0+.

Signed-off-by: Petr Šabata <contyk@redhat.com>
2017-05-26 09:40:37 +02:00
Jan Kaluza
91758a9d4e Output urlgrabber to stdout, so it is not lost when LOG_LEVEL is info. 2017-05-25 17:26:39 +02:00
Jan Kaluža
b77be81173 Merge #556 Don't build/obtain SRPM packages on the host 2017-05-25 13:16:55 +00:00
Jakub Kadlčík
ebab993244 Workaround disabled kojipkgs repos 2017-05-20 17:58:14 +02:00
Jakub Kadlčík
99ba03b52d Move also distgit_src_get command to config 2017-05-17 16:23:16 +02:00
Jan Kaluža
43ebacd5a1 Merge #554 Modify content generator based on Koji dev feedback 2017-05-17 09:45:39 +00:00
Jakub Kadlčík
8c8ea65b2e Don't hardcode dist-git clone command 2017-05-16 16:26:24 +02:00
Jakub Kadlčík
9e4c43a315 Use commit hash from source as branch 2017-05-16 15:20:28 +02:00
Jakub Kadlčík
8a258c3ad7 Use master branch 2017-05-16 14:51:40 +02:00
Jakub Kadlčík
1af400de02 Obtain SRPM from distgit via mock SCM 2017-05-16 14:51:40 +02:00
Jakub Kadlčík
14757ec3ad Implement classes for building srpms via mock 2017-05-16 14:51:40 +02:00
Jakub Kadlčík
6e92ed6b97 Add function to find srpm in given directory 2017-05-16 14:51:40 +02:00
Jan Kaluža
c1eb07289f Merge #551 Do not fail a module build in buildroot_ready when repo is not generated yet. 2017-05-16 08:31:38 +00:00
Stanislav Ochotnicky
5eb4c1652f Modify content generator based on Koji dev feedback
- Change the type of build from modulemd to just module
- Change build output type from modulemd to file
- Provide the typeinfo also for the modulemd.yaml output
- Convert dashes to underscores for build version (i.e. mbs stream).
  koji build versions can't have dashes - we can provide real value in
  the extra section
- Add name, stream, version data into build extra section
- Add tool information for modulemd
- Add buildroot components from host running mbs
- Added few methods licensed under BSD 3-clause (from atomic-reactor)
2017-05-15 10:39:01 +02:00
Jan Kaluza
2c202bcf00 Do not fail a module in buildroot_ready when repo is not generated yet. 2017-05-12 10:24:47 +02:00
Jan Kaluža
7c117c01d1 Merge #544 Add support for modulemd buildopts.rpms.macros 2017-05-11 14:13:18 +00:00
Jan Kaluza
0ecbadeaad Add support for modulemd buildopts.rpms.macros 2017-05-11 16:08:30 +02:00
Jan Kaluža
6a7555777b Merge #548 Delete build target when module build is complete after configurable time 2017-05-11 13:57:34 +00:00
Jan Kaluza
22758419c0 Delete build target after config.koji_target_delete_time seconds. 2017-05-11 14:43:05 +02:00
Jan Kaluža
9a4da7241d Merge #528 Add functionality of koji content generator imports 2017-05-11 12:23:36 +00:00