2386 Commits

Author SHA1 Message Date
mprahl
1cb1e65767 Release v2.25.0 v2.25.0 2019-07-17 08:24:26 -05:00
mprahl
f2f033e66f Use mmd_to_str in _createrepo to reduce code duplication 2019-07-17 07:11:34 -05:00
Owen W. Taylor
886bd34c55 MockModuleBuilder.py: Fix for libmodulemd v2
With v2 of the libmodulemd API, writing a module to a string requires
creating a Modulemd.ModuleIndex object.
2019-07-17 07:11:34 -05:00
mprahl
280a25b939 Support base modules with virtual streams and no stream version 2019-07-16 14:21:49 +00:00
mprahl
1bcb40d4d0 Allow specifying a specific module build to reuse components from
This resolves #1296.
2019-07-16 11:40:59 +00:00
mprahl
6c4d6ee2b4 Alphabetize the build parameters in the documentation 2019-07-16 11:40:59 +00:00
Chenxiong Qi
bd0a2bbdc2 Give a unique name to postgres database container
Signed-off-by: Chenxiong Qi <cqi@redhat.com>
2019-07-16 09:51:02 +08:00
Chenxiong Qi
5baaeb2fc7 Give a unique name to container running tests inside
Signed-off-by: Chenxiong Qi <cqi@redhat.com>
2019-07-16 09:44:32 +08:00
mprahl
ec8946af05 Use get instead of filter_by in test_poller.py to be consistent
This is based on the feedback in PR #1341
2019-07-15 11:22:24 -04:00
mprahl
18def28d2b Fix the unit tests when running with Postgresql 2019-07-15 11:06:52 -04:00
Luiz Carvalho
e35596b6f2 Remove duplicated build refresh from tests
Signed-off-by: Luiz Carvalho <lucarval@redhat.com>
2019-07-12 14:12:15 -04:00
Luiz Carvalho
302e905f49 Rename trigger_new_repo_when_stalled accurately
Signed-off-by: Luiz Carvalho <lucarval@redhat.com>
2019-07-12 14:12:15 -04:00
Luiz Carvalho
9e50e9e268 Do not start newRepo task if one in progress
Signed-off-by: Luiz Carvalho <lucarval@redhat.com>

Check task status on producer - to be squashed

Signed-off-by: Luiz Carvalho <lucarval@redhat.com>
2019-07-12 14:12:15 -04:00
mprahl
82ec6944c6 Prevent overlapping RPMs from buildrequired base modules from being available when using default modules
When using default modules, this feature will add conflicts to
module-build-macros for every RPM in a buildrequired base module
that overlaps with RPMs in the buildrequired modules. This will
prevent them from being available in the buildroot, and thus
ensure that the RPMs from the buildrequired modules (non-base
modules) are used even if they have a lower NVR.
2019-07-11 09:21:09 -04:00
mprahl
4891716c2d Default the cache directory to the "mbs" directory under tempfile.gettempdir() 2019-07-10 19:01:43 -04:00
Mike Bonnet
3681b66ff8 remove Declarative options from Scripted pipelines
These options don't work in Scripted pipelines, and cause tracebacks.
2019-07-10 08:29:22 -07:00
mprahl
ddafbb86ff Allow the poller to clean up module builds without arches 2019-07-10 13:29:58 +00:00
Jan Kaluža
b3c32ec859 Merge #1294 Allow modules built against platform in 'garbage' state to be used as build dependency. 2019-07-10 09:21:30 +00:00
Jan Kaluza
8301aeb9eb Return the latest base module in case stream_version_lte is used, but stream is not in x.y.z format.
This seems to be better behaviour than simply rejecting the module build
completely. MBS still shows warning in the log that it cannot find
any compatible module, but the build continues with the base module
requested in the submitted modulemd.
2019-07-10 10:41:21 +02:00
Jan Kaluza
e9f5b4e2db Fix unreliable test in test_module_init.py. 2019-07-09 11:26:02 +02:00
Jan Kaluza
95febc2e1b Allow modules built against platform in 'garbage' state to be used as build dependency. 2019-07-09 07:35:01 +02:00
mprahl
96d44d049e Add the ability to automatically buildrequire default modules defined by the buildrequired base module
A base module can set xmd.mbs.default_modules_url, which contains a
URL to a list of modules in the format of name:stream separated by
new lines. When a module buildrequires this base module, the list
of default modules are added as buildrequires of the module automatically
unless there are conflicting streams or the default module is not
in the MBS database.
2019-07-05 14:52:50 -04:00
mprahl
9f55ce724d Add a global requests session with retry logic configured
This also replaces the usage of other request sessions.
2019-07-03 09:00:49 -04:00
mprahl
db03f0a7f5 Promote resolver._get_module to a public method 2019-07-02 10:45:31 -04:00
Matt Prahl
1585d6b97c Merge #1319 Reuse method read_staged_data and ModuleBuild.get_by_id 2019-07-02 14:15:44 +00:00
Chenxiong Qi
60b0e8da5c Wait for Postgres to be running before starting the unit tests
Fixes #1314

Signed-off-by: Chenxiong Qi <cqi@redhat.com>
2019-07-02 20:54:26 +08:00
Chenxiong Qi
16bf4e945b Reuse ModuleBuild.get_by_id
Signed-off-by: Chenxiong Qi <cqi@redhat.com>
2019-07-02 20:52:12 +08:00
Chenxiong Qi
c15a7cadf3 Reuse function read_staged_data
In addition, reuse staged_data_filename to construct file and directory name.

Signed-off-by: Chenxiong Qi <cqi@redhat.com>
2019-07-02 20:52:12 +08:00
Valerij Maljulin
a80f15a6d3 Release v2.24.0 v2.24.0 2019-07-02 13:43:47 +02:00
Valerij Maljulin
7277ac480f Release v2.22.0 2019-07-01 17:26:31 +02:00
mprahl
50f0a60ec1 Allow configuring the number of parallel submissions to Koji
When NUM_CONCURRENT_BUILDS is 0, then multi-threading is disabled
when submitting builds to Koji. This is not acceptable, so this
commit makes the number of threads configurable.
2019-07-01 08:12:12 -04:00
Chenxiong Qi
fadbc26994 Enable PostgreSQL for running tests
Signed-off-by: Chenxiong Qi <cqi@redhat.com>
2019-06-28 21:35:00 +08:00
Matt Prahl
f3fecf5089 Merge #1309 Fix tests in order to run with PostgreSQL 2019-06-28 13:21:08 +00:00
Matt Prahl
1282a775a0 Merge #1310 Fix type error preventing inclusion of custom SRPMs when running on F31/Rawhide. 2019-06-28 12:49:10 +00:00
Chenxiong Qi
e49f69f7b5 Fix tests in order to run with PostgreSQL
Most of the issues are caused by the use of SQLAlchemy database session. Some
inline comments describe the issues in detail.

Signed-off-by: Chenxiong Qi <cqi@redhat.com>
2019-06-28 14:48:37 +08:00
Merlin Mathesius
9f269c39e1 Older versions of kobo.rpmlib.get_header_field() return bytes, newer versions
return str. Decode as necessary.

Signed-off-by: Merlin Mathesius <mmathesi@redhat.com>
2019-06-27 10:44:58 -05:00
Mike Bonnet
302c76b90f add more information to the Pagure commit flags and PR status
This makes them more consistent with CentOS CI flags.

Also add the commit hash to the uid, so updates are commit-specific.
2019-06-25 21:41:38 -04:00
Valerij Maljulin
f0dc0b851d Add state_reason on GW failure
Signed-off-by: Valerij Maljulin <vmaljuli@redhat.com>
2019-06-25 17:39:40 +02:00
Matt Prahl
cde8d8058d Merge #1304 Add additional documentation about rebuild strategies 2019-06-25 14:29:52 +00:00
mprahl
c887448a7c Add additional documentation about rebuild strategies 2019-06-25 10:19:23 -04:00
Jan Kaluža
1a8ac64850 Merge #1305 Minor fixes to _get_filtered_rpms_on_self_dep 2019-06-25 11:49:55 +00:00
Martin Curlej
ed24ca870a Module builds now remember what module they reused for building.
There was a race condition, when 2 builds where build in the same time.
There was an issue that after one has finished the other reused the new build
for reuse and not the one it started with.

Ticket-ID: FACTORY-3862

Signed-off-by: Martin Curlej <mcurlej@redhat.com>
2019-06-25 11:09:33 +02:00
Chenxiong Qi
5bdb77777f Minor fixes to _get_filtered_rpms_on_self_dep
* Add docstring
* Call dict.setdefault to simplify the code a little which constructs the map
  from package name to built RPMs' NVRs.

Signed-off-by: Chenxiong Qi <cqi@redhat.com>
2019-06-25 15:13:22 +08:00
mprahl
35eb016fd8 Move the Rebuild Strategies documentation to a separate file 2019-06-24 14:29:58 -04:00
mprahl
e19c58b6ad Stop testing with Postgresql temporarily
The Jenkins job currently stalls with this enabled, so let's disable
it for now.
2019-06-21 10:50:51 -04:00
Chenxiong Qi
5f93a47051 Allow to run specific test inside container
For example, contrib/run-unittests.sh /src/tests/test_utils ...

Please note that the path starts from /src, which is the root directory of
code inside container.

Signed-off-by: Chenxiong Qi <cqi@redhat.com>
2019-06-21 10:48:10 -04:00
Matt Prahl
567a05b09c Merge #1291 Run unit tests with PostgreSQL in Jenkins job 2019-06-20 16:32:22 +00:00
Matt Prahl
7341e68ff7 Merge #1292 Remove unused variable local_modules from GenericBuilder.default_buildroot_groups 2019-06-20 16:31:24 +00:00
Jan Kaluza
e1b29d2fde Version 2.23.0 v2.23.0 2019-06-20 06:55:00 +02:00
Chenxiong Qi
8728afffd7 Remove unused variable local_modules from GenericBuilder.default_buildroot_groups
Signed-off-by: Chenxiong Qi <cqi@redhat.com>
2019-06-20 10:25:05 +08:00