Commit Graph

3573 Commits

Author SHA1 Message Date
Adrian Reber
de58ca2f0f Forgot to change the actual command to run 38 crawlers in parallel 2015-05-06 17:28:32 +00:00
Kevin Fenzi
f059414354 Always search vpn first. This breaks proxies if they try non vpn first. 2015-05-06 15:21:03 +00:00
Adrian Reber
cb8716913e Remember the start time of the last umdl run
The script which checks if umdl should be run used to store
the time of the end of the current umdl run. It actually should
remember the time of the start of this run as we want to make sure
to pick up all changes since the start of the current run.

Also print the date and time in the same line as the logging.
2015-05-06 12:58:12 +00:00
Adrian Reber
c7f31e41bb Increase the number of parallel crawls from 35 to 38. 2015-05-06 12:36:06 +00:00
Adrian Reber
3357ba0d37 Do not automatically run the crawler in staging 2015-05-06 12:34:08 +00:00
Adrian Reber
16e0082824 Distribute the hosts to be crawled by MM2 between the existing crawlers
This commit adds two new scripts to the crawlers:
 * mm2_get-highest-active-host-id: this queries the MM database and returns
   the id of the active mirror with the highest id
 * run_crawler.sh: this calculates the right startid and stopid parameters
   depending on the number of available crawlers

These scripts are integrated into the start of the crawler so that each
crawler only crawls a subset of the existing mirrors. This distribution
is not perfect as it pretends that the active mirrors are equally
distributed under the total number of existing mirrors.
2015-05-06 09:08:08 +00:00
Miroslav Suchý
546a5a98e3 Revert "define builduser"
This reverts commit 19221a7766.
2015-05-06 09:50:42 +02:00
Tim Flink
359e71fbb8 putting qadevel sshd back on port 222 2015-05-06 00:58:36 +00:00
Kevin Fenzi
a4dcb508f2 Correct epel7 mash config names. 2015-05-05 22:47:37 +00:00
Kevin Fenzi
e9c3e5014d Drop this old cvspass thing 2015-05-05 22:44:05 +00:00
Kevin Fenzi
69cc7c34f3 Add update-fullfilelist 2015-05-05 22:40:38 +00:00
Kevin Fenzi
15fc0fd248 Need masher and ftpsync for bodhi-backend 2015-05-05 22:38:14 +00:00
Tim Flink
0309289a8c switching qadevel sshd back to port 22 for debug 2015-05-05 22:28:00 +00:00
Kevin Fenzi
6cf80856d7 Adjust playbook some more, fix nagios to monitor bodhi-backend01.stg now. 2015-05-05 21:20:00 +00:00
Kevin Fenzi
40dbfb0a1c Rework of things for bodhi-backend role/setup in staging.
We are going to rename the 'relengNN' and 'relepel01' machines
bodhi-backend's to match our other stuff.
Rename the masher subrole to backend to match that.
Add inventory and playbook.
This is a first cut, will need a bunch more work.
2015-05-05 21:11:30 +00:00
Kevin Fenzi
a25a6cf15d cron.d entries should be mode 644. 2015-05-05 20:21:56 +00:00
Kevin Fenzi
61a9f16ff9 Fix some typos in this torrent stats script. 2015-05-05 20:18:46 +00:00
Ralph Bean
8eda7545ae Specify some new parameters to the fedbadges backend. 2015-05-05 19:38:28 +00:00
Kevin Fenzi
e6f8efe736 Change this alias to mirrormanager as thats the url people know and use already. 2015-05-05 16:36:52 +00:00
Mikolaj Izdebski
ac35410e4d Staging Koji doesn't have armhfp builders 2015-05-05 14:45:17 +00:00
Kevin Fenzi
7c0f38f9e8 Drop torrent02, it's gone. Add torrent01 to acls for downloads. 2015-05-05 14:08:11 +00:00
Pierre-Yves Chibon
c491c0a141 Fix indentation 2015-05-05 13:09:36 +02:00
Pierre-Yves Chibon
57d6053166 Apparently quotes work 2015-05-05 13:08:02 +02:00
Pierre-Yves Chibon
5d0c06fc22 Try with quotes 2015-05-05 12:52:04 +02:00
Adrian Reber
0b6c4ac699 move status message to the right location 2015-05-05 08:44:44 +00:00
Kevin Fenzi
5022b25da8 Weed out the btseed messages 2015-05-05 02:47:36 +00:00
Pierre-Yves Chibon
07cd4b2c3c Add and install the alembic.ini for MM2 2015-05-04 22:32:58 +02:00
Kevin Fenzi
9165e3d2a1 Monitor torrent01 in nagios, stop monitoring torrent02 2015-05-04 18:04:52 +00:00
Kevin Fenzi
5f1b738fab Drop spins generation we don't need it anymore. 2015-05-04 18:01:27 +00:00
Kevin Fenzi
10fc4fc096 Fix IndexOptions to be correct. 2015-05-04 17:51:53 +00:00
Kevin Fenzi
5722b05d51 Also start opentracker-ipv6. It now seems to work ok. 2015-05-04 17:46:12 +00:00
Kevin Fenzi
35031730d2 Move these up one level. They were mismatched with the cron job and in a duplicate subdir 2015-05-04 17:35:54 +00:00
Kevin Fenzi
f94a9c4d8a Add more width to indexes so files are readable. 2015-05-04 17:29:44 +00:00
Kevin Fenzi
81e78f3105 Fix more cases of gzipped data. 2015-05-04 17:26:02 +00:00
Kevin Fenzi
303f63abdd These stats are now gzipped for some reason. Ungzip before running python on it. 2015-05-04 17:19:03 +00:00
Kevin Fenzi
8441d3528c Clean up some more cron jobs/stats scripts. 2015-05-04 17:10:58 +00:00
Kevin Fenzi
2693bec253 Add selinux context setup for /srv/web 2015-05-04 17:02:58 +00:00
Kevin Fenzi
ca4aac336c Set torrent to listen on 443 and set sslonly. 2015-05-04 16:59:17 +00:00
Kevin Fenzi
073326f856 Try setting the DocumentRoot here. 2015-05-04 16:48:14 +00:00
Kevin Fenzi
cd5e0996b4 Move torrent web files to more standard /srv/web dir and adjust scripts 2015-05-04 16:26:50 +00:00
Kevin Fenzi
98dbde496c Fix typo in copy 2015-05-04 16:14:10 +00:00
Kevin Fenzi
ff16e2ce8b Add ssl/certs and website to new torrent.
Fix ipv6 address in config.
Fix apache configs to just add dir access.
2015-05-04 16:09:03 +00:00
Kevin Fenzi
96221ca5c9 Add systemd unit for btseed. Fix config. Enable services. 2015-05-04 15:18:28 +00:00
Michael Simacek
bd727deb0a Update koschei config 2015-05-04 13:24:56 +00:00
Mikolaj Izdebski
ec8f976531 Allow koschei httpd to connect to pkgdb 2015-05-04 13:14:41 +00:00
Mikolaj Izdebski
0b0c3c9033 Fix a typo 2015-05-04 12:53:33 +00:00
Mikolaj Izdebski
70d415c7e4 Use correct fedmsg topics for Koschei staging 2015-05-04 12:50:14 +00:00
Adrian Reber
69348cdbab installed wrong script; replaced with the correct script 2015-05-04 12:20:59 +00:00
Mikolaj Izdebski
5c8265d57c Configure Koschei OpenID auth 2015-05-04 11:57:18 +00:00
Mikolaj Izdebski
8557b40e29 Use correct Koschei database passwords 2015-05-04 10:24:04 +00:00