Commit Graph

74 Commits

Author SHA1 Message Date
Michal Konecny
923ca456b0 [fedora-docs/translation] Fix yamllint issues
Signed-off-by: Michal Konecny <mkonecny@redhat.com>
2024-06-21 15:50:24 +02:00
Michal Konecny
94c9a21711 [fedora-docs/translation] Migrate to RHEL 9
Signed-off-by: Michal Konecny <mkonecny@redhat.com>
2024-06-21 14:27:36 +02:00
Francois Andrieu
9000dd6def docs: remove docs-old 2022-12-05 22:08:18 +00:00
Francois Andrieu
7993bcfe9c Allow htaccess redirect on docs.fp.o 2022-04-03 17:43:26 +00:00
Francois Andrieu
460c7ef705 Allow htaccess redirect on docs.stg.fp.o 2022-02-03 22:29:51 +00:00
Francois Andrieu
014eab1643 docs: fix 404 page 2022-02-03 19:18:16 +00:00
Kevin Fenzi
9d97ad3e6f docs-sync: sync stg to prod with hardlinking
Signed-off-by: Kevin Fenzi <kevin@scrye.com>
2021-06-17 18:38:47 -07:00
Kevin Fenzi
51c015596f proxies: do not serve out .git dirs anywhere, no need
Signed-off-by: Kevin Fenzi <kevin@scrye.com>
2021-05-11 16:32:30 -07:00
Francois Andrieu
ac54d9ed67 disable docstranslation cron on sundries01
This script is being moved to openshift.
The ssh keypair need to be recovered from ~_update_docs_trans/.ssh/id_rsa_docs_trans
and copied over /srv/private/ansible/files/docstranslation/id_rsa_docstrans_prod on batcave01.

Signed-off-by: Francois Andrieu <darknao@fedoraproject.org>
2020-12-16 13:36:37 +00:00
Kevin Fenzi
e0cfad793d proxies / docs-rsync job: set timeout on rsync
Set a 300 second timeout here, so we don't get jobs that are stuck
sitting around for a long time. See
https://pagure.io/fedora-infrastructure/issue/9221

Signed-off-by: Kevin Fenzi <kevin@scrye.com>
2020-08-24 10:34:07 -07:00
Pierre-Yves Chibon
51077d022e fedora-docs/translation: only run the cron job in sundries01
There is no need to run it on two hosts simultaneously.

Signed-off-by: Pierre-Yves Chibon <pingou@pingoured.fr>
2020-07-31 14:53:02 +02:00
Kevin Fenzi
6062f31827 Revert "docs sync cron: disable until the initial sync I am doing finishes."
This reverts commit df2adf6842.
2020-06-23 11:13:41 -07:00
Kevin Fenzi
df2adf6842 docs sync cron: disable until the initial sync I am doing finishes.
Signed-off-by: Kevin Fenzi <kevin@scrye.com>
2020-06-23 10:50:51 -07:00
Kevin Fenzi
41ca654628 docs sync: adjust cron jobs and rsync script
Right now we update translation files once a day at 22:00UTC.
So, it makes no sense to generate the translated docs more often than
once a day after that update. So, that cron moves to 23:00UTC.
The en cron can be once per hour, run it before sync.

Finally, adjust the docs-rsync script so it's actually idempotent,
and only transfers as much as it needs to.

Signed-off-by: Kevin Fenzi <kevin@scrye.com>
2020-06-23 10:08:28 -07:00
Kevin Fenzi
e01343e2ba fedora-docs / proxies: re-enable docs-sync cron job
Move the docs-sync cron to :55 and re-enable it.
See https://pagure.io/fedora-infrastructure/issue/8964
for more info

Signed-off-by: Kevin Fenzi <kevin@scrye.com>
2020-06-22 13:06:49 -07:00
Michael Scherer
a15f67be02 Display the generated public key for docs
Since sundries got reinstalled, there is a new ssh key, and
so we need to change the key on Pagure. Rather than bothering
someone each time that happen, it is better to just display
it so it can be added to Pagure.
2020-06-17 15:33:01 +00:00
Kevin Fenzi
cf212af782 fedora-docs: adjust rsync script a bunch more
Signed-off-by: Kevin Fenzi <kevin@scrye.com>
2020-06-07 19:04:09 -07:00
Stephen Smoogen
0339781ad3 have proxies not copy over copying.tmp if it shows up in docs tree 2020-06-04 10:15:37 -04:00
Stephen Smoogen
1a69c6bd50 have the docs rsync remove excluded files in case they came over. should remove garbage from proxies 2020-05-29 12:16:47 -04:00
Kevin Fenzi
93b435f3ba DISABLE DOCS SYNC: we need to figure out space issues before re-enabling
Signed-off-by: Kevin Fenzi <kevin@scrye.com>
2020-05-28 21:05:08 -07:00
Stephen Smoogen
581f7feec9 have docs-rsync not sync over the ar.rebuilding directory which will have incomplete and duplicaed data 2020-05-27 14:19:17 -04:00
Michael Scherer
4eee290230 Remove safety measure now that's validated
Also prevent sundries from filling up.
2020-05-18 21:14:32 +02:00
Kevin Fenzi
49e8ff002c docs-translation-update: change cron to run at 22 instead of 2. Fixes ticket 8847.
Per ticket 8847, moving this cron job to 10pm will let it run and finish before the larger
and longer cron script runs to update the docs site. This will prevent overlap and get
updates out a day sooner in some cases.

Signed-off-by: Kevin Fenzi <kevin@scrye.com>
2020-04-24 21:34:29 +02:00
Michael Scherer
29f4b8f52e Add last deps, for pocount 2020-04-24 21:34:28 +02:00
Michael Scherer
a7acf091a1 Disable hostkey verification
Since that's run by cron, we have to accept the key.
Given that a MITM of pagure would just enable to intercept
nothing of value (we are using public keys, the data to be commited
can be regenerated trivially and would just concern translation),
disabling StrictHostKeyChecking for that user is IMHO not
a security risk.
2020-04-24 21:34:28 +02:00
Michael Scherer
85136ba279 use the right version of python 2020-04-24 21:34:28 +02:00
Michael Scherer
54949cfc13 Add missing deps 2020-04-24 21:34:28 +02:00
Michael Scherer
d6bba5daa4 Remove the key display, add ssh config 2020-04-24 21:34:28 +02:00
Michael Scherer
547f5bc938 Add a job to update translation
See https://pagure.io/fedora-infrastructure/issue/8691
2020-04-24 21:34:28 +02:00
Kevin Fenzi
828a35a67b do the same thing in prod too 2018-11-08 00:50:28 +00:00
Kevin Fenzi
bff1f4d622 Switch to letting rsync filter our overlaps in docs combined site.
Right now we are doing 3 rsyncs one at a time, but this prevents us
from deleting content that has disappeared from one of the first ones.
So, switch to doing one rsync with multiple sources and let it sort out
files that are now gone to be deleted in the target.
Fixes ticket 7334.
2018-11-08 00:47:37 +00:00
Kevin Fenzi
e40b57559a make sure we keep hardlinks for the 12GB docs-old 2018-08-02 19:35:45 +00:00
Kevin Fenzi
c34ddc25a9 fix logic error 2018-08-02 15:54:22 +00:00
Kevin Fenzi
129cd1f153 docs combined site to prod 2018-08-02 15:25:30 +00:00
Kevin Fenzi
a91923fc2d docs unified website in stg. ticket 7130 2018-08-01 19:51:25 +00:00
Kevin Fenzi
c3ee20181c no stderr from docssync either 2018-06-21 18:58:29 +00:00
Patrick Uiterwijk
8449774d3d Add docs-old.stg
Signed-off-by: Patrick Uiterwijk <puiterwijk@redhat.com>
2017-09-27 16:31:03 +00:00
Patrick Uiterwijk
9c67c7019b Redirect old docs urls to docs-old
Signed-off-by: Patrick Uiterwijk <patrick@puiterwijk.org>
2017-09-27 17:26:58 +02:00
Kevin Fenzi
b2a1c831a0 Make docs 404 page a real local 404 page instead of a redirect that ends in a 200. 2017-09-12 15:00:36 +00:00
Kevin Fenzi
a975655c2b test this fix in staging 2017-09-11 19:49:06 +00:00
Kevin Fenzi
e859a157e5 also add the file 2017-08-30 15:58:28 +00:00
Kevin Fenzi
954dd50de7 make stg and prod use different files 2017-08-30 15:57:29 +00:00
Kevin Fenzi
84e33ff9f3 try this 2017-08-30 14:16:41 +00:00
Kevin Fenzi
b1b36c15c6 try again 2017-08-30 14:14:24 +00:00
Kevin Fenzi
3e7b8f95e1 set 404 for docs 2017-08-30 14:10:17 +00:00
Kevin Fenzi
8f264907f7 Make staging docs sync every 5min 2017-08-26 23:41:18 +00:00
Kevin Fenzi
61b14e5245 fix redirects now gone 2017-08-24 23:07:58 +00:00
Kevin Fenzi
f0e03bd7e9 Fix up docs config 2017-08-24 21:42:51 +00:00
Kevin Fenzi
adc88df3a3 remove all these old docs redirects 2017-08-24 21:41:32 +00:00
Kevin Fenzi
64030a3009 also change prod 2017-08-24 21:12:37 +00:00