2026-09-11 22:17:13 +02:00
|
|
|
$ANSIBLE_VAULT;1.1;AES256
|
jar-lid-archive: a staging deployment on its own box
Jar Lid Archive (Django + Postgres 18 + SeaweedFS) on jar-lid-archive-staging-box
(nodito VM 3300, 1 core / 1 GB / 10 GB), public at jars-staging.contrapeso.xyz
through vipy's Caddy. New role roles/jar_lid_archive; per-host values in
host_vars, so a production host is a new [jar_lid_archive] entry, not a new
playbook.
── Containers, following :master ──────────────────────────────────────────
The same three services as the app repo's compose.yaml, so staging rehearses
what dev and CI run. Every playbook run pulls :master and `up -d --wait`s;
compose recreates web only when the digest moved. --wait gates on web's
/health/, which checks the database and the bucket, so a green run means the
app serves. Upgrading is re-running the playbook.
── web is on the host network ─────────────────────────────────────────────
Docker's published ports are DNATed before UFW sees them, so `8000:8000` would
answer on the LAN whatever UFW says, and binding to the tailnet IP races
tailscaled at boot. On the host network gunicorn's port is an ordinary one: UFW
default-deny covers the LAN, tailscaled's ts-input accepts tailscale0 ahead of
UFW (checked on mempool-box), and the headscale ACL grants tag:prd-vipy exactly
:8000. db and storage publish on 127.0.0.1 only. Verified: LAN times out, vipy
gets 200.
That matters for HTTPS: the app trusts X-Forwarded-Proto
(DJANGO_BEHIND_TLS_PROXY=1), which is only safe while Caddy is the sole client.
Login POST through the public URL passes CSRF; cookies are Secure.
── Secrets ────────────────────────────────────────────────────────────────
Generated straight into host_vars/jar_lid_staging_local/vault.yml, never
printed: Django key, Postgres and S3 secrets, and seed passwords for the
fixture's alice/bob/admin usernames - never the fixture's published passwords,
since the site is public. The group vault gains one line, this host's Gatus push
token; decrypted, it differs from before by exactly that line.
── Backups, and the outage the first one caused ───────────────────────────
One uncompressed tar (pg_dump -Fc + the SeaweedFS data dir), age-encrypted on
the box at 02:20, pulled by small-backups-box; 3 days at both ends. Verified end
to end, including decrypting a pulled artefact on lapy.
The first test run stopped web AND storage and left the app down 26 minutes:
SeaweedFS outlasted its 150s healthcheck budget on this disk, compose marked it
unhealthy, and web's depends_on never started it. Now only web is stopped - it
is the only writer to both stores, so they are still captured at one instant -
and the healthchecks have start_periods sized for the disk.
Also inherited from the app's compose.yaml: storage writes /tmp/s3.json and
chowns it to seaweed, so on a RESTART of the same container root cannot
re-create it (sticky /tmp + protected_regular): "Permission denied". Fixed here
with rm -f first; the app repo needs the same line.
── The disk is the problem ────────────────────────────────────────────────
The VM disk is on proxmox-tank-1, the HDD mirror, which knots-box's random reads
(~6 MB/s) keep near saturation. Inside this VM: ~96% "full" I/O pressure while
idle, ~5 min to start web, sudo occasionally over 12s. Moving it to local-zfs
(NVMe) is the fix; noted in the README, not done.
── Also ───────────────────────────────────────────────────────────────────
- lan_ip read from the Proxmox guest agent; host key checked against the one
the agent reads off the disk before it went into known_hosts.
- Monitoring: liveness + disk (400), probe_jar-lid-archive-staging (403), public
/health/ + DNS (402), backup-dump/backup-store.
- tofu: the VM definition.
- Deployed v2026.10.03.1.
Co-Authored-By: Claude Opus 5.5 (1M context) <noreply@anthropic.com>
2026-10-03 23:56:30 +02:00
|
|
|
33653731643464333331646636613630383836323134363761333038383334353230663631376666
|
|
|
|
|
3861376232363238613234663263646137336662666263360a633661313435616338383337396664
|
|
|
|
|
31316234616365326363353739323230326264623562313061303339373265663435313938326634
|
|
|
|
|
3464636635386664620a663330396463653963613537653230333430326137333964386530343636
|
|
|
|
|
62383336343031363537383362643934643839653731346364636534373430303636353431646534
|
|
|
|
|
66313264343338623333633964376137623833613664393137343432666264656466353830346631
|
|
|
|
|
62616639343265646661373062376138363232376562316134303730323431336533306565646438
|
|
|
|
|
62666132613930646564393162316461643431666664356436356264633839333338356561333038
|
|
|
|
|
65333466396165363030653137663939303838663030666235356639616362346330346437306133
|
|
|
|
|
61653130363136643038626562653437303939393133613733326530656163323531386436656363
|
|
|
|
|
37303930613063366537623435396564643431346266373363333332663632663939346131373565
|
|
|
|
|
32663430643034663530643431346335623636663265316431336361363233383761333130353530
|
|
|
|
|
30373566316336646536313938353663666436643532303433643139376232646566616430366330
|
|
|
|
|
36646433393037373733633562306631623164356237326532653833633031633735653463343461
|
|
|
|
|
65646664383531346531353133313334663130393237353436623638333731326139653363383032
|
|
|
|
|
63356235646366333534366666383961636361626636616237323237346234383035623365376137
|
|
|
|
|
34646162663761343662353631393131313562326138336565383764666333383731353730376135
|
|
|
|
|
64656231613630646330643133373766643330656166346134363263373966363665323964396233
|
|
|
|
|
64333038373565343330626633323933333239623634333436666338633539316263616438626461
|
|
|
|
|
30643566656534666533373365613861383231373062613831653537623532353561633736633866
|
|
|
|
|
61383532633430323330646137613633383830393136303332643531383466353039353564393232
|
|
|
|
|
39326130333336663038643766303464363664333261313137663863616466666534383831613732
|
|
|
|
|
35303831633232306131636137656461653361346134373935333462306232323165313265323239
|
|
|
|
|
36343864306130303537386164653866656632633861363736336362656161356463386265336430
|
|
|
|
|
38323739336364303061363437346137633436653566353464323462643838313631393235643635
|
|
|
|
|
65626461643263656537616638623066346636663335383861376336623932343439353231343739
|
|
|
|
|
64663263613862626266616362313136373630636262633036386462666632623336343431333231
|
|
|
|
|
31333164356538616562353335313161353339653262616439636134383063346566663261323938
|
|
|
|
|
36633631636265396230313033373230373635643165613239623532613436376464646635326535
|
|
|
|
|
39333433336361343530623434356636363433653035333934653162363135626564346161346130
|
|
|
|
|
65313130393639393539633534653330343935376365656162383132643635313034383538333333
|
|
|
|
|
64346336346231313939396463643166363165393439626431386334393563646337383361326431
|
|
|
|
|
34346462333732643365303230383937316462623566346238393431656433323535376361623561
|
|
|
|
|
66333530346638623332633832623532393035343930663434343737643032303764343138326638
|
|
|
|
|
33386666656162393633636437656564326336343661643137323362653437323939663033316230
|
|
|
|
|
61643437633665643439663566663232643162656139383236356538663139333162383665343766
|
|
|
|
|
31326539313163333034666233316634396434316535313264313430313432313938383534663333
|
|
|
|
|
33653165303864353638303833646134363362306632336133306430353165363063353735336464
|
|
|
|
|
31303536333964333833343566383238636233366233656531343664346331386230316365626662
|
|
|
|
|
30316635353262303962316364386263636531396636306534306464336536343138663933326236
|
|
|
|
|
38653563633663356339633335376361326132356334626163616361383134306239643365343562
|
|
|
|
|
34323031383638313336663937663564376362663534373464386635653164636430643266343766
|
|
|
|
|
62326134623638343735613562366232653137613265653836326461386539646133303638613639
|
|
|
|
|
31373465353533383237393933626333383839313736636132646564666639336530386537663239
|
|
|
|
|
34653533643039633337353535393832343439346536336232373837363734366430336539373732
|
|
|
|
|
66646339616366313834333562303466373962656435373530666466383339653064666532663236
|
|
|
|
|
64393032623234623561313766343233643232303630613165383761323435313130303361346237
|
|
|
|
|
62323430353333383539613536646439336466633435383134626530326531643135326264376662
|
|
|
|
|
37393832643662386137613230633964396338616638313764373464616665316531396462326431
|
|
|
|
|
36666338666536613666643032376331626132316433653036656330353834323865663865366535
|
|
|
|
|
36313937346136353534373631396630633432313065666639623538343332636665313236336366
|
|
|
|
|
35613330336136623331346636646134316265613863323730663837303032303131376435643131
|
|
|
|
|
39353965376565356136613533623235303031646331663166396631336434623561643464656263
|
|
|
|
|
64376636376337336661363133663139343935613033333266663439326239646434633131316637
|
|
|
|
|
38643164383136343939663332653433376362363432333265623166643831303639376637366363
|
|
|
|
|
37336361336461363437646234663330393830393861373162663463366533366637646530373838
|
|
|
|
|
32633764373164646339653931653066333833363534663234663864336465333164353231663032
|
|
|
|
|
36333666653633643362343334303035656539636663306333613964663837366338613565626635
|
|
|
|
|
34393964303866313835373936376130626665303031376637396639353734373337336534376563
|
|
|
|
|
30643261663235323831366537613434376566323837633136306663663331333863643037336133
|
|
|
|
|
63623035376233393431373361653964323833396362646661343235343332636435356365346330
|
|
|
|
|
39663533353631643062613839643761633866373539613536326132386336373731633239323362
|
|
|
|
|
31383863333330366665393666363864613632636537363436613230623030353436373061633037
|
|
|
|
|
36326633356533666438353034343966366136316331376431396536393261383633373131656530
|
|
|
|
|
36336364653962303730393338313435316162393561383161646232663430616239623964623431
|
|
|
|
|
38383563386266343935666463636533353361623965326232663937326462366433366534306534
|
|
|
|
|
66323139346238343031313762353166646235313463363435393236633337303561333930376439
|
|
|
|
|
37613630386636636634396437623866326639343863353134346438663033353232646566336164
|
|
|
|
|
63376535363235653362623630636661636162313462303664393032326538613139653039653065
|
|
|
|
|
38626234353034643330333861316665306665313933363234623639373765303065376632643233
|
|
|
|
|
39633764346132356564333236306333373664366134363037633730653732643130616665343466
|
|
|
|
|
62356138656331626437666465663132663562336365353834353632383062326164356161366138
|
|
|
|
|
66663532373464316264366661343863363265616438323132646361346135653063303031323833
|
|
|
|
|
33306231353231316165373137616134326163313430613963653532316331323738633639356565
|
|
|
|
|
38343537616330376263636165396139396365643663393637626132306564613263323362663637
|
|
|
|
|
64356665646532326466393733303130386230363831666265396635363630336331326662363864
|
|
|
|
|
39383432346265376137636639613162643135343433303435336436376161303766383232656166
|
|
|
|
|
32323462313432643330303039373239323939626266383232393433366232636134643636646431
|
|
|
|
|
37376330343461393766643664393864633265393631383566396530393364346634626535373133
|
|
|
|
|
61623931386433396630616463353236393630343838383865666466383632363631373136393930
|
|
|
|
|
35633934393963626263646137623262666335306233356439633334313765353161653566613833
|
|
|
|
|
32346637393530313730376564656434393737383037613664666338666435373066303338623930
|
|
|
|
|
63333763633533373437363666616263646564613466613830336134353933626336343036646137
|
|
|
|
|
32633265636134333438386330663764633432376633383930333835363362613738353464636330
|
|
|
|
|
38613135326635643436346565633833623630623736623231306237313662666666653532333234
|
|
|
|
|
62383866373939326335653461653238346336636636383961613534326336653030386534653934
|
|
|
|
|
39323266373664346437613362373162643532636566623563303139353430343638656130303866
|
|
|
|
|
63346537323431613434643865353865633331653233343839376237646337613566663130306537
|
|
|
|
|
39343735626236653636393465633038323465656661626561656438373835343361363735386638
|
|
|
|
|
39623830303864636333373534396562623630653362366166386264643438373435386438383831
|
|
|
|
|
34633264613230643434313037323538346661346464393362613434303135313136376131666530
|
|
|
|
|
36373866313739323962333061343836363661346334383033613534393666636631363262323238
|
|
|
|
|
64313330316464336533663764386666313732616338393162393434613437623730613038356663
|
|
|
|
|
39383236316664313731626330323039373937366638373461373736633239666438306437666666
|
|
|
|
|
66316639346432316631616261626262666238346530353563356436353332313362353431646430
|
|
|
|
|
64643366656466333363313135653331303764633839316239333630353665666465393263633333
|
|
|
|
|
31306663326366643032653762646464396530643662303636393432373966393934396634343032
|
|
|
|
|
31346365633933313436643937626634656535323431616231393866663334303632613237633666
|
|
|
|
|
65396262363665353837366166633435326133356330383066613537653736656565306434303663
|
|
|
|
|
38313837303965633236366533386661366464613262326162316365626534356237663035396264
|
|
|
|
|
33356165623232323664363731383962616465653230373234323961646236356132383031346465
|
|
|
|
|
61396136636137303933346462356339393236313361316465346631666432626434636366396531
|
|
|
|
|
35313264323766663436666430313864303065313633396631656438666564313038386161313433
|
|
|
|
|
66383734373435633838666463643636376366633334626130333730366639663961666630383234
|
|
|
|
|
35343964363931663431373162653333613563366462333037363838623662303837626237396132
|
|
|
|
|
36366162313766366237306337333338623937363165306433616530326435363063333938393939
|
|
|
|
|
61373433666233393962633263386534333735303564326435623363663334313163326239653966
|
|
|
|
|
30656132353938326530306663613637373838323432323762306263623136653937383465613038
|
|
|
|
|
66346661646231623161373233653337353162636334376137373138613864353036663964336362
|
|
|
|
|
64303362306239633339313666303636626264353833333333613132316261333830616232333662
|
|
|
|
|
64623061633466336336623734616632303265363630356665303663636334656136636339353534
|
|
|
|
|
65636564636462346133666438623461653630333833643230623632333266663066376461316661
|
|
|
|
|
37623637356333386638343937613361343265663033326337666138393233646639656232333864
|
|
|
|
|
37343733646432353564316237363964656532386561666538633737323739383766316337386137
|
|
|
|
|
65656231336463623965653232323162363866373732656534376430356432653539393939343661
|
|
|
|
|
30626130336436343033386637393334363237373737613761363633316533623033343731356338
|
|
|
|
|
38363231303637323861376662356564323032316130356461653466336165363363383637313862
|
|
|
|
|
35666338383164666135633734386432353137363464376538663465353330376237363333653566
|
|
|
|
|
32376462383732656135333861323465396664353032393432373861353836376239346338393230
|
|
|
|
|
39623532336232343761303235393963333065653935616230656236646330323465303263663236
|
|
|
|
|
39336233303030656161343961353566626462616333643235623032623338646163346564383034
|
|
|
|
|
63333439653936653731653337396231396562383565363837643138373864613338386164346262
|
|
|
|
|
31613133303833323238343665353238323335623162353362646337336335323639363730386462
|
|
|
|
|
61633966313435313165643537626330663864623762633330383730613131396463313231343837
|
|
|
|
|
61623965393836303230626463363438343239363562643334653733343865313334383233343932
|
|
|
|
|
33313930666136613766376435636432303466626565326434636561373565306532376239643735
|
|
|
|
|
63613037616534656265663536373164643866653466326361313965383635626331636463383363
|
|
|
|
|
35356533393461376132626431383839393132663161373831366130663964313839613566643165
|
|
|
|
|
63353139316333666337636635303236643034623830353462626535623064653065316135343564
|
|
|
|
|
64363963383230313765643262396330663938366631623834376532643937316236623865613665
|
|
|
|
|
34653331333336333364396330646632326266626638316566363539313532323762383034323036
|
|
|
|
|
38343838616264333737376432366535643339323734316563386439313339653763343139306565
|
|
|
|
|
61383538613761353733653933316634316138313565393932623638636135303962366562623231
|
|
|
|
|
38346365616434663362306138373634613334613037613961383032326661356163626238666233
|
|
|
|
|
31653938633938366632326439333237663539383461646236306265326536626135343161396137
|
|
|
|
|
34616636663639396534363431666464306538623632623133623133643864313839653865623266
|
|
|
|
|
35643865366465346532386130353565633333613061396139383265663734323139663532376638
|
|
|
|
|
38623966306639363938643564343330636363346261333166613938623936303966613037663365
|
|
|
|
|
62376334613363323563363332356463376532323964333338623239326663343031373635663032
|
|
|
|
|
33626432356662636130363761323862616131653630396164623435333061366564626236643936
|
|
|
|
|
65316562633036366233303538373530343932616533346637656464346166306438396435666533
|
|
|
|
|
37313766366636336535363536333061373264663163303162666330633061356464353164636239
|
|
|
|
|
39623836663066623431343835623264373239363766323338353633336338363536643462666236
|
|
|
|
|
35313031633561353066306336336362643863393730613938373539363831336266353266633036
|
|
|
|
|
30313039336631396664383434316462643366643532353638396339353430303063303734343830
|
|
|
|
|
31323761643235663061336237333866323139613533366463353433613832316232323938323331
|
|
|
|
|
39356261636231353936313033363962353232663831316634653634323965313035663537323864
|
|
|
|
|
33633138383431376131616462363337313035326339646661643730666337393266316562333138
|
|
|
|
|
39616636323630356631653834313466393533333761666534333239306666356166363433326434
|
|
|
|
|
33643566323438333934363236313633666465663236353034653439323338613433333538336535
|
|
|
|
|
30326435383362343065356463373761333565396131336562636236353863613635636436326131
|
|
|
|
|
37353238656337633135643430306532393530653032663437303139323463613136656563613633
|
|
|
|
|
39303463656631336231643733323439376331653732376639303231333533373264623034316435
|
|
|
|
|
64386635636565333961663936356131643536636235666433356338646531306535653366363362
|
|
|
|
|
64336634396666303364663033383034616639646532333238336138343032376631326139646664
|
|
|
|
|
37323432613664343032313838663561373735323938666339336133653131383263366665656537
|
|
|
|
|
61363139356666303438316434626536323362306539613930353263663263353933353664393666
|
|
|
|
|
37663763616635306665386163333034643465376130313861633435366666653535383234363438
|
|
|
|
|
34326565373461343035616162316532333739386562383466626436366434306261363931653464
|
|
|
|
|
63306238663038373631363834313261323337393263323362306636663765393535303433643562
|
|
|
|
|
63616336383563343732653034316133343662333733323231623064386561623535376235336432
|
|
|
|
|
38646537303136653939346335653031636266343132626262643439363564613132356634666435
|
|
|
|
|
34626562336630363363393261643735353263653462353336383630366335643966396434363034
|
|
|
|
|
65623233346335343637633564393466616365626361613134306362663333353730336264616664
|
|
|
|
|
33656361323631663639303033663632663262313461663133646663633833383833636661336463
|
|
|
|
|
37633266616639663830343333336362653838316363303637333535663136336633393339666263
|
|
|
|
|
37313434303638616530336366303865333038326534656135613136613930376635363062353962
|
|
|
|
|
38323339356235663965383633323665313932643632363132386666363239633666313566653063
|
|
|
|
|
64643433363234396563356435383335623133613364313834396236376339633738326235363737
|
|
|
|
|
31303566613461386434646233306261393835613739353831306164343164616432656466636139
|
|
|
|
|
62393132636465663965633432353665643535643233313738323236383166653838663338323462
|
|
|
|
|
61383035636632323863333361643333363238636436616562393465326230373164366261313564
|
|
|
|
|
39343861333562373762623437613334396634613462373132386564616462333638373161653737
|
|
|
|
|
38313366373864333064646133393561396537353333626462666361326532323239376431326330
|
|
|
|
|
30373734346566663235616235316633636263373431326166623734303734383337643562666536
|
|
|
|
|
61353130646537623936646639393439306639356130373431623431643834386632616165383133
|
|
|
|
|
61666165396634613763306561356533663263386639643766306166303162376366363530396361
|
|
|
|
|
65356538663638633261636332386262343236663731313932656339323239343938666662343064
|
|
|
|
|
66353234346530366163656437356464376136663261343938636566333865313261396164316137
|
|
|
|
|
38663238656365383131363239333537646333656136656465636464656530306137363436636231
|
|
|
|
|
39366339663630653461383461323234363936346230643266393833356432396661356263333238
|
|
|
|
|
38656530306133363733336335386238626132356237313334633634393634333937643631623963
|
|
|
|
|
36326364306664613832363734336463303635373262653632356263336665353739373231316664
|
|
|
|
|
34633036383439393339363364346165376261613339356236323330306432616665343265363564
|
|
|
|
|
66666137346231383465353666633835393737313261643935656530356162613538363864343830
|
|
|
|
|
35323865613563366130323132326238346338303761353433656532643131333962373066336233
|
|
|
|
|
34303734396235303137616362653037333138306132393537646531616635636561343831366531
|
|
|
|
|
36333932323234643237346266323466303736663665363362373465333139393934623939313535
|
|
|
|
|
34316433323136316533313663393238663530386565376131366631393031643362346239316430
|
|
|
|
|
64303636343765326465616464663234373137393137666635306261653466323733303962393461
|
|
|
|
|
61356438316631333231636465653933343264356230313937636431336261306464316532343335
|
|
|
|
|
32383732363866383531373136353331623566636332643332636237653737313064393566373837
|
|
|
|
|
37333031643034343637333832363931343938303764313836373230353931613535313765393065
|
|
|
|
|
30623234653039316461626635366337633265623236333963323934313065623732353362303338
|
|
|
|
|
64663130383030613536383739646562636662656234363036613162666461373834333530363363
|
|
|
|
|
62383166353333663232363737653639316235303535616536383962653039386464303435356538
|
|
|
|
|
61653166633162616563336663323830383732666264393262323139303936626464373132303738
|
|
|
|
|
30343061313535363838653930306164303438353736393862643461363333396539326633386236
|
|
|
|
|
63623666343330363166373037636332313966303565303061663361386239353962666164383435
|
|
|
|
|
64626663383735393431623436323862656262396461393663616530353132646234353838633537
|
|
|
|
|
66313437306330653963613663373235383338383439636563643333323265626132326639386639
|
|
|
|
|
38663762326666343935393664643761393236323266336265393033643734333439353538613062
|
|
|
|
|
38626438663431366464343937316165313937323732643061643334643437353764333231646362
|
|
|
|
|
65393566663530383133393430383237633638363363313963383230663434353635353364333830
|
|
|
|
|
30306535353962633865346131333035353638336539336635643238383762303563323663616164
|
|
|
|
|
63356630393664653637613935363536656239616239316337353730666632633234613331336136
|
|
|
|
|
34383036616432306533663164316163303332313239646662656536333564643539343533383939
|
|
|
|
|
32303935313565626661393334303564633136323164623965663364323966346636396532336535
|
|
|
|
|
38373232616265346131633930333134666333663961383063666237653462623635323537393837
|
|
|
|
|
30373438616561353430633139323163353138363735636530643630346566633631383931363638
|
|
|
|
|
66633266643762626530613238343663326236363134316337653861376561383631663937373833
|
|
|
|
|
32663063356164333731343263393837386332623665313135396665373436323366613331363333
|
|
|
|
|
65393533353933643134643362366330653261313064663963336539653134396437383430313666
|
|
|
|
|
33663234616461626630646563616561313139396630646461386338623266666434376335306435
|
|
|
|
|
36643430663131373064313464633733356131386338643439653032353436656661356366626533
|
|
|
|
|
35343434396361303634636438633036386563383664646561663566613339323865363136333230
|
|
|
|
|
37616265613030633061376639386461383062353135666534346632353064353231
|