personal_infra/ansible/roles/xmrblocks/tasks/install.yml

130 lines
4.2 KiB
YAML
Raw Permalink Normal View History

xmrblocks: the Monero explorer, built off-box because 2 GB cannot compile it The Onion Monero Blockchain Explorer on monerod-box, published at exmrplore.contrapeso.xyz. Ten Gatus endpoints green across the node and the explorer. ── It needs a compiled monero source tree, not a running monerod ─────────── xmrblocks is not an RPC client. cmake/FindMonero.cmake imports 21 STATIC libraries out of a monero build tree and includes its headers, because it opens the LMDB directly. The release tarball we install for the daemon ships only executables - no .a files, no headers - so there is nothing on the box to link against, and building it means compiling monero first. Measured on Debian 13, building only the libraries it links: peak RSS, one cc1plus ~3.2 GB peak RSS at -j4 ~5.5 GB wall time at -j4 167 s source + build tree 195 MB toolchain 1.6 GB That rules the box out at ANY parallelism: 768 MiB and 1800 MiB were both OOM-killed at -j1 and -j2, because a single translation unit over 3 GB is not something lower -j works around. My first estimate of "~10 GB of disk" was wrong by two orders of magnitude - that figure describes upstream's full `make`, which also builds monerod, both wallets and the test suite, none of it linked here. Disk was never the constraint. So scripts/build-xmrblocks.sh does the build in a debian:13 container. An artefact only one machine can produce is one nobody can audit; this way any host with Docker and ~6 GB reproduces it. It verifies the monero source against binaryFate's signature exactly as roles/monero does for the daemon, and the role asserts the resulting sha256 ON THE CONTROL NODE before copying a single byte. ── Three upstream problems, none documented anywhere ─────────────────────── Found by building, not by reading: 1. libasio-dev is absent from upstream's dependency list. That list is Ubuntu-based; Crow wants standalone asio.hpp, not boost/asio.hpp, and on Debian 13 the build dies outright. 2. The explorer does not compile against monero v0.18.5.1. v0.18.5.0 changed get_pruned_transaction_hash from returning the hash to returning bool with an out-param, and src/page.h still calls the old form. Upstream's Dockerfile pins v0.18.4.0, which is why nobody has hit it. Patched from an exact-line anchor, so if upstream fixes it the build STOPS rather than quietly doing something else. We patch instead of building against 0.18.4.0 because the signed hashes.txt only covers the current release - using the older source would mean dropping the provenance chain. LMDB is VERSION 5 in both, so either reads the other's database. 3. FindMonero.cmake hunts for miniupnpc inside the monero build tree with NO_DEFAULT_PATH, but monero stopped vendoring miniupnp as a submodule. Fixed with a cache override rather than patching their cmake. USE_DEVICE_TREZOR=OFF as well - an explorer has no use for hardware wallets and it drops the generated protobuf units. Verified that xmrblocks still links. ── Two things in the unit that look wrong and are not ────────────────────── WorkingDirectory is load-bearing: page.h hardcodes TMPL_DIR as "./templates", resolved relative to cwd at REQUEST time. Get it wrong and the service starts, binds 8081, and 500s every page. That is also why the health check fetches a real page and greps it instead of probing the port. ReadWritePaths must include the blockchain directory even though the database is opened read-only: monero sets mdb_flags = MDB_RDONLY WITHOUT MDB_NOLOCK, so LMDB still registers this reader in lock.mdb. With ProtectSystem=strict and nothing writable the open fails. "It only reads, so grant it nothing" is wrong. ── Timeouts are measured, not guessed ────────────────────────────────────── proxmox-tank-1 is a spinning-disk mirror and xmrblocks says so on startup. First start took 98s to open the LMDB before binding (wait_for now allows 300s), and a COLD index page took 68 SECONDS where the next two took 0.87s and 0.012s (the check now allows 90s, its unit 180s). The first pass used 90s and 25s and produced exactly the false failures you would expect. A stat() bug was caught the same way: `stat` computes a sha1 by default, so checking that data.mdb exists was hashing the entire 40 GB blockchain. --check found it before a real run did. ── Exposure ──────────────────────────────────────────────────────────────── Caddy on vipy terminates TLS; the upstream is reached over the tailnet, which needed a headscale ACL entry for tag:monerod-box:8081 - without it the node is invisible, not merely unreachable, and the symptom is a 502 "no such host". No authentication, deliberately: it is a block explorer over public chain data. That includes --enable-pusher, so a visitor can relay a raw transaction through our node. A choice, not an oversight; flip xmrblocks_enable_pusher to close it. ── Also ──────────────────────────────────────────────────────────────────── monerod-box raised 2048 -> 6144 MiB. Not for the explorer: monerod alone had outgrown 2 GB past ~39% of the chain and was OOM-killed twice in a morning at 1.74 GB anon-rss. Recorded in vms.auto.tfvars because ignore_changes = all means tofu will not reconcile it. The box now idles at ~1.2 GB of 5.9 GB with both services up. No backups, deliberately - binary, templates and chain are all reproducible. Co-Authored-By: Claude Opus 5 (1M context) <noreply@anthropic.com>
2026-09-20 17:06:30 +02:00
---
# Install the prebuilt xmrblocks artifact produced by scripts/build-xmrblocks.sh.
#
# The verification happens on the CONTROL NODE, before a single byte is copied.
# Shipping a binary to a host and checking it afterwards is not verification,
# it is an apology.
- name: Assert the artifact checksum is pinned
ansible.builtin.assert:
that:
- xmrblocks_sha256 | length == 64
quiet: true
fail_msg: >-
xmrblocks_sha256 is not set. Build the artifact with
scripts/build-xmrblocks.sh and pin the sha it prints, so this role cannot
ship a binary nobody has checked.
- name: Check the artifact on the control node
ansible.builtin.stat:
path: "{{ xmrblocks_artifact_dir }}/xmrblocks"
checksum_algorithm: sha256
get_checksum: yes
delegate_to: localhost
become: no
register: xmrblocks_local
changed_when: false
- name: Assert the artifact exists and matches the pinned checksum
ansible.builtin.assert:
that:
- xmrblocks_local.stat.exists
- xmrblocks_local.stat.checksum == xmrblocks_sha256
quiet: true
fail_msg: >-
{{ xmrblocks_artifact_dir }}/xmrblocks is
{{ 'missing - run scripts/build-xmrblocks.sh'
if not xmrblocks_local.stat.exists
else 'sha256 ' ~ xmrblocks_local.stat.checksum ~ ', expected ' ~ xmrblocks_sha256 }}
- name: Check the templates directory on the control node
ansible.builtin.stat:
path: "{{ xmrblocks_artifact_dir }}/templates/index.html"
delegate_to: localhost
become: no
register: xmrblocks_local_templates
changed_when: false
# The binary resolves TMPL_DIR as "./templates" at request time, so a missing
# templates directory is not a startup error - it is a 500 on the first page
# view. Catch it here instead.
- name: Assert the templates came with the artifact
ansible.builtin.assert:
that:
- xmrblocks_local_templates.stat.exists
quiet: true
fail_msg: "{{ xmrblocks_artifact_dir }}/templates/index.html is missing - the artifact is incomplete"
- name: Install the runtime shared libraries xmrblocks needs
apt:
name:
# From `objdump -p xmrblocks | grep NEEDED`. Boost is version-locked to
# the build image's Debian release; monerod-box is Debian 13 and the
# artifact is built in debian:13, so 1.83 matches on both sides.
- libboost-chrono1.83.0
- libboost-filesystem1.83.0
- libboost-program-options1.83.0
- libboost-serialization1.83.0
- libboost-thread1.83.0
- libhidapi-libusb0
- libunbound8
- libunwind8
state: present
update_cache: yes
- name: Create the xmrblocks directory
ansible.builtin.file:
path: "{{ xmrblocks_dir }}"
state: directory
owner: root
group: root
mode: '0755'
- name: Install the xmrblocks binary
ansible.builtin.copy:
src: "{{ xmrblocks_artifact_dir }}/xmrblocks"
dest: "{{ xmrblocks_dir }}/xmrblocks"
owner: root
group: root
mode: '0755'
notify: Restart xmrblocks
- name: Install the xmrblocks templates
ansible.builtin.copy:
src: "{{ xmrblocks_artifact_dir }}/templates/"
dest: "{{ xmrblocks_dir }}/templates/"
owner: root
group: root
mode: '0644'
directory_mode: '0755'
notify: Restart xmrblocks
- name: Record which build is deployed
ansible.builtin.copy:
src: "{{ xmrblocks_artifact_dir }}/MANIFEST"
dest: "{{ xmrblocks_dir }}/MANIFEST"
owner: root
group: root
mode: '0644'
- name: Assert the blockchain database is where we think it is
ansible.builtin.stat:
path: "{{ xmrblocks_bc_path }}/data.mdb"
# data.mdb is the whole blockchain - tens of GB and growing. stat computes a
# sha1 by DEFAULT, so without these it hashes the entire chain just to answer
# "does this file exist", and the play hangs for many minutes.
get_checksum: no
get_mime: no
get_attributes: no
register: xmrblocks_lmdb
- name: Fail if the LMDB is missing
ansible.builtin.assert:
that:
- xmrblocks_lmdb.stat.exists
quiet: true
fail_msg: >-
No LMDB at {{ xmrblocks_bc_path }}/data.mdb. xmrblocks reads monerod's
database directly, so it has nothing to serve. Check that monerod is
deployed and its data disk is mounted.