Files
proxmox/docs/04-configuration/verification-evidence/APPLIED_FIXES_20260207.md
defiQUG fbda1b4beb
Some checks failed
Deploy to Phoenix / deploy (push) Has been cancelled
docs: Ledger Live integration, contract deploy learnings, NEXT_STEPS updates
- ADD_CHAIN138_TO_LEDGER_LIVE: Ledger form done; public code review repo bis-innovations/LedgerLive; init/push commands
- CONTRACT_DEPLOYMENT_RUNBOOK: Chain 138 gas price 1 gwei, 36-addr check, TransactionMirror workaround
- CONTRACT_*: AddressMapper, MirrorManager deployed 2026-02-12; 36-address on-chain check
- NEXT_STEPS_FOR_YOU: Ledger done; steps completable now (no LAN); run-completable-tasks-from-anywhere
- MASTER_INDEX, OPERATOR_OPTIONAL, SMART_CONTRACTS_INVENTORY_SIMPLE: updates
- LEDGER_BLOCKCHAIN_INTEGRATION_COMPLETE: bis-innovations/LedgerLive reference

Co-authored-by: Cursor <cursoragent@cursor.com>
2026-02-12 15:46:57 -08:00

73 lines
5.3 KiB
Markdown
Raw Blame History

This file contains ambiguous Unicode characters
This file contains Unicode characters that might be confused with other characters. If you think that this is intentional, you can safely ignore this warning. Use the Escape button to reveal them.
# Fixes Applied — 2026-02-07
**Run:** Applied all automatable fixes from [FULL_FIXES_PREPARED.md](../FULL_FIXES_PREPARED.md).
**Reference:** [FULL_FIXES_PREPARED.md](../FULL_FIXES_PREPARED.md).
---
## Applied (automated)
| # | Fix | Result |
|---|-----|--------|
| 1 | **Validators + tx-pool**`scripts/fix-all-validators-and-txpool.sh` | ✅ All 5 validators (10001004) config updated and besu-validator restarted on r630-01 and ml110. |
| 2 | **Stuck tx**`scripts/skip-stuck-transactions.sh` | ✅ Ran; next nonce **13178** confirmed. Use `--nonce 13178` for next deployer tx. |
| 3 | **Env permissions**`scripts/security/secure-env-permissions.sh` | ✅ chmod 600 applied to .env files. |
| 4 | **NPMplus certs (first only)**`FIRST_ONLY=1` request script | ✅ Ran; 0 hosts needed cert (all had certs or no DNS cred). |
| 5 | **NPMplus backup**`scripts/verify/backup-npmplus.sh` | ✅ Backup created: `backups/npmplus/backup-20260207_094351.tar.gz`. |
| 6 | **Full verification**`scripts/verify/run-full-verification.sh` | ✅ All 6 steps passed (~124s). Evidence in `verification-evidence/`. |
---
## Fixed via SSH (2026-02-07)
| # | Fix | Result |
|---|-----|--------|
| 3 (Sentry 1504) | Install Besu + config, start besu-sentry on ml110 | **Done.** Standalone install script run in 1504; config-sentry.toml and genesis from 1500 pushed; `besu-sentry.service` **active**. |
| 4 (RPC 2301) | Install Besu + config, start besu-rpc on ml110 | **Done.** Standalone install (NODE_TYPE=rpc) run in 2301; config-rpc.toml and genesis from 2101 pushed; `besu-rpc.service` started (**activating** → will become active as node syncs). |
**Script used:** `scripts/install-besu-in-ct-standalone.sh` (no external `build.func`; run with `NODE_TYPE=sentry` or `NODE_TYPE=rpc` inside CT).
---
## Manual only (cannot automate)
| # | Fix | Action |
|---|-----|--------|
| 5 | **UDM Pro port forward** | In UniFi: add 76.53.10.38 → 192.168.11.169 (80, 81, 443). See [UDM_PRO_NPMPLUS_ALLTRA_HYBX_PORT_FORWARD.md](../UDM_PRO_NPMPLUS_ALLTRA_HYBX_PORT_FORWARD.md). |
| 6 | **Alltra/HYBX 502** | From LAN: verify backends (curl to 192.168.11.172, 192.168.11.246, 192.168.11.177, 192.168.11.251). Then fix NPMplus proxy hosts or deploy VMIDs 25002502, 25032505, 5201, 5202. |
| 912 | **Optional** | Explorer SSL, cert 134, shellcheck (install then run), remaining NPMplus certs — per FULL_FIXES_PREPARED §7. |
---
## Post-apply status
- **Blockchain health:** Block production still stalled (only 1/5 validators active in health check). Validators were restarted; allow a few minutes and re-run `scripts/monitoring/monitor-blockchain-health.sh`.
- **Stuck tx:** Use nonce **13178** for next transaction from deployer `0x4A66...1C8`.
- **Alltra/HYBX backends:** Curl from this run (off-LAN) did not reach 192.168.11.172 / 192.168.11.246 / Cacti IPs; verify from a host on 192.168.11.x.
- **Shellcheck:** Not installed; optional. Install with `apt install shellcheck` or `brew install shellcheck`, then run `scripts/verify/run-shellcheck.sh --optional`.
---
## Verification evidence (this run)
- Full verification: `verification-evidence/` (dns-*, udm-pro-*, npmplus-*, backend-vms-*, e2e-* 20260207_094*).
- Source-of-truth: [INGRESS_SOURCE_OF_TRUTH.json](../INGRESS_SOURCE_OF_TRUTH.json).
---
## Node lists deploy and restarts (2026-02-07)
- **Deploy:** `./scripts/deploy-besu-node-lists-to-all.sh` — canonical `config/besu-node-lists/static-nodes.json` and `permissions-nodes.toml` pushed to 11 nodes (10001004, 15001502, 1504, 2101, 2301, 2400). Skipped: 1503, 2201, 2303, 2401 (not running).
- **Restarts:** Besu services restarted on all 11 nodes so they reload the node lists (validators: besu-validator; sentries: besu-sentry; RPCs: besu-rpc).
- **Docs:** [BESU_NODES_FILE_REFERENCE.md](../../06-besu/BESU_NODES_FILE_REFERENCE.md) updated with production RPC table (2101, 2102, 2201, 2301, 2303, 2400, 2401) and 1504; pointer to `config/besu-node-lists/` and deploy script.
- **1504 enode:** Not collected (admin_nodeInfo to 1504:8545 did not respond; add when sentry exposes RPC or use nodekey). When available, add to `config/besu-node-lists/` and re-run deploy.
- **2102 (RPC Core-2):** Container created; Besu RPC installed; config fixed (genesis/permissions/static-nodes → `/etc/besu`, removed `rpc-ws-origins` and `tx-pool-min-score`). **2102 enode added** to `config/besu-node-lists/static-nodes.json` and `permissions-nodes.toml`; deploy run; Besu restarted on all nodes to reload lists. SFValley2 tunnel (Zero Trust, connector, hostname, NPMplus, DNS) remains manual — see [RPC_CORE_2_NATHAN_SFVALLEY2_TUNNEL.md](../cloudflare/RPC_CORE_2_NATHAN_SFVALLEY2_TUNNEL.md).
---
## Status update (continue — 2026-02-07)
- **Blockchain health:** Validator **1000** is **active**; 10011004 still **activating**. Block production still stalled (1/5 validators in quorum). Re-run `scripts/monitoring/monitor-blockchain-health.sh` after more time.
- **Sentry/RPC:** 15001502, 1504; 2101, **2102**, 2301, 2400 — node lists deployed (including 2102 enode) and Besu restarted. 1503, 2201, 2303, 2401 skipped (containers not running).
- **Runbook added:** [INSTALL_BESU_1504_2301_RUNBOOK.md](../../06-besu/INSTALL_BESU_1504_2301_RUNBOOK.md) — steps to install Besu in 1504 and 2301 from host (push install script + configs, then start services).