Add CLAUDE.md, project memory notes, and token_count

CLAUDE.md points future sessions at .claude/memory/ for accumulated
project context (purpose, SA/MR topology, packaging/signing decisions,
open external dependencies) not fully captured elsewhere in the repo.
This commit is contained in:
wall
2026-07-28 14:27:05 +10:00
parent 4008f61ce4
commit 45f4dc733d
7 changed files with 155 additions and 0 deletions
+22
View File
@@ -0,0 +1,22 @@
# Project Purpose
This repo is about improving NiFi workflows in two related ways:
1. **Performance** — the current pack/unpack path (`MergeContent` /
`UnpackContent`) is disk-I/O bound on shared vSAN storage, due to
redundant read/write passes: an ingest write, a separate read to hash
content, a read+write to merge/pack, a read+write to unpack. vSAN is
shared, virtualized IOPS across the vSphere cluster, so the pain is
*contention*, not any single slow disk.
2. **Integrity & non-repudiation** — FlowFiles packed and exported outside
NiFi's space need signed attributes (the attributes already carry a
content hash, so content isn't re-hashed at pack time) to prove both
integrity and authorship, for S3 storage/retrieval, HTTP/filesystem
delivery, and selective date/category replay from a catalog database.
A future requirement extends this to TB-scale files that must be chunked,
tracked, and transited through NiFi (for routing/content-assurance
controls — all content must pass through NiFi) — including across a
one-way network boundary (MR) with no return channel for retransmission.
See [[topology]] and [[packaging-signing-decisions]].