systems
Aug 8, 20262 min read1 read
systems
design patterns that compose the concrete pieces documented elsewhere — queues, delivery semantics, cursors, batch/serving splits. the layer above any specific database, language, or protocol.
the boundary against its neighbours:
storage/andprotocols/— concrete systems (redis, sqlite, turso, turbopuffer, atproto, MCP)data-structures/— implementation tradeoffs in reusable structureslanguages/— language idioms (python, zig)operations/— running and shipping what you builtsystems/— the patterns that compose those things
if a note is mostly about what to do when something is already deployed and misbehaving, it belongs in operations/.
topics
- background-tasks — the celery→sidekiq→arq→docket lineage, why redis streams won over lists, perpetuals, scheduling future work (streams mechanics live in storage/redis/streams)
- at-least-once-forwarder — outbox, ack-after-durable-commit, and a cursor pinned to min(inflight); why ack-on-receipt plus shedding is silent loss
- serving-from-snapshots — build offline, verify against a manifest, adopt atomically; the overlay is authoritative, and batch cadence sets the freshness floor
- change-timestamps — "when we last wrote" and "when the content last changed" are different columns; pinning the wrong one turns a correctness gate into a measurement of write traffic
- watermark-semantics — one cursor, one meaning; the cost of a gate scales with the quantum of the thing it waits on
- prior-art-encodes-someone-elses-constraints — a mature schema's complexity is evidence of its constraints, not of its correctness for you; take the primitives, leave the envelope
Did you enjoy this article?
Recommend it — Standard Reader surfaces well-loved writing to more readers across the network.