Other Topics

Other Topics

Miscellaneous engineering topics that don't fit cleanly elsewhere.

44Articles
44Topics covered
Articles in this category

All 44 articles, sorted alphabetically

ARTICLE · 01

Coding Assistants: How DeepSeek-V3 and Claude 3.5 Sonnet Became the New Standard for Software Engineering

The dream of "AI pair programming"—an intelligent assistant that truly understands code and helps engineers build better software faster—has long been a holy grail…

Read article →
ARTICLE · 02

LoRA and QLoRA: Fine-tuning a Trillion-Parameter Model on a Single Home GPU

The era of massive foundation models—GPT-3, Llama 2/3, Mistral—has unleashed unprecedented AI capabilities.

Read article →
ARTICLE · 03

Context Connect: A Word Context Game

Context Connect: A Word Context Game

Read article →
ARTICLE · 04

A/B experimentation platform architecture

Deep-dive on building an A/B testing platform: deterministic salted assignment, exposure logging at the call site, the exposure-to-event join, a stats…

Read article →
ARTICLE · 05

Ansible Introduction, in depth: inventory, modules, playbooks, idempotence, roles and running it safely

A practical introduction to Ansible: how agentless push over SSH works, inventories and groups, modules and fully qualified names, playbooks, handlers…

Read article →
ARTICLE · 06

Argo CD Introduction, in depth: the GitOps reconciler, the Application resource, sync and health, waves and hooks, ApplicationSets and running it safely

A first-principles introduction to Argo CD: why pull-based GitOps, the components and how a change flows from a commit to the cluster, the Application…

Read article →
ARTICLE · 07

Batch Processing Architecture in Depth: bounded intervals, idempotent overwrite, atomic publish, backfills and quality gates

How to design batch pipelines that can be rerun safely: bounded inputs and the logical interval, the job as a pure function of its interval, idempoten…

Read article →
ARTICLE · 08

Change Data Capture Architecture in Depth: capture methods, snapshots, ordering, schema changes and idempotent sinks

A practical architecture guide to change data capture: query, trigger and log-based capture, the change-event envelope, the snapshot-to-stream handoff…

Read article →
ARTICLE · 09

Real-time chat messaging architecture

Deep-dive on building a real-time chat system: persistent-connection gateways, a write path that persists and sequences before acknowledging, fan-out …

Read article →
ARTICLE · 10

CI/CD, in depth: pipeline architecture from commit to production, build once and promote by digest, trusted tests, deployment strategies, safe migrations and a secured pipeline

A first-principles guide to CI/CD: what continuous integration, delivery and deployment require, a pipeline that builds once and promotes one digest, …

Read article →
ARTICLE · 11

Dead-letter queues -- where failed messages go to be dealt with

Deep-dive on dead-letter queues (DLQs): the poison-message problem, sidelining after max retries, retry-then-dead-letter, preserving context (error/at…

Read article →
ARTICLE · 12

DevOps Introduction, in depth: the operating model behind the tools, from value streams and the Three Ways to error budgets and DORA metrics

A first-principles introduction to DevOps as an operating model: the problem it solves, CAMS and CALMS, the Three Ways, a worked value-stream example …

Read article →
ARTICLE · 13

Distributed counter architecture

Deep-dive on distributed counters: sharding to eliminate write contention, local aggregation and atomic adds, cached rollups for hot reads, HyperLogLo…

Read article →
ARTICLE · 14

Distributed lock architecture

Deep-dive on distributed locking: a consensus-backed lock service granting a lease with a TTL that survives crashes, renewal heartbeats that extend it…

Read article →
ARTICLE · 15

Docker Introduction, in depth: what a container really is, how images are built and stored, and how to run them safely

A first-principles introduction to Docker: containers as namespaced, cgroup-limited processes on an overlay filesystem, OCI images and registries, the…

Read article →
ARTICLE · 16

Email Delivery Architecture, in depth: the spool, per-provider scheduling, IP pools and warm-up, DKIM key rotation and the event pipeline

How a transactional and bulk email sending platform is built: the accept path and durable spool, the message state machine, grouping by receiving prov…

Read article →
ARTICLE · 17

Feature flag architecture, in depth: flags inside the application with OpenFeature, typed registries, safe defaults, testing and flag debt

How to architect feature flags in application code: the layers from call site to provider, OpenFeature providers, clients, evaluation context and eval…

Read article →
ARTICLE · 18

Geo proximity search architecture

Deep-dive on nearest-neighbour search: why B-trees cannot index 2D, space-filling curves from geohash to S2 Hilbert ordering, quadtree adaptivity, the…

Read article →
ARTICLE · 19

Git Branching Strategies, in depth: trunk-based, GitHub flow, Gitflow, release branches and how to choose

How Git branching strategies really differ: what a branch is, trunk-based development, GitHub flow, Gitflow and release branches, merge versus squash …

Read article →
ARTICLE · 20

Helm Introduction, in depth: charts, templates, values, releases and the upgrade lifecycle, written for Helm 4

Learn Helm from first principles: the problem it solves, chart anatomy, Go templates and helpers, values precedence, a worked install-upgrade-rollback…

Read article →
ARTICLE · 21

Idempotency keys

Deep-dive on idempotency keys: client key generation and reuse, the idempotency store and first-vs-replay logic, concurrency locking, result caching, …

Read article →
ARTICLE · 22

Infrastructure as Code, in depth: desired state, plan and apply, state and locking, safe refactoring, pipelines and the failure modes that destroy production

A first-principles guide to Infrastructure as Code: declarative desired state versus imperative scripts, how plan and apply work over a dependency gra…

Read article →
ARTICLE · 23

Inventory reservation architecture

Deep-dive on inventory reservation: the atomic check-and-decrement gate, available = on_hand − reserved, TTL-bounded holds and the reaper, confirm-on-…

Read article →
ARTICLE · 24

Kubernetes Introduction, in depth: desired state, control loops, the first five objects, a worked deployment and how to debug a Pod that will not run

A first-principles introduction to Kubernetes: the reconciliation model, what the API server, etcd, scheduler, controllers and kubelet each do on kube…

Read article →
ARTICLE · 25

Leaderboard architecture, in depth: score semantics, sorted sets and tie-breaking, per-period boards, idempotent ingest, approximate rank, snapshots and fraud

How to build a leaderboard that stays correct at scale: best versus cumulative scores, Redis sorted sets, composite scores for tie-breaking within the…

Read article →
ARTICLE · 26

News feed architecture

Deep-dive on building a social news feed at scale, where the central decision is when to do the work: fan-out on write (push a post id into every foll…

Read article →
ARTICLE · 27

Notification System Architecture, in depth: event contract, preferences, dedupe, throttling, templates and push provider hygiene

How to build a notification system that sends the right message once: the event contract, the catalog, preference and consent storage, quiet hours, id…

Read article →
ARTICLE · 28

Object storage architecture

Deep-dive on object storage system design: the flat, immutable key-to-blob model that trades POSIX semantics for exabyte scale, how eleven-nines durab…

Read article →
ARTICLE · 29

Transactional outbox -- reliable events with database writes

Deep-dive on the transactional outbox pattern: the dual-write problem, the outbox table and atomic same-transaction write, CDC vs polling relays, at-l…

Read article →
ARTICLE · 30

Payment gateway architecture

Deep-dive on payment gateway architecture: idempotency keys, tokenization vaults and PCI scope, the payment state machine, risk and 3DS, immutable dou…

Read article →
ARTICLE · 31

Priority queue service architecture

Deep-dive on priority queue services: why priority is a latency promise that only matters under contention, priority classes and ordering stores, the …

Read article →
ARTICLE · 32

Rate limit system architecture, in depth: rate vs concurrency limits, cost-weighted budgets, tenant fairness and adaptive clients

How a production rate limit system fits together around the counter: rate limits versus concurrency limits and Little's law, cost-weighted limits…

Read article →
ARTICLE · 33

Recommender architecture, in depth: candidate generation, two-tower retrieval, ranking, re-ranking and the feedback loop

How a production recommender is built: the multi-stage funnel, candidate sources, a two-tower retrieval model trained with in-batch softmax and served…

Read article →
ARTICLE · 34

Saga Pattern Architecture in Depth: running sagas on a durable workflow engine, versioning in-flight sagas, testing compensations and operating a saga fleet

Sagas as production infrastructure: hosting a saga on a durable workflow engine such as Temporal, classifying failures into retry, compensate or wait,…

Read article →
ARTICLE · 35

Distributed job scheduler -- running work reliably at scale

Deep-dive on distributed job schedulers: why naive cron doesn't scale or survive failures, scheduling (cron/delays/intervals), distributed execut…

Read article →
ARTICLE · 36

Search architecture, in depth: the ranking cascade, feature logging, judgments, learning to rank and interleaving

How the relevance side of a search system is built: the staged retrieval and ranking cascade with a latency budget, query understanding, multiple retr…

Read article →
ARTICLE · 37

Terraform Introduction, in depth: the declarative model, plan and apply over a dependency graph, state and locking, modules, safe refactoring and the failure modes that bite teams

A first-principles introduction to Terraform: how configuration, state and provider APIs are reconciled by a plan, a worked AWS example with for_each,…

Read article →
ARTICLE · 38

Typeahead architecture

Deep-dive on autocomplete systems: mining and scoring query logs, compiling FST indexes with per-node top-k, prefix-sharded in-memory serving, edge ca…

Read article →
ARTICLE · 39

URL shortener architecture

Deep-dive on designing a URL shortener: the read/write skew and immutable mappings, counter+base62 vs KGS vs hashing key generation, cache-fronted red…

Read article →
ARTICLE · 40

Webhook delivery platform architecture

Deep-dive on webhook delivery systems: durable ingest and subscription fan-out, per-endpoint circuit breakers, jittered exponential backoff, HMAC sign…

Read article →
ARTICLE · 41

Workflow Orchestration Architecture in Depth

A 2500-word walkthrough of workflow orchestration: definition, scheduler, workers, durable state, task queue, retry, signals, child workflows, version…

Read article →
ARTICLE · 42

Prompt Injection 101: How Hackers 'Jailbreak' AI and How to Defend Against It

Large Language Models (LLMs) are designed to be flexible, creative, and follow instructions presented in natural language.

Read article →
ARTICLE · 43

Self-Healing Code: Using GenAI as a Smart Automation Layer for Legacy Codebase Migration

Nearly every mature enterprise is anchored by a "digital ball and chain": a critical, legacy codebase.

Read article →
ARTICLE · 44

Tool Use (Function Calling): How Transformers Learned to Use Calculators, APIs, and Python

Large Language Models (LLMs) are masterful linguists. They can generate fluent, coherent text, summarize vast documents, and even craft creative prose.

Read article →