hefftools.dev
Infrastructure-focused data utilities
ct-cert-feed Guides
Practical notes on CT log ingestion: paging, retries, short reads, x509 vs precert parsing, and normalization that stays stable over time.
Short reads
Retries/backoff
x509 vs precert
Normalization
How to Download and Parse Certificate Transparency Logs at Scale
A practical overview of CT log entry retrieval, paging, and parsing. Covers why ingestion pipelines fail and what “deterministic replay” really means.
CT Log Paging: Short Reads, Retries, Backoff, and Contiguous Indices
Defensive fetch loops: rate limiting, handling partial pages, retries on 429/5xx, and why you must advance by the count actually returned.
x509 vs Precertificate Entries: What You Can Decode and How to Normalize
How leaf types differ, why precert TBSCertificate isn’t a normal x509 parse, and how to normalize fields without lying to downstream consumers.