TechBeat
A newsletter engine that mines internal email threads out of public court filings.
See it run
The Problem
Real internal communications from tech companies — the actual email threads — are some of the most valuable primary-source material in tech journalism, but they're buried inside court filings that almost nobody scrapes. Most public data sources don't reliably contain them.
What I Built
A ~3,400-line pipeline that mines CourtListener and RECAP for verbatim email threads inside public filings. It runs an archive-first, two-engine system (auto-discover plus a deep-mine fallback across curated high-value cases), deduplicates every document with SHA-256, runs OCR with artifact correction on scanned pages, and tracks API rate limits so it never trips a wall. Each run surfaces, analyzes, and publishes one complete conversation.
The Outcome
Runs unattended on a schedule, publishing one analyzed thread per run. Established that CourtListener is the one source that reliably carries these threads — the sourcing moat is the hard part, and it's solved.
Like what you see?
Let's build something.