Engineering notes
Buyers needed one list of properties from many public records. We started with scripts. These notes are how that became signals on a grain — and the decisions that followed.
- 📌
Signals on a grain
Scripts and address lookup could inspect a parcel. They could not make one list of parcels with several court filings, an assessor column, and an absentee-owner flag. That mixed list needs a grain.
-
Queue grain, not raw HTML
After we match a signal to a parcel, we may queue that grain. We do not queue raw HTML or PDFs. Compose and list serving stay a separate track.
-
Scale sources, not requests
When sources multiply, we schedule one polite job per source. We do not speed crawls, and we do not put raw HTML on a queue.