idempotent pipeline term
pipeline that produces same result if rerun on same inputs
Critical for backfills and retries. Achieved via deterministic transforms, upserts/merges instead of inserts, partition-based overwrites.
pipeline that produces same result if rerun on same inputs
Critical for backfills and retries. Achieved via deterministic transforms, upserts/merges instead of inserts, partition-based overwrites.