Data Platform Engineer, Provenance & Temporal Storage (Remote)

DEFCON AI, Inc.; Oregon; Hybrid; USD 165,000 - 200,000; Full time

Benefits offered by this job

Fully remote work environment

Competitive salary, bonus, and equity

Employer-paid health insurance

Unlimited PTO

Flexible work schedule

14 weeks parental leave

Job summary

DEFCON AI, Inc. is seeking a Senior Data Platform Engineer to own the durable storage layer, preserving disagreements and evidence over time in a secure cloud environment.

You will build provenance-aware storage for entity resolution, support point-in-time queries, and ensure reproducible decisions, while leveraging probabilistic upstream outputs. This is a fully remote role with occasional travel to DEFCON AI locations and customer sites.

Qualifications

• 6+ years in data engineering or data platform engineering.
• Experience designing storage where history, provenance, and source disagreement are first-class.
• Comfort building on probabilistic upstream output rather than a clean shared key.
• Strong Python and SQL, with production experience on PostgreSQL or comparable.

Responsibilities

• Design and build the storage layer that preserves source disagreement and history rather than resolving them away at write time
• Build the first release's result and evidence store: saved per-person results linked to the originating record, prior results and human feedback retained separately, and configuration versions on every result
• Implement provenance and lineage across every node and edge against the platform's evidence-record contract
• Store the versioned rule library and configuration, and record on every result the exact rule versions and ordered context supplied to any model-assisted step
• Ensure every write is traceable to its origin and every decision is reproducible
• Carry match confidence and other uncertainty forward through the platform rather than collapsing it into a single value
• Support point-in-time questions: what did we believe about this entity on this date, and on what evidence
• Define, with entity resolution and ML teammates, what the storage layer needs to receive and what it must serve downstream

Skills

Python

SQL

Data engineering

Temporal data

PostgreSQL

US Citizenship

US Secret clearance

Tools

PostgreSQL

Job description

DEFCON AI, Inc. is seeking a Senior Data Platform Engineer to own the durable storage layer, preserving disagreements and evidence over time in a secure cloud environment.

You will build provenance-aware storage for entity resolution, support point-in-time queries, and ensure reproducible decisions, while leveraging probabilistic upstream outputs. This is a fully remote role with occasional travel to DEFCON AI locations and customer sites.