Senior Data Platform Engineer

defcon; United States; Remote; USD 165,000 - 200,000; Full time

Benefits offered by this job

Medical, dental, and vision coverage

Unlimited PTO

Flexible scheduling

Parental leave (14 weeks)

Remote with occasional travel

Job summary

Defcon is seeking a seasoned Data Platform Engineer to build a durable, historized data store that preserves source claims and evidence over time. You will enable probabilistic matching, provenance, and reproducibility of decisions, while supporting auditability and traceability for ML and entity resolution teams.

Remote-friendly role in the United States with occasional travel to offices or partner sites. The role offers a compensation range of $165,000–$200,000, plus bonus potential and

Qualifications

• Six+ years in data or data platform engineering.
• Experience with versioned, temporal, or historized data models.
• Strong Python and SQL with PostgreSQL production experience.

Responsibilities

• Design storage that retains conflicting source claims and their history instead of resolving disagreements during writes.
• Build a results and evidence store linking saved outcomes to originating records and keeps prior results, human feedback, and configuration versions distinct.
• Implement provenance and lineage across records and relationships, following the platform’s evidence contract.
• Store versioned rules and configurations, and record the precise rule versions and ordered context used by model-assisted steps.
• Make writes traceable and decisions reproducible, including point-in-time answers about what was believed and the evidence available then.

Skills

Python

SQL

Temporal data models

Tools

PostgreSQL

Job description

Role overview

Build the data platform’s durable record of resolved entities, preserving what each source said, the evidence behind it, confidence levels, and how conclusions changed over time. The storage design must support probabilistic matching and source disagreement without silently overwriting information, while allowing past results and their rationale to be reconstructed on demand.

Responsibilities

• Design storage that retains conflicting source claims and their history instead of resolving disagreements during writes.
• Build a results and evidence store that links saved outcomes to originating records and keeps prior results, human feedback, and configuration versions distinct.
• Implement provenance and lineage across records and relationships, following the platform’s evidence contract.
• Store versioned rules and configurations, and record the precise rule versions and ordered context used by model-assisted steps.
• Make writes traceable and decisions reproducible, including point-in-time answers about what was believed and the evidence available then.
• Carry match confidence and other uncertainty through the platform, and coordinate data needs with entity resolution and machine learning colleagues.

Requirements

• At least six years in data or data platform engineering, including production experience with versioned, temporal, or historized data models.
• Experience designing storage where provenance, history, and source disagreement are preserved as core data.
• Comfort working with probabilistic upstream results rather than relying on a clean shared key.
• Strong Python and SQL, with production experience using PostgreSQL or a comparable database.
• U.S. citizenship and an active Secret clearance.

Nice to have

• Storage experience downstream of entity resolution or record linkage.
• Production use of bitemporal, event-sourced, graph, or other temporal data models.
• Government or regulated-industry experience requiring historical decisions to be reproducible.
• An active Top Secret clearance.

Benefits and work setup

The position is fully remote with occasional travel to offices, customer locations, or partner facilities. The listed compensation range is $165,000–$200,000, with potential bonus and equity. Benefits include employer-paid medical, dental, and vision coverage for employees and their families, manager-approved unlimited paid time off, flexible scheduling, and 14 weeks of paid parental leave.