Senior Data Engineer - AI Platform & Data Provenance

Linchpin Software LLC; Chantilly (VA); On-site; USD 120,000 - 190,000; Full time

Job summary

Linchpin Software LLC is seeking a Senior Data Engineer to build the data pipelines and architecture for an in-house AI and GenAI analytic platform. You will engineer the vector, graph, and relational data layers to enable multi-model reasoning with traceable provenance and robust security in air-gapped and hybrid environments.

You will design ingestion schemas, enforce governance, and mentor junior engineers while collaborating across teams to set data standards and ensure fast, defensible data

Qualifications

• 8+ years of experience in data engineering, database design, or a related field.
• Strong relational database design, SQL, and ETL/ELT skills.
• Strong Python skills and experience building production data pipelines.
• Experience working with structured, semi-structured, and unstructured data.
• Experience improving data workflows, performance, and security.
• Ability to work full-time, on-site in Chantilly, VA (20151).

Responsibilities

• Build automated ETL pipelines for schema-aligned ingestion and normalization of diverse structured, semi-structured, and unstructured data.
• Engineer and orchestrate vector, graph, and relational databases powering retrieval and reasoning.
• Implement Named Entity Recognition, contextual entity extraction, and entity resolution at scale.
• Support multi-step retrieval, structured output generation, and deep source citation so every analytic result is traceable.
• Enforce Attribute Based Access Control at the data layer and track end-to-end data lineage and provenance.
• Design and optimize enterprise relational databases and set standards for operations, performance, and security.
• Integrate reasoning components, retrieval systems, databases, and GenAI services across the stack.
• Mentor junior engineers and contribute to cross-team data standards.

Skills

SQL

Python

ETL/ELT

Data modeling

Data governance

Security/compliance

Education

Bachelor's degree

Tools

PostgreSQL

LanceDB

lance graph

Claude Code

Codex

GitLab Duo

FastAPI

Docker

Kubernetes

Job description

Linchpin Software LLC is seeking a Senior Data Engineer to build the data pipelines and architecture for an in-house AI and GenAI analytic platform. You will engineer the vector, graph, and relational data layers to enable multi-model reasoning with traceable provenance and robust security in air-gapped and hybrid environments.

You will design ingestion schemas, enforce governance, and mentor junior engineers while collaborating across teams to set data standards and ensure fast, defensible data