On-Site DoD Data Engineer — Real-Time Pipelines

themarlinalliance; San Diego (CA); On-site; USD 175,000 - 225,000; Full time

Job summary

The Marlin Alliance in San Diego, CA is seeking a Data Engineer to design and optimize data pipelines for a Navy client. This on-site role requires active DoD clearance and focuses on transforming and indexing semi-structured data, with direct experience in tactical data links and cross-domain solutions.

You will build scalable data stores, automate pipelines, and present insights to leadership. Strong Python development and data format conversion skills are essential.

Qualifications

• 5-10 years of experience in data engineering or related roles.
• Hands-on developer skills with Python.
• Experience converting formats: XML, JSON, GEOJSON, CoT, JREAP-C, Link-16.

Responsibilities

• Build and optimize robust data pipelines: ingestion, transformation, storage, governance.
• Convert between tactical data formats (XML, JSON, GEOJSON, CoT, JREAP-C, Link-16).
• Implement automation using CHRON/CRON jobs and data orchestration (Airflow, Kafka, AWS Step Functions).
• Architect and maintain scalable data stores (Iceberg, Elasticsearch) with schema evolution and deduplication.
• Enable real-time data indexing and fast query performance.
• Implement MIL-STD-6016 and MIL-STD-3011 data handling.

Skills

Python

Data pipelines

ETL

Airflow

Kafka

Elasticsearch

Iceberg

RegEx

CDS knowledge

JREAP-C

Education

Bachelor's degree in Data Science, Computer Science, Engineering, or related STEM field

Tools

Apache Airflow

Kafka

Iceberg

Job description

The Marlin Alliance in San Diego, CA is seeking a Data Engineer to design and optimize data pipelines for a Navy client. This on-site role requires active DoD clearance and focuses on transforming and indexing semi-structured data, with direct experience in tactical data links and cross-domain solutions.

You will build scalable data stores, automate pipelines, and present insights to leadership. Strong Python development and data format conversion skills are essential.