DoD Data Engineer – Databricks & PySpark Pipelines

themarlinalliance; San Diego (CA); Hybrid; USD 85,000 - 100,000; Full time

Job summary

The Marlin Alliance is seeking a Data Engineer to design, build, and maintain data pipelines that transform raw operational data into analytics-ready datasets for a Navy DoD client. You will work in a cross-disciplinary team to deliver practical, data-driven solutions while ensuring governance and data quality.

The role requires 3–5 years of data engineering experience, strong Python and SQL skills, and the ability to obtain/maintain a Secret security clearance.

Qualifications

• Bachelor's degree or equivalent professional experience in a related field.
• 3–5 years of data engineering experience.
• Experience with Databricks and PySpark for large-scale data processing.
• Strong programming in Python.
• Experience writing, optimizing, and troubleshooting SQL queries.
• Ability to infer analytics from datasets without predefined requirements.
• Clear communication skills and ability to collaborate with diverse teams.
• U.S. citizenship and ability to obtain/maintain Secret clearance.

Responsibilities

• Design, build, and maintain scalable data pipelines.
• Develop and optimize Python and SQL-based data transformations.
• Analyze datasets lacking predefined requirements and identify insights.
• Collaborate with stakeholders to translate data problems into analytic solutions.
• Ensure data quality, governance, and consistency across pipelines.
• Document data engineering processes and architectures.
• Integrate data outputs into dashboards and downstream apps.
• Troubleshoot data pipelines to ensure timely delivery.

Skills

Databricks

PySpark

Python

SQL

US Citizenship

Education

Bachelor's degree in Computer Science/Data Science or related field

Tools

React

Palantir Foundry

Job description

The Marlin Alliance is seeking a Data Engineer to design, build, and maintain data pipelines that transform raw operational data into analytics-ready datasets for a Navy DoD client. You will work in a cross-disciplinary team to deliver practical, data-driven solutions while ensuring governance and data quality.

The role requires 3–5 years of data engineering experience, strong Python and SQL skills, and the ability to obtain/maintain a Secret security clearance.