Lead Data Engineer: Build Scalable, Petabyte-Scale Pipelines

Anduril Industries; Costa Mesa (CA); On-site; USD 146,000 - 194,000; Full time

Job summary

Anduril Industries is seeking a highly skilled Data Engineer to build and scale a next‑generation data platform. You will architect robust systems to unlock insights from complex, large‑scale data and act as a force multiplier across data science, analytics, and software teams.

You will design scalable ETL/ELT pipelines, enforce data quality, and treat data infrastructure as a software product, using CI/CD and best practices.

Qualifications

• 5+ years of experience in a data engineering or similar software engineering role.
• Strong programming proficiency in Python.
• Hands‑on expertise with cloud data platforms (Google BigQuery, Databricks, Palantir Foundry).
• Expert‑level SQL and query optimization on large datasets.
• Solid understanding of data modeling, ETL/ELT, and data warehousing/lakehouse.
• Experience with cloud environments (GCP, AWS, Azure) and containerization (Docker, Kubernetes).
• Eligible to obtain and maintain a US Top Secret security clearance.

Responsibilities

• Design and build scalable ETL/ELT pipelines for petabyte-scale data.
• Develop reusable data frameworks, libraries, and tools with version control and CI/CD.
• Model data and schemas for analytical querying and application use.
• Implement data quality checks, monitoring, and alerts; troubleshoot performance bottlenecks.
• Collaborate with data scientists, analysts, engineers, and business stakeholders.

Skills

Python

SQL

Data modeling

ETL/ELT

BigQuery

Databricks

Palantir Foundry

Cloud platforms

Docker

Kubernetes

US Top Secret clearance

Tools

Google BigQuery

Databricks

Palantir Foundry

Job description

Anduril Industries is seeking a highly skilled Data Engineer to build and scale a next‑generation data platform. You will architect robust systems to unlock insights from complex, large‑scale data and act as a force multiplier across data science, analytics, and software teams.

You will design scalable ETL/ELT pipelines, enforce data quality, and treat data infrastructure as a software product, using CI/CD and best practices.