Foundry Data Engineer: Pipelines, Quality & Governance

Compunnel, Inc.; Jacksonville (FL); On-site; USD 100,000 - 130,000; Full time

Job summary

A leading tech consulting company is seeking a Palantir Foundry Engineer to build and maintain code repositories, design scalable data ingestion pipelines, and collaborate with teams to translate business requirements into data models. The ideal candidate has at least 3 years of data engineering experience, with a strong preference for those with Palantir Foundry experience. Excellent analytical and performance tuning skills are necessary for ensuring data quality and optimization.

Qualifications

• 3+ years of experience in data engineering; 1+ year in Palantir Foundry strongly preferred.
• Excellent communication and collaboration skills.
• Familiarity with DevOps practices, CI/CD and Git-style workflows.

Responsibilities

• Build and maintain Foundry code repositories, transforms, and datasets.
• Design and implement scalable data ingestion pipelines and batch/stream workflows.
• Optimize performance of transforms (Spark/Python/SQL) and dataset materialization.

Skills

Python

Spark (PySpark)

SQL

Data modeling

ETL/ELT patterns

Data lineage

Versioning

Troubleshooting

Performance tuning

Education

BS/MS in Computer Science or related field

Tools

Palantir Foundry

AWS

GCP

Azure

Kubernetes

Git

Job description

A leading tech consulting company is seeking a Palantir Foundry Engineer to build and maintain code repositories, design scalable data ingestion pipelines, and collaborate with teams to translate business requirements into data models. The ideal candidate has at least 3 years of data engineering experience, with a strong preference for those with Palantir Foundry experience. Excellent analytical and performance tuning skills are necessary for ensuring data quality and optimization.