Foundry Data Engineer — ETL & Pipelines

MACHINE LEARNING TECHNOLOGIES LLC; Saint Paul (MO); On-site; USD 120,000 - 180,000; Full time

Job summary

Palantir Data Engineer role at MACHINE LEARNING TECHNOLOGIES LLC in St. Paul, MO, focusing on building scalable data pipelines within Palantir Foundry for healthcare analytics.

You will collaborate with data scientists and analytics teams, ingest and transform data with Python, PySpark and SQL, ensure data quality and governance, and implement ETL/ELT pipelines using Foundry tools across cloud platforms.

Qualifications

• Bachelor’s or Master’s degree in Computer Science, Information Systems, Finance, Data Engineering or a related field.
• Significant hands-on experience with Palantir Foundry.
• 5 to 7 Years of relevant experience in Palantir Foundry.
• Advanced skills in Python, PySpark, and SQL.
• Experience with big data technologies, cloud platforms (AWS, Azure, GCP), and agile methodologies.
• Strong analytical thinking and problem-solving abilities.
• Data engineers at Palantir focus on building and optimizing data pipelines within the Palantir Foundry platform.
• Design and implement scalable ETL/ELT pipelines using Foundry's tools and code repositories.
• Use Python, PySpark, and SQL to ingest, transform, and manage large-scale data from diverse sources.
• Collaborate with data scientists and analytics teams to create data models (ontologies), ensuring data quality and governance.
• Perform data analysis, validation, and optimization to ensure data integrity and pipeline performance.

Responsibilities

• Build and optimize data pipelines within Palantir Foundry.
• Design scalable ETL/ELT processes using Foundry tools and repos.
• Ingest, transform, and manage large-scale data from diverse sources using Python/PySpark/SQL.
• Collaborate with data scientists to create ontologies and ensure data governance.

Skills

Python

PySpark

SQL

ETL/ELT pipelines

Data modeling

Data governance

Education

Bachelor's or Master's degree in CS/IS/Finance/Data Engineering

Tools

Palantir Foundry

AWS

Azure

GCP

Job description

Palantir Data Engineer role at MACHINE LEARNING TECHNOLOGIES LLC in St. Paul, MO, focusing on building scalable data pipelines within Palantir Foundry for healthcare analytics.

You will collaborate with data scientists and analytics teams, ingest and transform data with Python, PySpark and SQL, ensure data quality and governance, and implement ETL/ELT pipelines using Foundry tools across cloud platforms.