Senior Data Engineer – AI/Foundry Pipelines (Pittsburgh)

LMI; Pittsburgh (Allegheny County); On-site; USD 101,144 - 174,591; Full time

Job summary

LMI is seeking a skilled Data Engineer to join our team in Pittsburgh, PA, focusing on Palantir Foundry (Vantage) pipelines, ontologies, and Databricks workloads. You will lead data engineering efforts, engineer scalable data products, and collaborate with data scientists and developers to advance AI-driven solutions.

The role demands strong Python/SQL expertise, Git, Agile practices, and the ability to operate across Foundry and Databricks environments.

Qualifications

• Bachelor’s degree or equivalent in a related field.
• 3–5 years of data engineering with Palantir Foundry (Vantage).
• Proficiency in Python and SQL for data pipelines.
• Experience with Databricks notebooks, Delta Lake, and Spark processing.
• Active Secret Clearance or ability to obtain one.

Responsibilities

• Lead data engineering in Palantir Foundry (Vantage) including ontology design and pipeline development.
• Build and optimize Foundry pipelines using PySpark and Foundry tools.
• Develop Databricks notebooks and Delta Lake tables for analytics workloads.
• Translate data science outputs into governed, reusable data products.
• Lead AI/ML integration into Foundry and Databricks-based apps.

Skills

Palantir Foundry (Vantage)

Databricks

Python

SQL

Git

Agile methodologies

CI/CD

Leadership

Security clearance

Education

Bachelor’s degree in Computer Science, Data Science, Data Engineering, Software Engineering, Information Systems, or related field

Master’s degree in Computer Science or related field

Tools

Foundry Workshop

Delta Lake

Storybook

LangChain

OpenAI / AI tooling

Job description

LMI is seeking a skilled Data Engineer to join our team in Pittsburgh, PA, focusing on Palantir Foundry (Vantage) pipelines, ontologies, and Databricks workloads. You will lead data engineering efforts, engineer scalable data products, and collaborate with data scientists and developers to advance AI-driven solutions.

The role demands strong Python/SQL expertise, Git, Agile practices, and the ability to operate across Foundry and Databricks environments.