Platform Engineer: AI-Driven ETL & Data Observability

Artha; Falls Church, Northern (VA, KY); Hybrid; USD 140,000 - 190,000; Full time

Job summary

Pinnacle Government Solutions is seeking a Palantir Platform Engineer to integrate ETL workflows within the Palantir ecosystem, enhancing observability and data conditioning. You will connect ETL conditioners to Palantir tooling and ensure comprehensive insight into each phase of transformation.

Ideal candidates have TS/SCI clearance, Palantir Foundry experience, and strong PySpark/Python skills, with a focus on data governance, AI-augmented pipelines, and robust logging/monitoring.

Qualifications

• Active TS/SCI clearance with polygraph is required.
• Experience with Palantir Foundry and data ontology concepts.
• Proven ability to design and implement robust ETL pipelines.
• Strong PySpark and Python coding skills.
• Experience with logging and monitoring solutions; data governance focus.
• Familiarity with DevOps practices and deployment.
• Experience applying AI to optimize data pipelines and data products.

Responsibilities

• Integrate custom ETL workflows within Palantir ecosystem to improve observability and data conditioning.
• Ensure end-to-end insight into data transformation processes across platforms.
• Model data ontologies and govern data quality for analytics tools.
• Collaborate with cross-functional teams to deploy scalable ETL solutions and monitoring frameworks.

Skills

TS/SCI clearance

Palantir Foundry

Ontology/Data Ontology

ETL Pipelines

PySpark

Python

Logging & Monitoring

Data Governance

DevOps

AI for Data Pipelines

Data Validation

Tools

Palantir Foundry

PySpark

Python

Logging Tools

Job description

Pinnacle Government Solutions is seeking a Palantir Platform Engineer to integrate ETL workflows within the Palantir ecosystem, enhancing observability and data conditioning. You will connect ETL conditioners to Palantir tooling and ensure comprehensive insight into each phase of transformation.

Ideal candidates have TS/SCI clearance, Palantir Foundry experience, and strong PySpark/Python skills, with a focus on data governance, AI-augmented pipelines, and robust logging/monitoring.