Platform Engineer

Pinnacle Government Solutions; Herndon (VA); On-site; USD 140,000 - 210,000; Full time

Job summary

Pinnacle Government Solutions is seeking a Palantir Platform Engineer to integrate ETL workflows within Palantir Foundry and drive data conditioning across large datasets.

You will leverage PySpark and Python to build scalable pipelines, apply ontology models, and ensure data quality with robust logging and monitoring. A TS/SCI clearance with polygraph is required for this critical federal program.

Qualifications

• Active TS/SCI clearance w/ polygraph is required.
• Experience with Palantir Foundry is required.
• Strong understanding of Ontology and Data Ontology is essential.
• Expertise in building and integrating ETL pipelines.
• Proficiency in PySpark and Python.
• Experience with logging and monitoring solutions.

Responsibilities

• Design and implement robust data pipelines using PySpark and Python.
• Integrate custom ETL workflows within the Palantir ecosystem.
• Ensure end-to-end data transformation with governance and validation.
• Enhance observability and data conditioning through monitoring frameworks.
• Collaborate across cross-functional teams to deliver reliable analytics products.

Skills

TS/SCI clearance

Palantir Foundry

Ontology knowledge

ETL pipelines

PySpark

Python

Logging & monitoring

Data governance

DevOps

AI for data pipelines

Data product validation

Tools

Palantir Foundry

PySpark

Python

Job description

Pinnacle Government Solutions is a minority-owned small business that provides Software, AI/ML, and Cloud Engineering Solutions for our Department of Defense, Intelligence Community, and Federal Civilian agencies. We bring SME-level expertise and over five decades of combined industry knowledge and Talent Acquisition experience. We believe in getting it right for our customers and our country.

We are looking for a Palantir Platform Engineer who will play a pivotal role in integrating custom ETL workflows within the Palantir ecosystem. Your responsibilities will include connecting ETL conditioners to Palantir tooling, which enhances observability and accelerates data conditioning efforts. You will ensure that stakeholders maintain comprehensive insight into each phase of the transformation process, leveraging your expertise in data ontology, logging, and monitoring. Utilizing your skills in PySpark and Python, you will design and implement robust data pipelines that support seamless data flow and transformation.

In this position, you will also harness AI to augment and optimize data pipelines, driving greater speed and efficiency in processing large datasets. Your focus on data governance and validation will be essential as you prepare products for integration into advanced analytics tools, ensuring data quality and reliability. Experience with DevOps practices will be valuable as you manage deployment and operational aspects of the platform, while your familiarity with Palantir Foundry and ontology modeling will help you navigate complex data environments. Success in this role will be supported by a strong background in building scalable ETL solutions, implementing monitoring frameworks, and collaborating with cross-functional teams to deliver actionable data insights.

Required Skills:

• Active TS/SCI clearance w/ polygraph
• Experience with Palantir Foundry
• Strong understanding of Ontology and Data Ontology
• Expertise in building and integrating ETL Pipelines
• Proficiency in PySpark and Python
• Experience with Logging and Monitoring solutions
• Knowledge of Data Governance best practices
• Familiarity with DevOps methodologies
• Experience leveraging AI to augment data pipelines
• Strong skills in Validation of data products

Preferred Skills/Experience:

• Experience connecting ETL conditioners to Palantir tooling
• Background in increasing observability and accelerating data conditioning
• Experience ensuring end-to-end insight into data transformation processes
• Familiarity with integrating validated products into analytics tools for data exploitation