Platform Engineer — AI-Driven ETL Pipelines & Observability

Avalore.ai; Herndon (VA); On-site; USD 180,000 - 240,000; Full time

Benefits offered by this job

Health care plan (Medical, Dental & V&

Retirement plan (401k, IRA) with match

Life Insurance (Basic, Voluntary & AD&

Paid Time Off (Vacation, Sick & Public

Short/Long Disability

Training & Development

Employee Assistance Program

Job summary

Avalore.ai in Herndon, VA is seeking a Palantir Platform Engineer to architect and optimize ETL workflows within the Palantir ecosystem. You will connect ETL conditioners to Palantir tooling to boost observability and enhance data conditioning, ensuring stakeholders gain clear insight into each transformation phase.

You will apply PySpark and Python to build scalable data pipelines, enable AI-assisted processing, and reinforce data governance and validation as products move toward advanced

Qualifications

• Active Security Clearance with polygraph is required.
• Experience with Palantir Foundry.
• Strong understanding of Ontology and Data Ontology.
• Expertise in building and integrating ETL Pipelines.
• Proficiency in PySpark and Python.
• Experience with Logging and Monitoring solutions.
• Knowledge of Data Governance best practices.
• Familiarity with DevOps methodologies.
• Experience leveraging AI to augment data pipelines.
• Strong skills in Validation of data products.

Responsibilities

• Integrate and optimize ETL workflows within the Palantir ecosystem.
• Connect ETL conditioners to Palantir tooling to improve observability.
• Design and implement robust data pipelines for seamless data flow.
• Leverage AI to accelerate data processing and quality improvements.
• Support data governance and validation for analytics readiness.
• Manage deployment and operational aspects of the platform.
• Collaborate with cross-functional teams to deliver actionable data insights.

Skills

Security clearance

Ontology concepts

Data governance

AI in data pipelines

DevOps practices

Observability

Cross-functional collaboration

Data quality validation

Tools

Palantir Foundry

PySpark

Python

Logging & monitoring tools

Ontology modeling

Job description

Avalore.ai in Herndon, VA is seeking a Palantir Platform Engineer to architect and optimize ETL workflows within the Palantir ecosystem. You will connect ETL conditioners to Palantir tooling to boost observability and enhance data conditioning, ensuring stakeholders gain clear insight into each transformation phase.

You will apply PySpark and Python to build scalable data pipelines, enable AI-assisted processing, and reinforce data governance and validation as products move toward advanced