Platform Engineer: AI-Driven ETL & Data Governance

Avalore, LLC

Herndon (VA)

On-site

USD 130,000 - 190,000

Full time

5 days ago

Be an early applicant

A complete application in a minute

Tailored resume and cover letter, ready to send.

Get past ATS filters

Benefits offered by this job

Health care plan

Retirement plan

Life insurance

Paid time off

Disability insurance

Training & development

Employee assistance program

Job summary

Avalore, LLC is seeking a Palantir Platform Engineer to integrate ETL workflows within the Palantir ecosystem. You will connect ETL conditioners to Palantir tooling and enhance observability, leveraging data ontology, logging, and monitoring to ensure reliable data transformations.

Proficiency in PySpark and Python will drive design and implementation of robust data pipelines. You will also apply AI to optimize processing and ensure end-to-end data quality and governance in collaboration with

Qualifications

Experience with Palantir Foundry and Palantir tooling.
Expertise in building and integrating ETL pipelines.
Strong knowledge of data ontology and governance.

Responsibilities

Design and implement robust data pipelines using PySpark and Python to support data flow and transformation.
Connect ETL conditioners to Palantir tooling to improve observability and speed of data conditioning.
Ensure stakeholders have comprehensive visibility into each phase of the transformation process.
Leverage AI to augment and optimize data pipelines for faster processing of large datasets.
Apply DevOps practices to manage deployment and operations of the platform.
Navigate Palantir Foundry and ontology modeling to operate in complex data environments.
Build scalable ETL solutions and implement monitoring frameworks across the data platform.
Collaborate with cross-functional teams to deliver actionable data insights.