Platform Engineer: Data Pipelines & AI (Poly Clear)

Bespoke Technologies, Inc.; Herndon, Northern (VA, KY); Hybrid; USD 140,000 - 170,000; Full time

Job summary

Bespoke Technologies, Inc. is seeking a data engineering professional to design and implement robust ETL pipelines using PySpark and Python.

You will connect ETL conditioners to Palantir tooling to enhance observability and accelerate data conditioning, ensuring end-to-end insight into data transformation processes. You will leverage ontology modeling, data governance best practices, and monitoring frameworks to deliver scalable, reliable data products.

Qualifications

• Experience designing robust ETL pipelines with PySpark and Python.
• Ability to connect ETL conditioners to Palantir tooling to improve observability.
• Strong understanding of data governance and validation practices.

Responsibilities

• Connect ETL conditioners to Palantir tooling to enhance observability and data conditioning.
• Design and implement robust data pipelines for large datasets.
• Leverage AI to optimize data pipelines and ensure data quality.

Skills

PySpark

Python

Ontology

Data governance

Logging & Monitoring

DevOps

Tools

Palantir Foundry

Job description

Bespoke Technologies, Inc. is seeking a data engineering professional to design and implement robust ETL pipelines using PySpark and Python.

You will connect ETL conditioners to Palantir tooling to enhance observability and accelerate data conditioning, ensuring end-to-end insight into data transformation processes. You will leverage ontology modeling, data governance best practices, and monitoring frameworks to deliver scalable, reliable data products.