Foundry Engineering Lead

nscaleoperationsukltd; USA; Remote; USD 180.000 - 280.000; Vollzeit

Zusammenfassung

nscaleoperationsukltd is seeking a senior data platform lead to steer the technical direction of a scalable data platform that supports operational workflows, internal tools, and customer insights. This hands-on role blends architecture, engineering, and cross-team mentoring.

You will design architecture and roadmap, build pipelines, model data, enforce governance, review data contracts, and collaborate with product and commercial teams to deliver trusted datasets and actionable dashboards.

Qualifikationen

• Deep practical experience with Palantir Foundry and ontology modelling.
• Leadership track record in data engineering, setting standards and mentoring.
• Strong Python skills and experience with Spark/PySpark/Dask/pandas on large datasets.
• Familiarity with API integrations (REST, GraphQL, Foundry Action APIs).
• Experience with Git-based development, version control, and CI/CD workflows.
• Clear communication and ownership in dynamic environments.

Aufgaben

• Design platform architecture and technical roadmap with a focus on scale and data integrity.
• Build and maintain data pipelines uniting infrastructure, platform, and business data.
• Develop data models, schemas, and ontology structures for operational use cases.
• Establish access controls, governance, data quality checks, monitoring, lineage, and freshness practices.
• Review code, document data contracts and semantic layers, and help teams deliver trusted datasets.
• Partner with product and commercial teams to deliver data solutions and dashboards.

Kenntnisse

Leadership in data engineering

Python programming

API integrations

Git-based development

Ontology modelling

Tools

Palantir Foundry

Spark

PySpark

Dask

pandas

REST

GraphQL

Foundry Action APIs

Git

CI/CD

Jobbeschreibung

Role overview

Lead the technical direction and ongoing development of a data platform that supports operational workflows, internal tools, and customer-facing insights. This senior, hands-on role combines architecture and engineering with setting standards, mentoring colleagues, and coordinating across technical and business teams.

Responsibilities

• Design the platform architecture and technical roadmap, balancing scale, security, reliability, and long-term data integrity.
• Build and maintain data pipelines that bring together infrastructure, platform, and business-system data.
• Develop data models, schemas, and ontology structures to support operational use cases and a digital representation of the business.
• Establish access controls, governance, data quality checks, monitoring, lineage, and freshness practices.
• Review code, document data contracts and semantic layers, and help colleagues deliver consistent, trusted datasets.
• Partner with product and commercial teams to turn questions into data solutions, including capacity planning, cost analysis, reliability, and customer reporting.

Requirements

• Deep practical experience with Palantir Foundry, including ontology modelling, pipelines, data architecture, and large-scale platform design.
• A track record of technical leadership in data engineering, including architecture decisions, standards, and mentoring.
• Strong Python skills and experience with data tools such as Spark, PySpark, Dask, or pandas on complex datasets.
• Familiarity with API-based integrations, including REST, GraphQL, or Foundry Action APIs.
• Experience with Git-based development, code review, version control, and CI/CD workflows.
• Clear communication skills and the ability to take ownership in an environment where requirements can change.

Nice to have

• Experience with AWS, GCP, or Azure, especially alongside infrastructure telemetry.
• Familiarity with distributed systems, monitoring data, usage-based billing, or customer-facing data products.