Senior Data Platform Architect - Foundry & Databricks Expert

GoFasti; United States; Remote; USD 140,000 - 190,000; Full time

Job summary

GoFasti is seeking a Senior Data Platform Architect to design and implement federated architectures integrating Palantir Foundry and Databricks. You will establish data-sharing standards across Foundry, Databricks, BigQuery, and Cloud Storage, and define patterns using Delta Lake, Iceberg, Unity Catalog, and more.

You will lead modernization of ETL toward metadata-driven cloud-native data products, define governance, lineage, and ownership models, and enable AI workloads across platforms.

Qualifications

• 8+ years in Data Engineering, Architecture or Platform Engineering.
• Extensive Databricks Lakehouse and PySpark expertise.
• Experience with Palantir Foundry platforms and governance.

Responsibilities

• Design and implement enterprise-scale federated architectures integrating Palantir Foundry and Databricks.
• Establish standards for data sharing across Foundry, Databricks, BigQuery, and Cloud Storage environments.
• Define architecture patterns leveraging Delta Lake, Apache Iceberg, Unity Catalog, Foundry Ontology, Virtual Tables, and Catalog Federation.
• Lead the modernization of legacy ETL architectures toward metadata-driven, cloud-native data products.
• Define enterprise data governance, lineage, metadata, and ownership models across both platforms.
• Create architectural roadmaps supporting AI, machine learning, real-time analytics, and self-service data consumption.
• Design and implement Foundry Databricks Connector solutions, including bulk imports, incremental data synchronization, virtual tables, compute pushdown, and external model integrations.
• Build scalable ingestion, transformation, and enrichment pipelines using PySpark, Spark SQL, Python, Databricks Workflows, Airflow, and Foundry Code Repositories.
• Architect secure connectivity between Palantir Foundry, Databricks, Google Cloud Platform, BigQuery, Cloud Storage, and Enterprise APIs.
• Enable AI and machine learning workloads across Foundry and Databricks environments.
• Serve as the technical authority for enterprise data platform architecture and lead architecture reviews.

Skills

Data Engineering

Data Architecture

Platform Engineering

Databricks Lakehouse

PySpark

Spark SQL

Python

Data Modeling

Data Governance

Metadata Management

Leadership

Stakeholder Mgmt

Tools

GCP

BigQuery

Cloud Storage

Pub/Sub

IAM

Networking

Job description

GoFasti is seeking a Senior Data Platform Architect to design and implement federated architectures integrating Palantir Foundry and Databricks. You will establish data-sharing standards across Foundry, Databricks, BigQuery, and Cloud Storage, and define patterns using Delta Lake, Iceberg, Unity Catalog, and more.

You will lead modernization of ETL toward metadata-driven cloud-native data products, define governance, lineage, and ownership models, and enable AI workloads across platforms.