Data Platform Architect for AI-Native Systems

G-P; United States; Remote; USD 150,000 - 210,000; Full time

Job summary

G-P is seeking a seasoned data platform architect to lead the design of internal SDKs and self-service frameworks for an AI-native data platform. You will own the Databricks ecosystem, driving cost efficiency and performance while shaping data quality through Schema-on-Write validation and Data Contracts.

The role emphasizes remote-first collaboration across product teams and enterprise-scale data workloads.

Qualifications

• 5+ years building production-grade data systems at massive scale.
• Deep hands-on mastery of Databricks/Spark ecosystem including Delta Lake and DLT.
• Proven track record in real-time streaming architectures with Kafka or Kinesis.

Responsibilities

• Lead the design and implementation of internal SDKs and self-service frameworks.
• Take full ownership of Databricks ecosystem cost-effectiveness and performance.
• Implement Schema-on-Write validation and Data Contracts for quality standards.

Skills

Databricks

Spark

Delta Lake

Delta Live Tables (DLT)

Kafka

Kinesis

Real-time streaming

SDK design

Self-service frameworks

Data platform architecture

Job description

G-P is seeking a seasoned data platform architect to lead the design of internal SDKs and self-service frameworks for an AI-native data platform. You will own the Databricks ecosystem, driving cost efficiency and performance while shaping data quality through Schema-on-Write validation and Data Contracts.

The role emphasizes remote-first collaboration across product teams and enterprise-scale data workloads.