Senior Software Engineer (Data Platform) (Fully Remote)

G-P; United States; Remote; USD 150,000 - 210,000; Full time

Job summary

G-P is seeking a seasoned data platform architect to lead the design of internal SDKs and self-service frameworks for an AI-native data platform. You will own the Databricks ecosystem, driving cost efficiency and performance while shaping data quality through Schema-on-Write validation and Data Contracts.

The role emphasizes remote-first collaboration across product teams and enterprise-scale data workloads.

Qualifications

• 5+ years building production-grade data systems at massive scale.
• Deep hands-on mastery of Databricks/Spark ecosystem including Delta Lake and DLT.
• Proven track record in real-time streaming architectures with Kafka or Kinesis.

Responsibilities

• Lead the design and implementation of internal SDKs and self-service frameworks.
• Take full ownership of Databricks ecosystem cost-effectiveness and performance.
• Implement Schema-on-Write validation and Data Contracts for quality standards.

Skills

Databricks

Spark

Delta Lake

Delta Live Tables (DLT)

Kafka

Kinesis

Real-time streaming

SDK design

Self-service frameworks

Data platform architecture

Job description

• Act as the architectural backbone of the AI-native Data Platform.
• Design self-service frameworks and high-performance engines for all products and AI workflows.
• Bridge strategic leadership and technical execution for scalable data reliability.

What You Will Do:

• Lead the design and implementation of internal SDKs and self-service frameworks.
• Take full ownership of Databricks ecosystem cost-effectiveness and performance.
• Implement Schema-on-Write validation and Data Contracts for quality standards.

What We Are Looking For:

• 5+ years building production-grade data systems at massive scale.
• Deep hands-on mastery of Databricks/Spark ecosystem including Delta Lake and DLT.
• Proven track record in real-time streaming architectures with Kafka or Kinesis.

G-P

G-P offers a SaaS-based Global Employment Platform that enables companies to expand into over 180 countries quickly and efficiently. The company fosters a diverse, remote-first culture where innovation thrives and every contribution is valued.