Principal Data Platform Engineer: Airflow & Kubernetes Lead

Showcify, Inc.

San Mateo (CA)

On-site

USD 295,000 - 345,000

Full time

14 days+

Get a reply from this employer

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Job summary

Roblox is hiring a Principal Software Engineer to lead the Data Platform Orchestration team in San Mateo, CA. You will own the Airflow-based orchestration platform and its Kubernetes infrastructure, shaping architecture and delivering scalable, reliable data pipelines.

You will collaborate with data platforms, governance, data science, and product engineering to drive roadmaps, improve observability, and raise the bar for engineering excellence across teams. Equity and benefits are provided.

Qualifications

  • B.S. equivalent in CS or similar degree.
  • 10+ years of experience designing, building, and operating production-grade distributed systems.
  • Deep hands-on experience with workflow orchestration (Airflow preferred) or equivalent schedulers.

Responsibilities

  • Define the multi-year orchestration strategy for Airflow and surrounding platform.
  • Scale and harden Airflow across scheduler, metadata, executors, and DAG parsing.
  • Own orchestration on Kubernetes, including autoscaling and deployment automation.
  • Build platform tooling, APIs, operators, and self-service pipelines for engineers.
  • Drive observability, SLOs, alerts, and incident reviews for pipelines and components.
  • Lead cross-team alignment with data platform, governance, data science, and product engineering.
  • Raise engineering standards for code quality, design, and reliability.

Skills

Python
Go
Java
Kubernetes
Airflow
Dagster
Spark

Education

B.S. equivalent in CS

Tools

Apache Airflow
Kubernetes (AWS EKS)
Spark on Kubernetes
Dagster
Prometheus/OpenTelemetry

Job description

Roblox is hiring a Principal Software Engineer to lead the Data Platform Orchestration team in San Mateo, CA. You will own the Airflow-based orchestration platform and its Kubernetes infrastructure, shaping architecture and delivering scalable, reliable data pipelines.

You will collaborate with data platforms, governance, data science, and product engineering to drive roadmaps, improve observability, and raise the bar for engineering excellence across teams. Equity and benefits are provided.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Principal Data Orchestration Engineer
Principal Data Orchestration Engineer

Roblox Corporation • San Mateo (CA)

On-site
USD 295,000 - 345,000
Principal Orchestration Engineer, Airflow on Kubernetes
Principal Orchestration Engineer, Airflow on Kubernetes

Game Companies • San Mateo (CA)

On-site
USD 295,000 - 345,000
Principal Data Platform Orchestrator
Principal Data Platform Orchestrator

Roblox Corporation • San Mateo (CA)

On-site
USD 295,000 - 345,000
Equity compensation
Principal Data Engineer, Creator Analytics Platform
Principal Data Engineer, Creator Analytics Platform

Speedrun Talent Network • San Mateo (CA)

On-site
USD 345,000 - 399,000
Principal Software Engineer (Orchestration)
Principal Software Engineer (Orchestration)

Roblox Corporation • San Mateo (CA)

On-site
USD 295,000 - 345,000
Principal Software Engineer, Orchestration
Principal Software Engineer, Orchestration

Game Companies • San Mateo (CA)

On-site
USD 295,000 - 345,000
Principal Software Engineer, Orchestration
Principal Software Engineer, Orchestration

Roblox Corporation • San Mateo (CA)

On-site
USD 295,000 - 345,000
Equity compensation
Principal Software Engineer, Orchestration
Principal Software Engineer, Orchestration

Showcify, Inc. • San Mateo (CA)

On-site
USD 295,000 - 345,000
Principal Kubernetes Platform Engineer — Compute at Scale
Principal Kubernetes Platform Engineer — Compute at Scale

Roblox Corporation • San Mateo (CA)

Hybrid
USD 345,040 - 399,420
Principal Engineer, Creator Analytics — Equity
Principal Engineer, Creator Analytics — Equity

SportsTechJobs • San Mateo (CA)

On-site
USD 345,000 - 399,000
Equity compensation
Benefits package