Senior Data Compute Platform Engineer (Spark on Kubernetes)

The Briefed

San Mateo (CA)

Presencial

USD 243 000 - 295 000

Tempo integral

Há 11 dias

Uma candidatura completa num minuto

Currículo e carta de apresentação personalizados, prontos a enviar.

Ultrapassa os filtros ATS

Vantagens oferecidas por esta oferta de emprego

Equity compensation
Healthcare
Onsite meals

Resumo da oferta

Roblox in San Mateo is hiring a Senior Software Engineer for the Data Platform Compute team to own the Spark-on-Kubernetes compute layer and the job submission APIs that power analysts, engineers, and ML workloads. You will design, operate and scale the EKS clusters, build auto-tuning and cost-control features, and partner with Data Engineering, ML, Analytics and Infra to optimize infrastructure patterns.

This role emphasizes reliability, SLO-driven observability, on-call ownership, and

Qualificações

  • 5+ years of professional experience building distributed systems.
  • Bachelor of Science in Computer Science or equivalent.
  • Hands-on experience operating Spark on Kubernetes (EKS/GKE).
  • Strong knowledge of AWS or GCP and IaC tooling.

Responsabilidades

  • Design, build, and operate Spark job submission APIs and libraries.
  • Deliver Spark Connect for notebook workflows and cost-aware compute management.
  • Develop auto-tuning engines to optimize performance and spend.
  • Build lifecycle automation for EKS clusters with zero disruption.
  • Own batch scheduling and multi-tenant fairness and migrations.

Conhecimentos

Distributed systems
Backend languages
On-call ownership
Performance tuning

Formação académica

Bachelor of Science in Computer Science

Ferramentas

Kubernetes (EKS/GKE)
Apache Spark on Kubernetes
AWS
Terraform
Helm
Argo
Karpenter
Spark Connect

Descrição da oferta de emprego

Roblox in San Mateo is hiring a Senior Software Engineer for the Data Platform Compute team to own the Spark-on-Kubernetes compute layer and the job submission APIs that power analysts, engineers, and ML workloads. You will design, operate and scale the EKS clusters, build auto-tuning and cost-control features, and partner with Data Engineering, ML, Analytics and Infra to optimize infrastructure patterns.

This role emphasizes reliability, SLO-driven observability, on-call ownership, and

Obtém a tua avaliação gratuita e confidencial do currículo.

ou arrasta e larga o ficheiro aqui.

Similar jobs

Ofertas semelhantes que vale a pena comparar

Senior Data Compute Platform Engineer (Spark on Kubernetes)
Senior Data Compute Platform Engineer (Spark on Kubernetes)

Roblox Corporation • San Mateo (CA)

Presencial
USD 243 000 - 295 000
Senior Data Platform Engineer - Spark on Kubernetes Scale
Senior Data Platform Engineer - Spark on Kubernetes Scale

Roblox Corporation • San Mateo (CA)

Presencial
USD 243 000 - 295 000
Senior Data Infra Engineer — Spark on Kubernetes
Senior Data Infra Engineer — Spark on Kubernetes

Showcify, Inc. • San Mateo (CA)

Presencial
USD 243 000 - 295 000
Equity compensation
Senior Software Engineer (Data Infrastructure Compute)
Senior Software Engineer (Data Infrastructure Compute)

Roblox Corporation • San Mateo (CA)

Presencial
USD 243 000 - 295 000
Sr. Software Engineer - Data Compute Platform | Roblox NEW
Sr. Software Engineer - Data Compute Platform | Roblox NEW

The Briefed • San Mateo (CA)

Presencial
USD 243 000 - 295 000
Equity compensation
Healthcare
Onsite meals
Senior Software Engineer, Data Infrastructure Compute
Senior Software Engineer, Data Infrastructure Compute

Showcify, Inc. • San Mateo (CA)

Presencial
USD 243 000 - 295 000
Equity compensation
Principal Kubernetes Platform Engineer — Compute at Scale
Principal Kubernetes Platform Engineer — Compute at Scale

Roblox Corporation • San Mateo (CA)

Híbrido
USD 345 040 - 399 420
Senior Software Engineer, Data Infrastructure Compute
Senior Software Engineer, Data Infrastructure Compute

Roblox Corporation • San Mateo (CA)

Presencial
USD 243 000 - 295 000
Principal Data Orchestration Engineer
Principal Data Orchestration Engineer

Roblox Corporation • San Mateo (CA)

Presencial
USD 295 000 - 345 000
Senior Metric Platform Engineer: Scale Data Infra
Senior Metric Platform Engineer: Scale Data Infra

SportsTechJobs • San Mateo (CA)

Presencial
USD 243 000 - 295 000
Equity compensation
Benefits described on this page