Senior Platform Engineer - AI Infra & Kubernetes

Groq

San Francisco (CA)

Hybrid

USD 260,000 - 420,000

Full time

14 days+

Get a reply from this employer

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Job summary

Groq is seeking a Staff/Sr. Staff software engineer to design and build core Groq platform systems, focusing on Kubernetes-based infrastructure for AI training and inference at scale.

You will stay hands-on while providing senior technical leadership, writing production-grade code, and shaping the product that powers our AI workloads. Based in the San Francisco, Dallas, or New York region with remote flexibility, you will collaborate across infra, inference, networking, and security teams to

Qualifications

  • Experienced software engineer with production software experience.
  • Deep Kubernetes platform engineering experience with operators/controllers and CRDs.
  • Strong distributed-systems expertise including CAP, consensus, and recovery.
  • Experience building infrastructure software with robust SDLC practices.
  • Experience delivering Kubernetes as a Service for enterprise customers is valuable.
  • Hands-on experience with coding agents and AI-related tooling is valued.
  • Experience in hyperscale AI infrastructure environments is preferred.
  • Comfort with ambiguity and rapidly changing requirements.

Responsibilities

  • Design and build core Groq platform systems: APIs, controllers, operators, reconciliation loops, and infrastructure abstractions.
  • Remain deeply hands-on: Write, review, test, debug, and operate substantial production code while providing Senior Staff technical leadership.
  • Leverage Kubernetes to build a commercial product for AI infrastructure, delivering production-grade Kubernetes services for large AI workloads.
  • Apply distributed-systems principles to partial failure, retries, concurrency, and recovery.
  • Design stable platform APIs and contracts that decouple customer experience from backend changes.
  • Collaborate with infra, inference, networking, infosec and other teams to turn platform needs into production systems.

Skills

Senior software engineer
Kubernetes platform engineering
Distributed systems
Infrastructure software
Kubernetes as a Service
Coding agents tooling
Hyperscaler experience
Ambiguity tolerance

Tools

Operators/Controllers
CRDs
CI/CD
Observability tools

Job description

Groq is seeking a Staff/Sr. Staff software engineer to design and build core Groq platform systems, focusing on Kubernetes-based infrastructure for AI training and inference at scale.

You will stay hands-on while providing senior technical leadership, writing production-grade code, and shaping the product that powers our AI workloads. Based in the San Francisco, Dallas, or New York region with remote flexibility, you will collaborate across infra, inference, networking, and security teams to

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Senior Kubernetes Platform Engineer - AI Infra (Remote)
Senior Kubernetes Platform Engineer - AI Infra (Remote)

Groq • United States

Hybrid
USD 270,000 - 402,000
Long‑Term Incentive Program
Remote work during transition
Competitive total cash compensation
Senior AI Infrastructure Engineer — Remote
Senior AI Infrastructure Engineer — Remote

Groq • San Francisco (CA)

Hybrid
USD 270,000 - 402,000
LTI program
Kubernetes Platform Engineer for AI Infra & Production
Kubernetes Platform Engineer for AI Infra & Production

Groq • United States

Hybrid
USD 185,000 - 303,000
Long-Term Incentive (LTI)
Employee benefits
Kubernetes Platform Engineer - AI Infra & Scale
Kubernetes Platform Engineer - AI Infra & Scale

Groq, Inc. • San Francisco (CA), New York (NY)

Hybrid
USD 185,000 - 303,000
Senior PM - AI Inference Platform & Cloud
Senior PM - AI Inference Platform & Cloud

Groq, Inc. • Dallas (TX), San Francisco (CA), New York (NY)

Hybrid
USD 310,000 - 365,000
LTI program
Employee benefits
Staff AI/HPC Network Architect
Staff AI/HPC Network Architect

Groq • San Francisco (CA)

Hybrid
USD 180,000 - 240,000
Staff/Sr. Staff Platform Engineer, Kubernetes Infrastructure (GroqMetal)
Staff/Sr. Staff Platform Engineer, Kubernetes Infrastructure (GroqMetal)

Groq • San Francisco (CA)

Hybrid
USD 260,000 - 420,000
Senior AI Infrastructure Product Leader - Cloud Platform
Senior AI Infrastructure Product Leader - Cloud Platform

Groq • New York (NY)

Hybrid
USD 170,000 - 230,000
Senior AI Inference Platform Leader
Senior AI Inference Platform Leader

Groq • San Francisco (CA)

Remote
USD 310,000 - 365,000
Staff/Sr. Staff Platform Engineer, Kubernetes Infrastructure (GroqMetal)
Staff/Sr. Staff Platform Engineer, Kubernetes Infrastructure (GroqMetal)

Groq • United States

Hybrid
USD 270,000 - 402,000
Long‑Term Incentive Program
Remote work during transition
Competitive total cash compensation