Senior Kubernetes Platform Engineer - AI Infra

Groq, Inc.; New York (NY); Remote; USD 270,000 - 402,000; Full time

Job summary

Groq, Inc. is building an advanced infrastructure platform for AI workloads. This hands-on Senior Staff role focuses on designing a Kubernetes-based platform, leading production software initiatives, and delivering scalable services for large-scale training and inference.

The role combines deep system design with practical coding leadership, mentoring engineers, and shaping platform APIs to ensure stability as we transition to onsite offices in the future.

Qualifications

• Experience designing, implementing, testing, shipping, and maintaining production software.
• Deep Kubernetes platform engineering experience with operators/CRDs.
• Strong distributed-systems expertise: CAP, consensus, leader election, eventual consistency.

Responsibilities

• Design and build core Groq platform systems: APIs, controllers, operators, reconciliation loops.
• Remain hands-on: write, review, test, debug, and operate substantial production code.
• Deliver production-grade Kubernetes services for AI training and inference workloads.
• Apply distributed-systems principles for stability, reliability, and recovery.
• Collaborate across infra, inference, networking, infosec, and other teams.

Skills

Kubernetes platform

Distributed systems

CI/CD pipelines

Production software

APIs & controllers

Coding agents

Tools

Codex

Claude Code

Job description

Groq, Inc. is building an advanced infrastructure platform for AI workloads. This hands-on Senior Staff role focuses on designing a Kubernetes-based platform, leading production software initiatives, and delivering scalable services for large-scale training and inference.

The role combines deep system design with practical coding leadership, mentoring engineers, and shaping platform APIs to ensure stability as we transition to onsite offices in the future.