Senior Staff Kubernetes Platform Engineer – AI Infra

Groq, Inc.; San Francisco (CA); Hybrid; USD 270,000 - 402,000; Full time

Job summary

Groq, Inc. is seeking a hands-on Senior Staff software engineer to lead a Kubernetes-based platform for large-scale AI training and inference workloads.

You will design core platform APIs, write substantial production code, and collaborate across infra, inference, networking, and security to deliver a stable, customer-facing product. You will stay deeply hands-on, applying distributed-systems principles to ensure reliability and performance, with a path toward transitioning the role to onsite in

Qualifications

• Strong experience designing, implementing, testing, shipping, and maintaining production software.
• Deep knowledge of Kubernetes-based platform engineering and distributed systems.
• Experience with infrastructure software development and SDLC processes.
• Familiarity with coding agents and AI infra tooling is a plus.
• Ability to design stable platform APIs and contract boundaries.

Responsibilities

• Design and build core Groq platform systems: APIs, controllers, operators, reconciliation loops, and infrastructure abstractions.
• Remain deeply hands-on: Write, review, test, debug, and operate substantial production code while providing Senior Staff technical leadership.
• Leverage Kubernetes to build a commercial product for AI infrastructure, delivering production-grade Kubernetes services for dedicated customers.
• Apply distributed-systems principles to partial failure, retries, concurrency, consistency, idempotency, availability, and recovery.
• Design stable platform APIs and contracts that decouple customer experience from backend changes.
• Collaborate with infra, inference, networking, infosec, and other teams to turn platform needs into production systems.

Skills

Kubernetes platform

Distributed systems

Production software

CI/CD

Code agents

Tools

Kubernetes operators

CRDs

Job description

Groq, Inc. is seeking a hands-on Senior Staff software engineer to lead a Kubernetes-based platform for large-scale AI training and inference workloads.

You will design core platform APIs, write substantial production code, and collaborate across infra, inference, networking, and security to deliver a stable, customer-facing product. You will stay deeply hands-on, applying distributed-systems principles to ensure reliability and performance, with a path toward transitioning the role to onsite in