Senior Kubernetes Platform Engineer - AI Infra (Remote)

Groq, Inc.; United States; Hybrid; USD 270,000 - 402,000; Full time

Benefits offered by this job

Long‑Term Incentive Program

Remote work during transition

Competitive total cash compensation

Job summary

Groq is seeking a Senior Staff software engineer to design and lead a Kubernetes-based platform for large-scale AI training and inference workloads. You will write production-grade code, build core platform APIs and controllers, and drive robust system design with a hands-on, senior leadership approach.

You will work across infrastructure, networking, and security teams to deliver a scalable, reliable, and customer-focused AI infrastructure product.

Qualifications

• Strong experience designing, implementing, testing, shipping, and maintaining production software.
• Deep Kubernetes platform engineering experience: operators/controllers, CRDs, admission control, node lifecycle, cluster services.
• Strong distributed-systems expertise: CAP, consensus, leader election, eventual consistency, recovery.

Responsibilities

• Design and build core Groq platform systems: APIs, controllers, operators, reconciliation loops, infrastructure abstractions.
• Remain deeply hands-on: write, review, test, debug, and operate substantial production code while providing Senior Staff leadership.
• Leverage Kubernetes to deliver production-grade services for large-scale AI training/inference workloads.
• Apply distributed-systems principles to ensure stability, concurrency, and recovery.
• Design stable APIs and contracts to decouple customer experience from backend changes.

Skills

Kubernetes platform engineering

Distributed systems

Infrastructure software

Kubernetes as a service

Production-grade software

Tools

Codex

Claude Code

Job description

Groq is seeking a Senior Staff software engineer to design and lead a Kubernetes-based platform for large-scale AI training and inference workloads. You will write production-grade code, build core platform APIs and controllers, and drive robust system design with a hands-on, senior leadership approach.

You will work across infrastructure, networking, and security teams to deliver a scalable, reliable, and customer-focused AI infrastructure product.