Senior AI Infra Deployment Engineer (Remote)

Groq, Inc.; New York (NY); Hybrid; USD 270,000 - 402,000; Full time

Job summary

Groq, Inc. is seeking a Sr./Staff Forward Deployed Engineer focused on AI infrastructure.

You will drive complex customer engagements from discovery to production, spanning GroqCloud, GroqMetal, GPU and LPX infrastructure and related networks, storage, and observability layers. You will collaborate with Commercial, Field Engineering, Platform and Cloud teams, and Customer Ops to deliver scalable AI workloads on leading-edge platforms.

Qualifications

• 4+ years of hands-on experience building, deploying, operating, or troubleshooting cloud infrastructure, AI infrastructure, HPC systems, large-scale platforms, or similarly demanding production environments.

Responsibilities

• Own technical execution across complex customer engagements, from discovery and architecture through PoCs, demos, deployment, cluster bring-up, validation, acceptance, production readiness, and operational handoff.
• Translate incomplete or ambiguous customer requirements into practical architectures, implementation plans, test criteria, runbooks, and concrete engineering actions.
• Work hands-on across Linux, bare-metal infrastructure, Kubernetes and Slurm, networking, storage, observability, automation, and Groq platform integrations to bring customer environments online and resolve issues.
• Support large-scale GPU and LPX deployments, including infrastructure bring-up, cluster health and performance validation, workload testing, benchmarking, failure isolation, and production-readiness evidence.
• Understand customer AI workloads well enough to reason about training and inference behavior, concurrency, throughput, latency, data movement, caching, scheduling, and infrastructure bottlenecks.

Skills

Linux

Kubernetes

Slurm

Python

Tools

NVIDIA GPU infrastructure

CUDA

NCCL

NVLink/NVSwitch

DCGM

GPU Operator

InfiniBand

RoCE

Kubernetes

Slurm

Job description

Groq, Inc. is seeking a Sr./Staff Forward Deployed Engineer focused on AI infrastructure.

You will drive complex customer engagements from discovery to production, spanning GroqCloud, GroqMetal, GPU and LPX infrastructure and related networks, storage, and observability layers. You will collaborate with Commercial, Field Engineering, Platform and Cloud teams, and Customer Ops to deliver scalable AI workloads on leading-edge platforms.