Senior AI Infrastructure Engineer — Remote

Groq, Inc.; San Francisco (CA); Hybrid; USD 270,000 - 402,000; Full time

Benefits offered by this job

LTI program

Job summary

Groq, Inc. is seeking a Senior/Staff Forward Deployed Engineer focused on AI infrastructure to drive large-scale AI systems from requirements to production, spanning GroqCloud, GroqMetal, GPU and LPX infrastructure, and related networking, storage, and observability layers.

You will collaborate with Commercial, Field Engineering, Platform, Cloud Engineering, Networking, Data Center Operations, Security, and Support teams, and may base in Dallas, San Francisco, or New York City area with remote

Qualifications

• 4+ years of hands-on experience building, deploying, operating, or troubleshooting cloud infrastructure, AI infrastructure, HPC systems, large-scale platforms, or similarly demanding production environments.
• Strong Linux and distributed-systems fundamentals with practical experience in Kubernetes, Slurm, bare-metal environments, or comparable infrastructure platforms.
• Meaningful technical depth in at least one area such as GPU or accelerator systems, networking, storage, orchestration, or infrastructure reliability.
• Working knowledge of AI training and inference workloads and how workload characteristics affect compute, networking, storage, scheduling, latency, and throughput.

Responsibilities

• Own technical execution across complex customer engagements, from discovery and architecture to PoCs, demos, deployment, and production readiness.
• Translate ambiguous customer requirements into architectures, plans, test criteria, runbooks, and engineering actions.
• Work hands-on across Linux, bare-metal infrastructure, Kubernetes, networking, storage, and Groq platform integrations to bring environments online.
• Support large-scale GPU and LPX deployments, including cluster health, benchmarking, and production-readiness evidence.
• Understand customer AI workloads to reason about training and inference behavior, concurrency, throughput, and bottlenecks.
• Lead technical portions of customer discovery, architecture reviews, demos, and proofs of concept for stakeholders.
• Partner with Networking and Security on requirements like private connectivity, routing, load balancing, and security diligence.
• Troubleshoot production/pre-production issues and coordinate internal experts to resolution.

Skills

Linux systems

Kubernetes

Slurm

Python

Go

Bash

Problem solving

Communication

Tools

NVIDIA CUDA

NCCL

GPU Operator

InfiniBand

Terraform

Ansible

CI/CD

PXE/iPXE

Job description

Groq, Inc. is seeking a Senior/Staff Forward Deployed Engineer focused on AI infrastructure to drive large-scale AI systems from requirements to production, spanning GroqCloud, GroqMetal, GPU and LPX infrastructure, and related networking, storage, and observability layers.

You will collaborate with Commercial, Field Engineering, Platform, Cloud Engineering, Networking, Data Center Operations, Security, and Support teams, and may base in Dallas, San Francisco, or New York City area with remote