Senior AI Infrastructure Field Engineer (Remote)

Groq, Inc.; New York (NY); Remote; USD 270,000 - 402,000; Full time

Job summary

Groq, Inc. is seeking a Senior/Staff Forward Deployed Engineer focused on AI infrastructure to drive production-grade deployments for demanding customer workloads.

You will work across GroqCloud, GroqMetal, GPU/LPX stacks, and networking/storage/orchestration layers, delivering end-to-end solutions and reusable tooling in a fast-moving environment. You will be based in one of three hubs (Dallas, SF, NYC) with remote work flexibility as Groq opens local offices, transitioning to onsite when

Qualifications

• 4+ years of hands-on experience building, deploying, operating, or troubleshooting cloud infrastructure, AI infrastructure, HPC systems, or similar production environments.
• Strong Linux and distributed-systems fundamentals with practical experience in Kubernetes, Slurm, bare-metal environments, or comparable platforms.
• Meaningful depth in at least one area such as GPU/accelerator systems, networking, storage, or reliability, with breadth to troubleshoot adjacent layers.
• Working knowledge of AI training and inference workloads and how workload characteristics affect compute, networking, storage, scheduling, latency, and throughput.
• Strong Python, Go, Bash, or equivalent scripting/programming skills for diagnostics, automation, deployment tooling, testing, or integrations.
• Track record of debugging and delivering systems rather than only architecture or escalation.

Responsibilities

• Own technical execution across complex customer engagements from discovery through PoCs, demos, deployment, validation, and production handoff.
• Translate ambiguous customer requirements into practical architectures, test criteria, runbooks, and concrete engineering actions.
• Work hands-on across Linux, bare‑metal infrastructure, Kubernetes and Slurm, networking, storage, observability, automation, and Groq integrations to bring environments online.
• Support large-scale GPU and LPX deployments including bring-up, health and performance validation, testing, and evidence of production readiness.
• Understand customer AI workloads to reason about training/inference behavior, concurrency, throughput, latency, data movement, and bottlenecks.
• Lead technical portions of customer discovery, architecture reviews, demos, and proofs of concept with clear design choices and risks.
• Partner with Networking and Security on private connectivity, routing, access controls, and security diligence.
• Troubleshoot cross-boundary issues, coordinate internal experts, and maintain end-to-end ownership.
• Embed with Platform/Cloud/Operations teams when deployments reveal gaps needing automation or integration work.
• Build reusable tools, reference architectures, test suites, deployment patterns, and documentation for future deployments.
• Provide structured customer feedback to Product and Engineering to turn one-off solutions into repeatable platform capabilities.

Skills

Linux systems

Kubernetes

Scripting (Python/Go/Bash)

AI workloads

Distributed systems

Debugging

Communication

Tools

CUDA

NVIDIA GPUs

Job description

Groq, Inc. is seeking a Senior/Staff Forward Deployed Engineer focused on AI infrastructure to drive production-grade deployments for demanding customer workloads.

You will work across GroqCloud, GroqMetal, GPU/LPX stacks, and networking/storage/orchestration layers, delivering end-to-end solutions and reusable tooling in a fast-moving environment. You will be based in one of three hubs (Dallas, SF, NYC) with remote work flexibility as Groq opens local offices, transitioning to onsite when