Senior/Staff Forward-Deployed AI Infra Engineer (Remote)

Groq; New York (NY); Hybrid; USD 270,000 - 402,000; Full time

Job summary

Groq is seeking a Staff/Sr. Staff Forward Deployed Engineer focused on AI Infrastructure to advance production deployments of large‑scale AI systems.

You will drive engagements from discovery to PoCs, deployment, and production readiness across GPU and Groq platforms. Based in the United States (Dallas, SF, or NYC area preferred), you’ll work hands-on with Linux, Kubernetes, Slurm, networking, and platform integrations, while collaborating with cross‑functional teams to ensure scalable, reliable

Qualifications

• 4+ years building, deploying, or operating cloud/AI infrastructure.
• Strong Linux and distributed-systems fundamentals; practical Kubernetes/Slurm/bare-metal experience.
• Deep technical depth in at least one area (GPU/accelerator, networking, storage, or platform engineering).
• Knowledge of AI training and inference workloads and their impact on compute, networking, storage, scheduling, latency, and throughput.
• Strong Python/Go/Bash scripting for diagnostics and automation.
• Track record of debugging and delivering systems, not only architecture.
• Ability to decompose ambiguous problems into concrete actions across teams.
• Strong written and verbal communication; ability to gather requirements and document work.
• Comfort in a fast-moving environment where requirements and capabilities evolve.

Responsibilities

• Own technical execution across complex customer engagements from discovery to PoCs and production readiness.
• Translate ambiguous requirements into practical architectures, plans, and runbooks.
• Hands-on work across Linux, bare-metal, Kubernetes, Slurm, networking, storage, and Groq platform integrations.
• Support large-scale GPU deployments including health checks, benchmarking, and production readiness.
• Understand AI workloads to reason about training/inference performance and data movement.
• Lead PoCs, architecture reviews, and demonstrations; explain design choices and risks clearly.
• Collaborate with Networking and Security on private connectivity, peering, routing, and security reviews.
• Troubleshoot production/pre-production issues and coordinate with internal experts to resolution.
• Embed with Platform/Cloud/Infrastructure teams to address gaps through engineering execution.
• Build reusable tools, patterns, and documentation to improve future deployments.
• Provide structured feedback to Product/Engineering for platform improvements.

Skills

Linux fundamentals

Kubernetes

Slurm

Python/Go/Bash

Distributed systems

Networking

Performance debugging

Automation tooling

Tools

CUDA

NVIDIA GPU infra

DCGM

InfiniBand

RoCE

Docker

Job description

Groq is seeking a Staff/Sr. Staff Forward Deployed Engineer focused on AI Infrastructure to advance production deployments of large‑scale AI systems.

You will drive engagements from discovery to PoCs, deployment, and production readiness across GPU and Groq platforms. Based in the United States (Dallas, SF, or NYC area preferred), you’ll work hands-on with Linux, Kubernetes, Slurm, networking, and platform integrations, while collaborating with cross‑functional teams to ensure scalable, reliable