Senior ML Infra Engineer: GPU Clusters & Pipelines

General Intuition & Medal; New York (NY); On-site; USD 180,000 - 260,000; Full time

Job summary

General Intuition & Medal is building frontier models and the Medal platform for gaming clips. The role focuses on infrastructure that spans cluster scheduling, data pipelines, storage I/O, and low-latency inference across multiple regions.

You will collaborate with the founding team to design scalable systems, using cloud providers and code-driven infrastructure to ship robust, end-to-end solutions.

Qualifications

• Own orchestration and GPU clusters - scheduling, utilization, capacity.
• Build preprocessing pipelines turning large raw gameplay video into training-ready data.
• Treat disk and network I/O as first-class constraints at very large data volumes.
• Optimize production inference - batching, quantization, KV cache, serving runtimes.

Responsibilities

• Own orchestration of GPU clusters and scheduling to maximize utilization and minimize idle hardware.
• Build and maintain preprocessing pipelines to produce training-ready data at high throughput.
• Assess and mitigate I/O bottlenecks across disk and network to sustain data throughput.
• Lead production inference optimization, controlling latency and cost of serving models.

Skills

Cluster orchestration

GPU clusters

Preprocessing pipelines

I/O optimization

Inference optimization

Infrastructure as code

Multi-region deployment

Production latency

Tools

Kubernetes

Terraform

Python

Go

Rust

C++

Job description

General Intuition & Medal is building frontier models and the Medal platform for gaming clips. The role focuses on infrastructure that spans cluster scheduling, data pipelines, storage I/O, and low-latency inference across multiple regions.

You will collaborate with the founding team to design scalable systems, using cloud providers and code-driven infrastructure to ship robust, end-to-end solutions.