Founding Infra Engineer for GPU Training & Inference

Peano AI

Palo Alto (CA)

On-site

USD 140,000 - 210,000

Full time

14 days+

A complete application in a minute

Tailored resume and cover letter, ready to send.

Get past ATS filters

Job summary

Peano Labs in California seeks a founding infrastructure engineer to build and operate the platform that runs AI experiments at scale. You’ll manage thousands of containerized environments, schedule GPU jobs and collect results for iterative training runs.

You don't need a ML background; strong fundamentals in distributed systems and production reliability matter most. You’ll collaborate with researchers and ML engineers to improve throughput and reduce idle time.

Qualifications

  • Bachelor's degree or equivalent practical experience.
  • 3 years with Kubernetes and Docker in production infrastructure.
  • 3 years coding in Go, Python or similar.
  • Experience with Linux systems administration, networking, storage and distributed systems.
  • Experience deploying and managing infrastructure on AWS, GCP or Azure.
  • Experience operating GPU clusters for distributed workloads on schedulers like SLURM/Volcano.
  • Kubernetes scheduling, autoscaling, resource quotas, multi-tenant isolation.
  • Containerized sandbox environments for untrusted code or AI agents.
  • IaC and deployment tools: Terraform, Helm, Argo CD.
  • Monitoring/logging with Prometheus, Grafana, OpenTelemetry.
  • Track record of improving reliability, utilization or costs.

Responsibilities

  • Build and operate Kubernetes clusters for GPU training, model inference and agent execution.
  • Create and maintain Docker images and reproducible environments for research and production.
  • Launch, monitor, and recover thousands of concurrent containerized tasks.
  • Improve scheduling, autoscaling and resource allocation to reduce idle time and costs.
  • Automate provisioning, deployments and upgrades with IaC and CI/CD.
  • Build monitoring and debugging tools for failures and performance bottlenecks.
  • Troubleshoot Linux hosts, containers, networking, storage and GPU infrastructure.
  • Implement workload isolation and access controls for shared clusters.
  • Collaborate with researchers and ML engineers to turn experiments into reliable systems.
  • Own incident response and root-cause analysis to prevent recurring failures.

Skills

Kubernetes
Docker
Production infrastructure
Go
Python
Linux administration
Networking
Storage
Cloud platforms
GPU clusters
SLURM/Volcano scheduling
Kubernetes autoscaling
IaC tools (Terraform, Helm, Argo CD)
Observability tools (Prometheus, Grafa

Education

Bachelor's degree or equivalent practical experience

Job description

Peano Labs in California seeks a founding infrastructure engineer to build and operate the platform that runs AI experiments at scale. You’ll manage thousands of containerized environments, schedule GPU jobs and collect results for iterative training runs.

You don't need a ML background; strong fundamentals in distributed systems and production reliability matter most. You’ll collaborate with researchers and ML engineers to improve throughput and reduce idle time.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Founding Infrastructure Engineer - GPU & AI Ops
Founding Infrastructure Engineer - GPU & AI Ops

Peanoai • Palo Alto (CA)

On-site
USD 180,000 - 260,000
Founding Infrastructure Engineer
Founding Infrastructure Engineer

Peano AI • Palo Alto (CA)

On-site
USD 140,000 - 210,000
Founding Infrastructure Engineer
Founding Infrastructure Engineer

Peanoai • Palo Alto (CA)

On-site
USD 180,000 - 260,000
Senior Production Infra Engineer — AI Inference & GPUs
Senior Production Infra Engineer — AI Inference & GPUs

Ashby, Inc. • Palo Alto (CA)

On-site
USD 180,000 - 280,000
Health coverage
401(k) match
Meals and snacks
+1
Founding ML Infra Engineer — Equity & Open-Source AI
Founding ML Infra Engineer — Equity & Open-Source AI

Peano AI • Palo Alto (CA)

On-site
USD 180,000 - 260,000
GPU Supercomputing Engineer for Large-Scale ML Training
GPU Supercomputing Engineer for Large-Scale ML Training

Bison • San Francisco (CA)

On-site
USD 350,000 - 475,000
Health/dental/vision
Unlimited PTO
Parental leave
+1
Robotics ML Infrastructure Engineer: GPU Fleet & Inference
Robotics ML Infrastructure Engineer: GPU Fleet & Inference

Generalist AI, Inc. • San Francisco (CA)

On-site
USD 180,000 - 240,000
Robotics ML Infra Engineer: GPU Fleet & Inference
Robotics ML Infra Engineer: GPU Fleet & Inference

Generalist AI, Inc. • Boston (MA)

On-site
USD 150,000 - 230,000
GPU Fleet Engineer - ML Infra & Inference
GPU Fleet Engineer - ML Infra & Inference

Generalist AI • San Mateo (CA)

On-site
USD 185,000 - 235,000
Senior ML Infra Engineer for Large-Scale Mid-Training & RL
Senior ML Infra Engineer for Large-Scale Mid-Training & RL

Peano AI • Palo Alto (CA)

On-site
USD 200,000 - 260,000