Founding Infrastructure Engineer

Peano AI

Palo Alto (CA)

On-site

USD 140,000 - 210,000

Full time

14 days+

A complete application in a minute

Tailored resume and cover letter, ready to send.

Get past ATS filters

Job summary

Peano Labs in California seeks a founding infrastructure engineer to build and operate the platform that runs AI experiments at scale. You’ll manage thousands of containerized environments, schedule GPU jobs and collect results for iterative training runs.

You don't need a ML background; strong fundamentals in distributed systems and production reliability matter most. You’ll collaborate with researchers and ML engineers to improve throughput and reduce idle time.

Qualifications

  • Bachelor's degree or equivalent practical experience.
  • 3 years with Kubernetes and Docker in production infrastructure.
  • 3 years coding in Go, Python or similar.
  • Experience with Linux systems administration, networking, storage and distributed systems.
  • Experience deploying and managing infrastructure on AWS, GCP or Azure.
  • Experience operating GPU clusters for distributed workloads on schedulers like SLURM/Volcano.
  • Kubernetes scheduling, autoscaling, resource quotas, multi-tenant isolation.
  • Containerized sandbox environments for untrusted code or AI agents.
  • IaC and deployment tools: Terraform, Helm, Argo CD.
  • Monitoring/logging with Prometheus, Grafana, OpenTelemetry.
  • Track record of improving reliability, utilization or costs.

Responsibilities

  • Build and operate Kubernetes clusters for GPU training, model inference and agent execution.
  • Create and maintain Docker images and reproducible environments for research and production.
  • Launch, monitor, and recover thousands of concurrent containerized tasks.
  • Improve scheduling, autoscaling and resource allocation to reduce idle time and costs.
  • Automate provisioning, deployments and upgrades with IaC and CI/CD.
  • Build monitoring and debugging tools for failures and performance bottlenecks.
  • Troubleshoot Linux hosts, containers, networking, storage and GPU infrastructure.
  • Implement workload isolation and access controls for shared clusters.
  • Collaborate with researchers and ML engineers to turn experiments into reliable systems.
  • Own incident response and root-cause analysis to prevent recurring failures.

Skills

Kubernetes
Docker
Production infrastructure
Go
Python
Linux administration
Networking
Storage
Cloud platforms
GPU clusters
SLURM/Volcano scheduling
Kubernetes autoscaling
IaC tools (Terraform, Helm, Argo CD)
Observability tools (Prometheus, Grafa

Education

Bachelor's degree or equivalent practical experience

Job description

Minimum qualifications
  • Bachelor's degree or equivalent practical experience.

  • 3 years of experience building or operating production infrastructure with Kubernetes and Docker.

  • 3 years of coding experience in Go, Python or a similar language.

  • Experience with Linux systems administration, networking, storage and troubleshooting distributed systems.

  • Experience deploying and managing infrastructure on AWS, GCP or Azure.

Preferred qualifications
  • Experience operating GPU clusters for distributed training, inference or other compute-intensive workloads, especially on top of SLURM, Volcano, or other schedulers

  • Experience with Kubernetes scheduling, autoscaling, resource quotas and multi-tenant workload isolation.

  • Experience building containerized sandbox environments for running untrusted code, automated tests or AI agents.

  • Experience with infrastructure as code and deployment tools such as Terraform, Helm and Argo CD.

  • Experience building monitoring, logging and alerting with tools such as Prometheus, Grafana and OpenTelemetry.

  • A track record of improving infrastructure reliability, resource utilization or operating costs.

About the job

We're building infrastructure that lets AI agents run experiments, train models and solve problems at scale. These workloads involve much more than serving requests: agents launch containers, execute code, interact with environments and share expensive compute resources. Making this work reliably takes people who understand the systems underneath it.

As a founding engineer on the team, you'll build and operate the infrastructure behind our training, inference and agent workloads. A workload might involve launching thousands of containerized environments, scheduling jobs across GPU nodes and collecting results for the next training run. You'll investigate why jobs fail, where resources sit idle and what slows down experiments, then build improvements that make the whole system more reliable and efficient.

You don't need a machine learning background. We care most about strong infrastructure fundamentals and experience owning production systems. You'll pick up the ML side working with our researchers and ML engineers.

Salary range: [range] + [bonus, equity, benefits]

Responsibilities
  • Build and operate Kubernetes clusters for GPU training, model inference and agent execution.

  • Create and maintain Docker images and reproducible environments for research and production workloads.

  • Build systems to launch, monitor, clean up and recover thousands of concurrent containerized tasks.

  • Improve scheduling, autoscaling and resource allocation to reduce GPU idle time and infrastructure costs.

  • Automate infrastructure provisioning, deployments and upgrades using infrastructure as code and CI/CD.

  • Build monitoring and debugging tools that make failures and performance bottlenecks easy to investigate.

  • Troubleshoot issues across Linux hosts, containers, networking, storage and GPU infrastructure.

  • Implement workload isolation, access controls and resource limits for shared clusters and agent environments.

  • Work with researchers and ML engineers to turn experimental workflows into reliable systems.

  • Own incident response and root-cause analysis, and make improvements that prevent recurring failures.

Peano Labs is an equal opportunity employer. We consider all qualified applicants regardless of race, color, religion, sex, sexual orientation, gender identity, national origin, age, disability, veteran status or any other characteristic protected by law.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Founding Infrastructure Engineer
Founding Infrastructure Engineer

Peanoai • Palo Alto (CA)

On-site
USD 180,000 - 260,000
Founding Senior Infra Engineer, Distributed Infra
Founding Senior Infra Engineer, Distributed Infra

Goaly AI • Palo Alto (CA)

Hybrid
USD 180,000 - 240,000
Meals and office benefits
Founding Senior Infra Engineer, Distributed Infra
Founding Senior Infra Engineer, Distributed Infra

Goaly • Palo Alto (CA)

Hybrid
USD 140,000 - 180,000
Meals and office benefits
Founding Senior AI Infrastructure Engineer
Founding Senior AI Infrastructure Engineer

Goaly • Palo Alto (CA)

On-site
USD 140,000 - 210,000
Platform Engineer
Platform Engineer

Reactor • San Francisco (CA)

On-site
USD 190,000 - 260,000
Visa sponsorship
Relocation assistance
Health, dental, vision
+1
Senior Software Engineer, Infrastructure Software for AI (Centralized AI Data Centers & Distrib[...]
Senior Software Engineer, Infrastructure Software for AI (Centralized AI Data Centers & Distrib[...]

Intelliswift • Sunnyvale (CA)

On-site
USD 120,000 - 150,000
Competitive salary
Health insurance
Flexible work hours
Founding Infra Engineer for GPU Training & Inference
Founding Infra Engineer for GPU Training & Inference

Peano AI • Palo Alto (CA)

On-site
USD 140,000 - 210,000
Member of Technical Staff
Member of Technical Staff

Harrison Clarke • San Francisco (CA)

On-site
USD 180,000 - 280,000
Founding Machine Learning Infrastructure Engineer
Founding Machine Learning Infrastructure Engineer

Peano AI • Palo Alto (CA)

On-site
USD 180,000 - 260,000
Infrastructure, Large-scale Training
Infrastructure, Large-scale Training

Hark • San Jose (CA)

On-site
USD 180,000 - 450,000