Founding Infrastructure Engineer

Peanoai

Palo Alto (CA)

On-site

USD 180,000 - 260,000

Full time

14 days+

Get a reply from this employer

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Job summary

Peano Labs is building infrastructure to run AI experiments at scale, launching thousands of containerized environments and scheduling GPU workloads across clusters. Founding engineers own the platform behind training, inference, and agent workloads, collaborating with researchers to ensure reliability and efficiency.

You'll focus on building scalable systems, improving resource utilization, and reducing idle GPU time, while growing with a team that values strong infrastructure fundamentals and

Qualifications

  • Bachelor's degree or equivalent practical experience.
  • 3 years of experience building or operating production infrastructure with Kubernetes and Docker.
  • 3 years of coding experience in Go, Python or a similar language.
  • Experience with Linux systems administration, networking, storage and troubleshooting distributed systems.
  • Experience deploying and managing infrastructure on AWS, GCP or Azure.

Responsibilities

  • Build and operate Kubernetes clusters for GPU training, model inference and agent execution.
  • Create and maintain Docker images and reproducible environments for research and production workloads.
  • Build systems to launch, monitor, clean up and recover thousands of concurrent containerized tasks.
  • Improve scheduling, autoscaling and resource allocation to reduce GPU idle time and infrastructure costs.
  • Automate infrastructure provisioning, deployments and upgrades using infrastructure as code and CI/CD.
  • Build monitoring and debugging tools that make failures and performance bottlenecks easy to investigate.
  • Troubleshoot issues across Linux hosts, containers, networking, storage and GPU infrastructure.
  • Implement workload isolation, access controls and resource limits for shared clusters and agent environments.
  • Work with researchers and ML engineers to turn experimental workflows into reliable systems.
  • Own incident response and root-cause analysis, and make improvements that prevent recurring failures.

Skills

Go
Python
Linux systems administration
Networking
Troubleshooting distributed systems
AWS/GCP/Azure

Education

Bachelor's degree or equivalent practical experience

Tools

Docker
Kubernetes
Terraform
Helm
Argo CD
OpenTelemetry
Prometheus
Grafana

Job description

Minimum qualifications
  • Bachelor's degree or equivalent practical experience.
  • 3 years of experience building or operating production infrastructure with Kubernetes and Docker.
  • 3 years of coding experience in Go, Python or a similar language.
  • Experience with Linux systems administration, networking, storage and troubleshooting distributed systems.
  • Experience deploying and managing infrastructure on AWS, GCP or Azure.
Preferred qualifications
  • Experience operating GPU clusters for distributed training, inference or other compute-intensive workloads, especially on top of SLURM, Volcano, or other schedulers
  • Experience with Kubernetes scheduling, autoscaling, resource quotas and multi-tenant workload isolation.
  • Experience building containerized sandbox environments for running untrusted code, automated tests or AI agents.
  • Experience with infrastructure as code and deployment tools such as Terraform, Helm and Argo CD.
  • Experience building monitoring, logging and alerting with tools such as Prometheus, Grafana and OpenTelemetry.
  • A track record of improving infrastructure reliability, resource utilization or operating costs.
About the job

We're building infrastructure that lets AI agents run experiments, train models and solve problems at scale. These workloads involve much more than serving requests: agents launch containers, execute code, interact with environments and share expensive compute resources. Making this work reliably takes people who understand the systems underneath it. As a founding engineer on the team, you'll build and operate the infrastructure behind our training, inference and agent workloads. A workload might involve launching thousands of containerized environments, scheduling jobs across GPU nodes and collecting results for the next training run. You'll investigate why jobs fail, where resources sit idle and what slows down experiments, then build improvements that make the whole system more reliable and efficient. You don't need a machine learning background. We care most about strong infrastructure fundamentals and experience owning production systems. You'll pick up the ML side working with our researchers and ML engineers.

Salary range: [range] + [bonus, equity, benefits]

Responsibilities
  • Build and operate Kubernetes clusters for GPU training, model inference and agent execution.
  • Create and maintain Docker images and reproducible environments for research and production workloads.
  • Build systems to launch, monitor, clean up and recover thousands of concurrent containerized tasks.
  • Improve scheduling, autoscaling and resource allocation to reduce GPU idle time and infrastructure costs.
  • Automate infrastructure provisioning, deployments and upgrades using infrastructure as code and CI/CD.
  • Build monitoring and debugging tools that make failures and performance bottlenecks easy to investigate.
  • Troubleshoot issues across Linux hosts, containers, networking, storage and GPU infrastructure.
  • Implement workload isolation, access controls and resource limits for shared clusters and agent environments.
  • Work with researchers and ML engineers to turn experimental workflows into reliable systems.
  • Own incident response and root-cause analysis, and make improvements that prevent recurring failures.

Peano Labs is an equal opportunity employer. We consider all qualified applicants regardless of race, color, religion, sex, sexual orientation, gender identity, national origin, age, disability, veteran status or any other characteristic protected by law.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Founding Infrastructure Engineer
Founding Infrastructure Engineer

Peano AI • Palo Alto (CA)

On-site
USD 140,000 - 210,000
Founding Senior Infra Engineer, Distributed Infra
Founding Senior Infra Engineer, Distributed Infra

Goaly • Palo Alto (CA)

Hybrid
USD 140,000 - 180,000
Meals and office benefits
Founding Senior Infra Engineer, Distributed Infra
Founding Senior Infra Engineer, Distributed Infra

Goaly AI • Palo Alto (CA)

Hybrid
USD 180,000 - 240,000
Meals and office benefits
Platform Engineer
Platform Engineer

Reactor • San Francisco (CA)

On-site
USD 190,000 - 260,000
Visa sponsorship
Relocation assistance
Health, dental, vision
+1
Software Engineer, AI Infrastructure
Software Engineer, AI Infrastructure

Harell Data • Palo Alto (CA)

On-site
USD 180,000 - 260,000
Founding Senior AI Infrastructure Engineer
Founding Senior AI Infrastructure Engineer

Goaly • Palo Alto (CA)

On-site
USD 140,000 - 210,000
Research Engineer, ML Infrastructure
Research Engineer, ML Infrastructure

cognition • San Francisco (CA)

On-site
USD 180,000 - 250,000
ML Infra Engineer, Compute
ML Infra Engineer, Compute

Physical Intelligence • San Francisco (CA)

On-site
USD 180,000 - 260,000
Director, Global AI Infrastructure & SRE
Director, Global AI Infrastructure & SRE

The POD Network • United States

Remote
PLN 852,918 - 1,231,993
Stock options
Medical, dental & vision plans
Flexible PTO
+2
Infrastructure Operations Engineer
Infrastructure Operations Engineer

lightningai • United States

Remote
USD 160,000 - 200,000
Medical, dental, vision
401(k) matching
Unlimited PTO
+4