Founding Infrastructure Engineer - GPU & AI Ops

Peanoai

Palo Alto (CA)

On-site

USD 180,000 - 260,000

Full time

14 days+

A complete application in a minute

Tailored resume and cover letter, ready to send.

Get past ATS filters

Job summary

Peano Labs is building infrastructure to run AI experiments at scale, launching thousands of containerized environments and scheduling GPU workloads across clusters. Founding engineers own the platform behind training, inference, and agent workloads, collaborating with researchers to ensure reliability and efficiency.

You'll focus on building scalable systems, improving resource utilization, and reducing idle GPU time, while growing with a team that values strong infrastructure fundamentals and

Qualifications

  • Bachelor's degree or equivalent practical experience.
  • 3 years of experience building or operating production infrastructure with Kubernetes and Docker.
  • 3 years of coding experience in Go, Python or a similar language.
  • Experience with Linux systems administration, networking, storage and troubleshooting distributed systems.
  • Experience deploying and managing infrastructure on AWS, GCP or Azure.

Responsibilities

  • Build and operate Kubernetes clusters for GPU training, model inference and agent execution.
  • Create and maintain Docker images and reproducible environments for research and production workloads.
  • Build systems to launch, monitor, clean up and recover thousands of concurrent containerized tasks.
  • Improve scheduling, autoscaling and resource allocation to reduce GPU idle time and infrastructure costs.
  • Automate infrastructure provisioning, deployments and upgrades using infrastructure as code and CI/CD.
  • Build monitoring and debugging tools that make failures and performance bottlenecks easy to investigate.
  • Troubleshoot issues across Linux hosts, containers, networking, storage and GPU infrastructure.
  • Implement workload isolation, access controls and resource limits for shared clusters and agent environments.
  • Work with researchers and ML engineers to turn experimental workflows into reliable systems.
  • Own incident response and root-cause analysis, and make improvements that prevent recurring failures.

Skills

Go
Python
Linux systems administration
Networking
Troubleshooting distributed systems
AWS/GCP/Azure

Education

Bachelor's degree or equivalent practical experience

Tools

Docker
Kubernetes
Terraform
Helm
Argo CD
OpenTelemetry
Prometheus
Grafana

Job description

Peano Labs is building infrastructure to run AI experiments at scale, launching thousands of containerized environments and scheduling GPU workloads across clusters. Founding engineers own the platform behind training, inference, and agent workloads, collaborating with researchers to ensure reliability and efficiency.

You'll focus on building scalable systems, improving resource utilization, and reducing idle GPU time, while growing with a team that values strong infrastructure fundamentals and

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Founding Infra Engineer for GPU Training & Inference
Founding Infra Engineer for GPU Training & Inference

Peano AI • Palo Alto (CA)

On-site
USD 140,000 - 210,000
Founding Infrastructure Engineer
Founding Infrastructure Engineer

Peano AI • Palo Alto (CA)

On-site
USD 140,000 - 210,000
Founding Infrastructure Engineer
Founding Infrastructure Engineer

Peanoai • Palo Alto (CA)

On-site
USD 180,000 - 260,000
Pioneering AI Infrastructure Engineer
Pioneering AI Infrastructure Engineer

Goaly • Palo Alto (CA)

On-site
USD 140,000 - 210,000
Founding ML Infra Engineer — Equity & Open-Source AI
Founding ML Infra Engineer — Equity & Open-Source AI

Peano AI • Palo Alto (CA)

On-site
USD 180,000 - 260,000
Staff Engineer, AI Compute & HPC Infrastructure
Staff Engineer, AI Compute & HPC Infrastructure

ATOMS Careers page • San Francisco (CA)

On-site
USD 224,000 - 284,000
Medical, Dental, Vision
401(k)
Equity
+2
Senior Production Infra Engineer — AI Inference & GPUs
Senior Production Infra Engineer — AI Inference & GPUs

Ashby, Inc. • Palo Alto (CA)

On-site
USD 180,000 - 280,000
Health coverage
401(k) match
Meals and snacks
+1
Founding Infra Engineer — AI Accelerator Clusters
Founding Infra Engineer — AI Accelerator Clusters

Goaly AI • Palo Alto (CA)

Hybrid
USD 180,000 - 240,000
Meals and office benefits
Autonomous GPU Infrastructure Engineer
Autonomous GPU Infrastructure Engineer

Sptix AI LLP • San Francisco (CA)

On-site
USD 190,000 - 270,000
Health insurance
Startup equity
Competitive benefits
GPU Compute Infrastructure Engineer
GPU Compute Infrastructure Engineer

Linuxconfig • San Francisco (CA)

Hybrid
USD 210,000 - 270,000