Go & Kubernetes Training Infra Engineer for ML

Cloudjobs

New York (NY)

On-site

USD 140,000 - 210,000

Full time

14 days+

Get a reply from this employer

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Benefits offered by this job

Equity
Medical insurance
Dental insurance
Vision insurance
Flexible PTO
Winter Break
Paid parental leave
Fertility and family-building stipend
401(k)

Job summary

Cloudjobs seeks a senior engineer in New York with deep expertise in Go, Kubernetes, and distributed systems to run ML/AI workloads in production. You will design and operate scalable cloud architectures and observability stacks, ensuring reliability and performance across modern data platforms.

The role emphasizes production-grade engineering, scalable infrastructure, and collaboration with data science teams to optimize models and pipelines using MLOps practices.

Qualifications

  • Requires a CS degree and deep expertise in Go and Kubernetes in production.
  • Strong understanding of distributed systems.
  • Experience with ML/AI workloads.

Skills

Go
Kubernetes
Distributed Systems
Python
MLOps
Observability Systems
Infrastructure Architecture
Scheduling
Networking
Temporal

Education

Bachelor or higher in CS

Tools

PyTorch
DeepSpeed
FSDP
Temporal
Airflow

Job description

Cloudjobs seeks a senior engineer in New York with deep expertise in Go, Kubernetes, and distributed systems to run ML/AI workloads in production. You will design and operate scalable cloud architectures and observability stacks, ensuring reliability and performance across modern data platforms.

The role emphasizes production-grade engineering, scalable infrastructure, and collaboration with data science teams to optimize models and pipelines using MLOps practices.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Senior ML Infra Engineer: Kubernetes, GPUs & GitOps
Senior ML Infra Engineer: Kubernetes, GPUs & GitOps

Schrödinger • New York (NY)

On-site
USD 110,000 - 160,000
Healthcare (dental & vision)
401k
Flexible work schedule
+4
ML Inference Platform Engineer (Kubernetes, Go)
ML Inference Platform Engineer (Kubernetes, Go)

Baseten • Seattle (WA)

On-site
USD 165,000 - 330,000
Competitive equity + compensation
Healthcare coverage for employee and 1
Flexible PTO including Winter Break
+4
Senior ML Infra Engineer - Kubernetes & Cloud
Senior ML Infra Engineer - Kubernetes & Cloud

Philo • Cambridge (MA)

Remote
USD 185,000 - 240,000
Full health coverage
401(k) plan with company match
Flexible working hours
+2
Senior Kubernetes Infra Engineer for AI Cloud
Senior Kubernetes Infra Engineer for AI Cloud

Frontdoor Defense • San Francisco (CA)

Hybrid
USD 230,000 - 346,000
Health, dental, vision coverage
401k with company match (USA)
Senior Training Infrastructure Engineer - Go & Kubernetes
Senior Training Infrastructure Engineer - Go & Kubernetes

present of AI • San Francisco (CA)

On-site
USD 190,000 - 260,000
Senior ML Infra Engineer — Kubernetes & GitOps
Senior ML Infra Engineer — Kubernetes & GitOps

Schrodinger, Inc. • New York (NY)

On-site
USD 110,000 - 160,000
Healthcare
401k
Pre-tax commuter benefits
+2
ML Infra Engineer | Scalable Inference & Kubernetes
ML Infra Engineer | Scalable Inference & Kubernetes

Fdetimes • San Francisco (CA)

On-site
USD 180,000 - 250,000
14 paid holidays
Health insurance
HSA contributions
+5
Senior ML Infra Engineer (Kubernetes, GPUs, MLOps)
Senior ML Infra Engineer (Kubernetes, GPUs, MLOps)

Philo, Inc. • San Francisco (CA), New York (NY), Cambridge (MA)

Hybrid
USD 195,000 - 250,000
Health benefits
401(k) with employer match
Flexible working hours
+4
Senior Go & Kubernetes Infra Engineer
Senior Go & Kubernetes Infra Engineer

Mistral • United States

Remote
USD 180,000 - 260,000
Senior ML Infra Engineer: Build & Scale AI Systems
Senior ML Infra Engineer: Build & Scale AI Systems

Goliath Partners Inc. • San Francisco (CA)

On-site
USD 180,000 - 240,000