Go & Kubernetes Training Infra Engineer for ML

Cloudjobs

New York (NY)

On-site

USD 140,000 - 210,000

Full time

4 days ago
Be an early applicant
Application generator

Don’t send a generic resume — generate a resume and cover letter tailored to this exact role.

Get past ATS filters

Benefits offered by this job

Equity
Medical insurance
Dental insurance
Vision insurance
Flexible PTO
Winter Break
Paid parental leave
Fertility and family-building stipend
401(k)

Job summary

Cloudjobs seeks a senior engineer in New York with deep expertise in Go, Kubernetes, and distributed systems to run ML/AI workloads in production. You will design and operate scalable cloud architectures and observability stacks, ensuring reliability and performance across modern data platforms.

The role emphasizes production-grade engineering, scalable infrastructure, and collaboration with data science teams to optimize models and pipelines using MLOps practices.

Qualifications

  • Requires a CS degree and deep expertise in Go and Kubernetes in production.
  • Strong understanding of distributed systems.
  • Experience with ML/AI workloads.

Skills

Go
Kubernetes
Distributed Systems
Python
MLOps
Observability Systems
Infrastructure Architecture
Scheduling
Networking
Temporal

Education

Bachelor or higher in CS

Tools

PyTorch
DeepSpeed
FSDP
Temporal
Airflow

Job description

Cloudjobs seeks a senior engineer in New York with deep expertise in Go, Kubernetes, and distributed systems to run ML/AI workloads in production. You will design and operate scalable cloud architectures and observability stacks, ensuring reliability and performance across modern data platforms.

The role emphasizes production-grade engineering, scalable infrastructure, and collaboration with data science teams to optimize models and pipelines using MLOps practices.

Get your free, confidential resume review.
or drag and drop your file here.
Similar jobs

Similar jobs worth comparing

Senior Cloud & DevOps Engineer for ML Infra
Senior Cloud & DevOps Engineer for ML Infra

Confidential • Austin (TX)

On-site
USD 150,000 - 200,000
Scale AI Infra Engineer | Kubernetes & CI/CD
Scale AI Infra Engineer | Kubernetes & CI/CD

BaseTen • New York (NY), San Francisco (CA)

Hybrid
USD 160,000 - 210,000
Meaningful equity
100% medical, dental, vision coverage
Flexible PTO including Winter Break
+4
MLOps Engineer MLOps Engineer
MLOps Engineer MLOps Engineer

Kurai • Austin (TX)

On-site
USD 140,000 - 190,000
Texas or California location role of Cloud & DevOps Engineer (ML Infrastructure)
Texas or California location role of Cloud & DevOps Engineer (ML Infrastructure)

Confidential • Austin (TX)

On-site
USD 150,000 - 200,000
ML Inference Platform Engineer (Kubernetes)
ML Inference Platform Engineer (Kubernetes)

Baseten • New York (NY)

On-site
USD 165,000 - 330,000
Software Engineer, Fleet Infra on Hyperscale Azure & Kubernetes
Software Engineer, Fleet Infra on Hyperscale Azure & Kubernetes

Cloudjobs • New York (NY)

On-site
USD 140,000 - 210,000
Relocation assistance
Remote ML DevOps Engineer for Scalable AI Infra
Remote ML DevOps Engineer for Scalable AI Infra

Pathway • Palo Alto (CA)

Hybrid
USD 150,000 - 190,000
ML Infra Tech Lead: Scalable Training & Inference
ML Infra Tech Lead: Scalable Training & Inference

Reducto • San Francisco (CA)

On-site
USD 180,000 - 260,000
Unlimited PTO
Daily Lunch
Commuter Reimbursement
+3
MLOps Engineer
MLOps Engineer

InfoVision Inc. • Irving (TX)

On-site
USD 100,000 - 130,000
Senior Solutions Engineer: AI Infra, Kubernetes & MLOps
Senior Solutions Engineer: AI Infra, Kubernetes & MLOps

Crusoe Energy Systems LLC • New York (NY)

On-site
USD 175,000 - 250,000
Competitive compensation and equity packages
Comprehensive health, dental & vision insurance
Paid parental leave
+3