Software Engineer - Training Infrastructure

Cloudjobs; New York (NY); On-site; USD 140,000 - 210,000; Full time

Benefits offered by this job

Equity

Medical insurance

Dental insurance

Vision insurance

Flexible PTO

Winter Break

Paid parental leave

Fertility and family-building stipend

401(k)

Job summary

Cloudjobs seeks a senior engineer in New York with deep expertise in Go, Kubernetes, and distributed systems to run ML/AI workloads in production. You will design and operate scalable cloud architectures and observability stacks, ensuring reliability and performance across modern data platforms.

The role emphasizes production-grade engineering, scalable infrastructure, and collaboration with data science teams to optimize models and pipelines using MLOps practices.

Qualifications

• Requires a CS degree and deep expertise in Go and Kubernetes in production.
• Strong understanding of distributed systems.
• Experience with ML/AI workloads.

Skills

Go

Kubernetes

Distributed Systems

Python

MLOps

Observability Systems

Infrastructure Architecture

Scheduling

Networking

Temporal

Education

Bachelor or higher in CS

Tools

PyTorch

DeepSpeed

FSDP

Temporal

Airflow

Job description

Requirements

Requires a degree in Computer Science and deep expertise in Go and Kubernetes within production environments. Candidates must have a strong understanding of distributed systems and experience with ML/AI workloads.

Key Skills

• Go
• Kubernetes
• Distributed Systems
• Python
• AWS
• GCP
• MLOps
• Observability Systems
• Infrastructure Architecture
• Scheduling
• Networking
• PyTorch
• DeepSpeed
• FSDP
• Temporal
• Airflow

Benefits

• Equity
• Medical insurance
• Dental insurance
• Vision insurance
• Flexible PTO
• Winter Break
• Paid parental leave
• Fertility and family-building stipend
• 401(k)