Senior ML Platform Engineer - Cloud, Kubernetes & CI/CD

Jobtailor; New York (NY); On-site; USD 140,000 - 190,000; Full time

Job summary

Jobtailor is seeking an experienced platform/DevOps engineer to design and maintain infrastructure for ML training, deployment, and inference. You will own CI/CD, IaC, observability, and operational tooling to support reliable, scalable ML workloads.

Responsibilities include operating distributed systems in production, building Kubernetes- and cloud-based services, and collaborating with data scientists and engineers to optimize model deployment and data workflows.

Qualifications

• Bachelor’s or Master’s degree in Computer Science, Engineering, or related field.
• 7+ years of experience in software engineering, platform engineering, or DevOps/SRE roles.
• Strong systems engineering background with production operations experience.
• Hands-on experience with cloud infrastructure and tooling (AWS, Docker, Kubernetes, Terraform, CI/CD, monitoring).
• Experience operating distributed systems in production.
• Experience with ML infrastructure, model serving, or data platforms is a strong plus.

Responsibilities

• Design, build, and maintain infrastructure supporting ML training, deployment, and inference workloads.
• Own and improve CI/CD, infrastructure-as-code, observability, and operational tooling for ML systems.
• Operate and evolve production systems with a strong focus on reliability, performance, and cost efficiency.
• Build and maintain Kubernetes- and cloud-based services that support model execution and data workflows.
• Partner with data scientists and engineers to support model deployment and operational needs.
• Improve developer workflows through automation, tooling, and platform abstractions.
• Participate in on-call and operational ownership for platform components.

Skills

Problem-Solving

Operations-First Mindset

Adaptability

Team Collaboration

Education

Bachelor’s Degree

Master’s Degree

Tools

AWS

Docker

Kubernetes

Terraform

CI/CD

Monitoring

Observability

Infrastructure-as-Code

Automation

Cloud Infrastructure

Job description

Jobtailor is seeking an experienced platform/DevOps engineer to design and maintain infrastructure for ML training, deployment, and inference. You will own CI/CD, IaC, observability, and operational tooling to support reliable, scalable ML workloads.

Responsibilities include operating distributed systems in production, building Kubernetes- and cloud-based services, and collaborating with data scientists and engineers to optimize model deployment and data workflows.