Senior ML Platform Engineer: Real-Time AI Infra

Harnham; New York (NY); Hybrid; USD 150,000 - 190,000; Full time

Benefits offered by this job

Competitive base salary and annual be

Equity participation through RSUs

Opportunity to work on cutting-edge AI

Career growth and technical leadership

Exposure to large-scale real-time prod

Job summary

Harnham is partnering with a leading consumer technology and financial services organization to advance a large-scale ML platform in New York. You will design, build, and operate distributed backend services powering real-time recommendation and personalization at scale.

Join a growing ML engineering team focusing on production-grade infrastructure, cloud-native deployments, and robust observability. This role offers significant leadership opportunities and exposure to cutting-edge AI systems.

Qualifications

• 7+ years of software or ML engineering experience.
• Backend engineering with distributed systems experience.
• Scala-based microservices and production-grade backend apps.
• Deep knowledge of AWS cloud services.
• Hands-on with Kubernetes, Docker, Terraform, and CI/CD practices.
• Track record of owning production systems, reliability, and monitoring.

Responsibilities

• Design, build, and maintain scalable ML training, deployment, and inference infra.
• Develop and optimize backend services and cloud-native apps for real-time ML systems.
• Own ML platform capabilities across cloud, model serving, and observability.
• Collaborate with Data Scientists to productionize models for real-time recommendations.
• Improve CI/CD pipelines, IaC, observability, and system reliability.
• Participate in incident response and support for critical production services.

Skills

Scala microservices

Distributed systems

AWS cloud

CI/CD

Reliability & observability

Production systems ownership

Tools

Kubernetes

Docker

Terraform

Job description

Harnham is partnering with a leading consumer technology and financial services organization to advance a large-scale ML platform in New York. You will design, build, and operate distributed backend services powering real-time recommendation and personalization at scale.

Join a growing ML engineering team focusing on production-grade infrastructure, cloud-native deployments, and robust observability. This role offers significant leadership opportunities and exposure to cutting-edge AI systems.