Senior ML Platform Engineer — Scalable AI Infra

Chime

San Francisco (CA)

On-site

USD 187,000 - 259,000

Full time

14 days+

Get a reply from this employer

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Benefits offered by this job

Health benefits
Parental leave
Wellness stipend
Commuter benefits

Job summary

Chime is seeking a Senior Software Engineer for the Machine Learning Platform to design, build, and operate scalable ML and AI infrastructure on AWS. You will enable data scientists and ML engineers to train, deploy, and monitor models, while advancing observability and governance across traditional ML and AI workloads.

You will contribute to feature stores, streaming data pipelines, and CI/CD for ML models, collaborate with Data Science teams, and participate in on-call rotations to support

Qualifications

  • 5+ years of experience in ML or AI infrastructure, platform engineering, distributed systems, or production ML systems.
  • Experience designing distributed systems and large-scale data or compute platforms on AWS using frameworks such as Spark or Ray.
  • Hands-on experience with CI/CD pipelines, DevOps practices, and infrastructure as code.
  • Strong programming skills in Python, Go, Scala, Java, or similar languages.

Responsibilities

  • Design, build, and operate scalable ML and AI infrastructure on AWS.
  • Design and operate shared platform capabilities for LLM and agentic workloads, including model access and tool integration.
  • Build evaluation frameworks for non-deterministic AI systems with offline benchmarks and online signals.
  • Establish observability, reliability, and governance for models and agents, including latency, token usage, and cost.
  • Help teams make principled architecture decisions across ML workloads and agentic workflows.
  • Build distributed training, batch inference, and large-scale processing systems using Spark or Ray.
  • Develop infrastructure as code using Terraform and manage CI/CD for ML models and AI apps.
  • Support data ingestion and streaming with Kinesis, Kafka, Flink, or Spark.

Skills

Python
Go
Scala/Java
Distributed systems
CI/CD
Observability
DevOps

Tools

Docker
Kubernetes
Terraform
Spark
Ray
Kafka
Flink
AWS

Job description

Chime is seeking a Senior Software Engineer for the Machine Learning Platform to design, build, and operate scalable ML and AI infrastructure on AWS. You will enable data scientists and ML engineers to train, deploy, and monitor models, while advancing observability and governance across traditional ML and AI workloads.

You will contribute to feature stores, streaming data pipelines, and CI/CD for ML models, collaborate with Data Science teams, and participate in on-call rotations to support

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Senior ML Platform Engineer — AI Infra & Tools
Senior ML Platform Engineer — AI Infra & Tools

Chime Enterprise • San Francisco (CA)

Hybrid
USD 187,000 - 259,000
Health benefits
Wellbeing benefits
Vacation policy
+1
Director of ML Platform & AI Strategy
Director of ML Platform & AI Strategy

Chime • San Francisco (CA)

On-site
USD 269,000 - 373,000
Health benefits
Wellness stipend
Parental leave
+2
Lead ML Platform Engineer – Scalable AI Infrastructure
Lead ML Platform Engineer – Scalable AI Infrastructure

Testing Site - JPMC • New York (NY)

On-site
USD 180,000 - 240,000
Senior ML Platform Engineer — Scalable AI Infra
Senior ML Platform Engineer — Scalable AI Infra

Blue River Technology • United States

Remote
USD 160,000 - 287,000
Senior ML Platform Engineer — Real-Time, Scalable AI
Senior ML Platform Engineer — Real-Time, Scalable AI

super • United States

On-site
USD 140,000 - 190,000
Medical / Health Insurance
Open Annual Leave
Employee Assistance Programme
+1
ML Platform Engineer — Build Scalable AI Infra & Inference
ML Platform Engineer — Build Scalable AI Infra & Inference

Not Specified • United States

Remote
USD 140,000 - 180,000
Senior ML Platform Engineer - Scalable ML Infrastructure
Senior ML Platform Engineer - Scalable ML Infrastructure

Testing Site - JPMC • New York (NY)

On-site
USD 140,000 - 190,000
Senior AI/ML Platform Engineer for Scalable Infra
Senior AI/ML Platform Engineer for Scalable Infra

Employee Relations Associates, Inc. • Denver (CO)

Hybrid
USD 170,000 - 210,000
Medical coverage
Dental coverage
Vision coverage
+4
Principal ML Platform Engineer - Scalable, Reliable Systems
Principal ML Platform Engineer - Scalable, Reliable Systems

EngineersOfAI • Sunnyvale (CA)

On-site
USD 150,000 - 200,000
Senior ML Platform Engineer — Build Scalable AI Infra
Senior ML Platform Engineer — Build Scalable AI Infra

Klaviyo • Boston (MA)

On-site
USD 148,000 - 222,000