Senior ML Platform Engineer — Scalable AI Infra

Chime; San Francisco (CA); On-site; USD 187,000 - 259,000; Full time

Benefits offered by this job

Health benefits

Parental leave

Wellness stipend

Commuter benefits

Job summary

Chime is seeking a Senior Software Engineer for the Machine Learning Platform to design, build, and operate scalable ML and AI infrastructure on AWS. You will enable data scientists and ML engineers to train, deploy, and monitor models, while advancing observability and governance across traditional ML and AI workloads.

You will contribute to feature stores, streaming data pipelines, and CI/CD for ML models, collaborate with Data Science teams, and participate in on-call rotations to support

Qualifications

• 5+ years of experience in ML or AI infrastructure, platform engineering, distributed systems, or production ML systems.
• Experience designing distributed systems and large-scale data or compute platforms on AWS using frameworks such as Spark or Ray.
• Hands-on experience with CI/CD pipelines, DevOps practices, and infrastructure as code.
• Strong programming skills in Python, Go, Scala, Java, or similar languages.

Responsibilities

• Design, build, and operate scalable ML and AI infrastructure on AWS.
• Design and operate shared platform capabilities for LLM and agentic workloads, including model access and tool integration.
• Build evaluation frameworks for non-deterministic AI systems with offline benchmarks and online signals.
• Establish observability, reliability, and governance for models and agents, including latency, token usage, and cost.
• Help teams make principled architecture decisions across ML workloads and agentic workflows.
• Build distributed training, batch inference, and large-scale processing systems using Spark or Ray.
• Develop infrastructure as code using Terraform and manage CI/CD for ML models and AI apps.
• Support data ingestion and streaming with Kinesis, Kafka, Flink, or Spark.

Skills

Python

Go

Scala/Java

Distributed systems

CI/CD

Observability

DevOps

Tools

Docker

Kubernetes

Terraform

Spark

Ray

Kafka

Flink

AWS

Job description

Chime is seeking a Senior Software Engineer for the Machine Learning Platform to design, build, and operate scalable ML and AI infrastructure on AWS. You will enable data scientists and ML engineers to train, deploy, and monitor models, while advancing observability and governance across traditional ML and AI workloads.

You will contribute to feature stores, streaming data pipelines, and CI/CD for ML models, collaborate with Data Science teams, and participate in on-call rotations to support