Senior ML Platform Engineer - Low-Latency Inference

Coinbase, Inc.; Augusta (ME); Hybrid; USD 191,000 - 225,000; Full time

Job summary

Coinbase is seeking a Senior Machine Learning Platform Engineer to build scalable ML infrastructure powering feature engineering, model training, and inference across our platform. You will own systems for streaming, distributed training, and highly available inference, collaborating with ML engineers and platform teams.

You'll mentor junior engineers, drive reliability, and shape how ML scales at Coinbase while maintaining responsible AI practices and high standards of software quality.

Qualifications

• 5+ years of industry experience as a software engineer with distributed systems in production.
• Experience building low-latency ML infrastructure (streaming pipelines, online serving systems, or distributed training).
• Track record of mentoring engineers and raising team engineering quality through code reviews, design reviews, and technical leadership.
• Familiarity with ML platform components (feature stores, model serving frameworks, training orchestration) sufficient to partner with ML engineers as a platform builder.
• Uses generative AI responsibly, maintaining human oversight to deliver business-ready outputs and drive measurable improvements in workflow efficiency, cost, and quality.

Responsibilities

• Own the design and reliability of ML inference infrastructure serving both predictive models and LLMs, maintaining high availability and low latency at scale.
• Build and optimize low-latency streaming pipelines that deliver fresh, high-quality feature data to production ML models.
• Drive improvements to distributed training infrastructure, enabling ML engineers to process large data volumes efficiently.
• Develop observability tooling to monitor data quality entering models and detect degradations impacting model performance.
• Mentor junior engineers on building production-grade software, raising the team's engineering standards over time.

Skills

Distributed systems

Low-latency ML infra

Mentoring engineers

ML platform components

Production-grade software

Tools

Streaming pipelines

Model serving frameworks

Training orchestration

Job description

Coinbase is seeking a Senior Machine Learning Platform Engineer to build scalable ML infrastructure powering feature engineering, model training, and inference across our platform. You will own systems for streaming, distributed training, and highly available inference, collaborating with ML engineers and platform teams.

You'll mentor junior engineers, drive reliability, and shape how ML scales at Coinbase while maintaining responsible AI practices and high standards of software quality.