Senior ML Platform Engineer: Low-Latency Inference

Coinbase; Northern (KY); Hybrid; USD 191,000 - 225,000; Full time

Benefits offered by this job

Medical coverage

Dental coverage

Vision coverage

401(k)

Job summary

Coinbase is a remote-first company building the future of finance. The Senior Machine Learning Platform Engineer will design and maintain ML inference infrastructure, streaming pipelines, and distributed training systems to support feature engineering, model training, and model serving.

You will mentor engineers, drive observability, and collaborate with ML engineers as a platform builder while upholding responsible use of generative AI and ensuring high availability and low latency.

Qualifications

• 5+ years of industry experience as a software engineer with distributed systems ownership.
• Experience building low-latency data or ML infrastructure processing data at scale.
• Proven mentoring experience and improving engineering quality through reviews.
• Familiarity with ML platform components to partner with ML engineers.

Responsibilities

• Own the design and reliability of ML inference infrastructure serving both predictive models and LLMs, maintaining high availability and low latency at scale.
• Build and optimize low-latency streaming pipelines that deliver fresh, high-quality feature data to production ML models.
• Drive improvements to distributed training infrastructure enabling ML engineers to process large data volumes efficiently.
• Develop observability tooling to monitor data quality entering models and detect degradations impacting model performance.
• Mentor junior engineers on building production-grade software, raising the team's engineering standards over time.

Skills

Distributed systems

Low-latency streaming

Mentoring engineers

Model serving frameworks

Training orchestration

Observability tooling

Generative AI governance

Tools

Streaming pipelines

Distributed training

Feature stores

Model serving frameworks

Observability tooling

Job description

Coinbase is a remote-first company building the future of finance. The Senior Machine Learning Platform Engineer will design and maintain ML inference infrastructure, streaming pipelines, and distributed training systems to support feature engineering, model training, and model serving.

You will mentor engineers, drive observability, and collaborate with ML engineers as a platform builder while upholding responsible use of generative AI and ensuring high availability and low latency.