Remote-First Senior AI Platform Engineer

Coinbase; Salt Lake City (UT); Hybrid; USD 186,000 - 219,000; Full time

Job summary

Coinbase is hiring a Senior Software Engineer for the AI Platform team to build and operate LLM and agent infrastructure used company-wide. You will lead multi-quarter initiatives spanning gateway, runtime systems, knowledge bases, and governance, with emphasis on scalable, production-ready AI capabilities.

You’ll collaborate with security, legal, finance, product, and cloud partners to ship high-impact platform features and drive FinOps and observability tooling.

Qualifications

• 5+ years of software engineering experience building ML/AI infrastructure, LLM systems, or distributed platform services at scale.
• Proven ability to lead multi-quarter initiatives end-to-end with measurable platform-wide impact.
• Deep expertise in LLM orchestration patterns, agent frameworks, and model serving infrastructure.

Responsibilities

• Own the architecture and delivery of core platform systems including the LLM Gateway, AI Hub, and agent runtime with microVM sandboxes.
• Drive design and implementation of Knowledge Base infrastructure for auto-provisioned vector/markdown stores
• Lead AI FinOps capabilities including spend attribution, governance, and cost optimization across AI workloads
• Partner across engineering, security, legal, finance, product teams to ship platform capabilities
• Build evaluation and observability tooling including LLM-as-judge harnesses, tracing, and feedback loops
• Shape applied AI strategy by embedding with teams to build production agents and fine-tuning workflows

Skills

LLM orchestration

Python

Distributed systems

Cross-functional collaboration

API design

Tools

LLM Gateway

Vector databases

APIs

Job description

Coinbase is hiring a Senior Software Engineer for the AI Platform team to build and operate LLM and agent infrastructure used company-wide. You will lead multi-quarter initiatives spanning gateway, runtime systems, knowledge bases, and governance, with emphasis on scalable, production-ready AI capabilities.

You’ll collaborate with security, legal, finance, product, and cloud partners to ship high-impact platform features and drive FinOps and observability tooling.