Senior AI Platform Engineer: LLM & Agents, Remote-First

Coinbase; Denver (CO); Hybrid; USD 186,000 - 219,000; Full time

Job summary

Coinbase is hiring a Senior Software Engineer for the AI Platform team. You will build and operate LLM and agent infrastructure used company-wide, shaping how Coinbase scales AI.

You’ll lead end-to-end platform initiatives, from gateway and runtimes to knowledge bases and governance, partnering with security, legal, and product teams. You’ll drive cross-functional design, implement cost-aware AI capabilities, and deliver production-grade systems with strong observability and compliance.

Qualifications

• 5 years of software engineering experience building ML/AI infrastructure, LLM systems, or distributed platform services at scale.
• Experience leading multi-quarter initiatives end-to-end from design to production.
• Deep expertise in LLM orchestration patterns and vector databases.
• Proven track record partnering with security, legal, and product teams on production AI systems.
• Fluent Python and a systems language (Go, Rust, or C++) with API and microservice experience.

Responsibilities

• Own architecture and delivery of core platform systems including the LLM Gateway, AI Hub, and agent runtime.
• Drive design and implementation of Knowledge Base infrastructure connected to auto-provisioned stores.
• Lead AI FinOps capabilities including spend attribution, governance, and cost optimization.
• Partner with security, legal, finance, product and cloud providers to ship high-impact platform capabilities.
• Build evaluation and observability tooling including LLM-as-judge harnesses and full tracing.

Skills

Python

Go

Rust

C++

LLM systems

Distributed systems

Job description

Coinbase is hiring a Senior Software Engineer for the AI Platform team. You will build and operate LLM and agent infrastructure used company-wide, shaping how Coinbase scales AI.

You’ll lead end-to-end platform initiatives, from gateway and runtimes to knowledge bases and governance, partnering with security, legal, and product teams. You’ll drive cross-functional design, implement cost-aware AI capabilities, and deliver production-grade systems with strong observability and compliance.