Senior AI Platform Engineer - LLM & Agent Infra Lead

Coinbase; Atlanta (GA); Hybrid; USD 186,000 - 219,000; Full time

Job summary

Coinbase is seeking a Senior Software Engineer for the AI Platform to build and operate the LLM and agent infrastructure used company-wide. You will own core platform systems, including the LLM Gateway, AI Hub, and agent runtime with sandboxing and governance, enabling scalable AI across Coinbase.

You will lead multi-quarter initiatives, partner with security, legal, finance and product teams, and drive cost optimization and observability across AI workloads, shaping the future of enterprise AI

Qualifications

• 5 years of software engineering experience with ML/AI infra, LLM systems or large-scale platform services.
• Proven track record leading cross-functional work with security, legal and product teams.
• Fluency in Python and at least one systems language (Go, Rust or C).

Responsibilities

• Own architecture and delivery of core platform systems including the LLM Gateway and agent runtime.
• Design Knowledge Base infrastructure connecting data sources to vector/markdown stores.
• Lead AI FinOps capabilities across all AI workloads with governance and cost optimization.
• Collaborate with security, legal, product and cloud providers to ship platform capabilities.
• Build evaluation and observability tooling for production agents and governance.
• Shape applied AI strategy with teams on production agents and ML techniques.

Skills

Python

Go

Rust

C

LLM infrastructure

API design

Distributed systems

Job description

Coinbase is seeking a Senior Software Engineer for the AI Platform to build and operate the LLM and agent infrastructure used company-wide. You will own core platform systems, including the LLM Gateway, AI Hub, and agent runtime with sandboxing and governance, enabling scalable AI across Coinbase.

You will lead multi-quarter initiatives, partner with security, legal, finance and product teams, and drive cost optimization and observability across AI workloads, shaping the future of enterprise AI