Senior AI Platform Engineer — LLM & Agent Infra Lead

Coinbase; Montgomery (AL); Hybrid; USD 186,000 - 219,000; Full time

Benefits offered by this job

Medical insurance

401(k)

Equity opportunities

Job summary

Coinbase is seeking a Senior Software Engineer for the AI Platform team within the Platform group. You will build and operate the LLM and agent infrastructure that powers the company, owning core platform systems from gateway to runtime with governance and cost optimization.

You will lead multi-quarter initiatives, connect data sources to knowledge bases, and enable scalable AI across the organization. Strong Python and systems language skills are essential for production APIs and runtimes.

Qualifications

• 5+ years of software engineering experience building ML/AI infrastructure or distributed platform services at scale.
• Proven ability to lead multi-quarter initiatives from design to production operation with measurable impact.
• Deep expertise in LLM orchestration patterns and agent frameworks across providers.
• Cross-functional collaboration with security, legal, and product to ship production AI systems.

Responsibilities

• Own architecture and delivery of core platform systems including the LLM Gateway, AI Hub, and agent runtime with microVM sandboxes.
• Drive design and implementation of Knowledge Base infrastructure connecting data sources to vector stores and markdown stores.
• Lead AI FinOps capabilities including spend attribution, governance, and cost optimization across AI workloads.
• Partner with security, legal, finance, product, and external partners to ship high-impact platform capabilities.
• Build evaluation and observability tooling including LLM-as-judge harnesses and full tracing for production agents.
• Shape applied AI strategy by embedding with teams to build production agents, including fine-tuning where appropriate.

Skills

LLM orchestration

Python

Go/Rust/C

ML/AI infrastructure

Distributed platform services

Tools

Vector databases

Model serving infrastructure

MicroVM sandboxes

Job description

Coinbase is seeking a Senior Software Engineer for the AI Platform team within the Platform group. You will build and operate the LLM and agent infrastructure that powers the company, owning core platform systems from gateway to runtime with governance and cost optimization.

You will lead multi-quarter initiatives, connect data sources to knowledge bases, and enable scalable AI across the organization. Strong Python and systems language skills are essential for production APIs and runtimes.