Staff AI Platform Engineer: LLM & Agent Infrastructure Lead

Coinbase; Frankfort (KY); Hybrid; USD 218,000 - 257,000; Full time

Benefits offered by this job

Equity

Bonus eligibility

Medical benefits

Dental benefits

Vision benefits

401(k)

Job summary

Coinbase is seeking a Staff Software Engineer for the AI Platform team to architect and operate scalable LLM and agent infrastructure that powers the company’s AI initiatives. You will own core platform systems, drive knowledge-base infrastructure, and lead cost governance across all AI workloads.

This role requires deep ML/AI infrastructure experience and collaboration with security, legal, and product partners.

Qualifications

• 8+ years of software engineering experience with at least 3 years in ML/AI infrastructure or distributed platform services at scale.
• Proven ability to lead multi-quarter, Staff-level initiatives end-to-end with measurable impact.
• Deep expertise in LLM orchestration, agent frameworks, and model serving across providers.
• Strong collaboration with security, legal, and product teams to ship production AI systems.

Responsibilities

• Own architecture and delivery of core platform systems including LLM Gateway, AI Hub, and agent runtime.
• Drive design of Knowledge Base infrastructure connecting data sources to vector stores.
• Lead AIFinOps capabilities including spend attribution and governance across AI workloads.
• Partner with engineering, security, legal, finance, product and cloud providers to ship platform capabilities.
• Build evaluation and observability tooling for production agents with tracing and feedback loops.
• Shape applied AI strategy by embedding with teams to build production agents with fine-tuning where appropriate.

Skills

Python

Go

Rust

LLM infrastructure

APIs

Tools

Vector databases

API gateways

Cloud services

Job description

Coinbase is seeking a Staff Software Engineer for the AI Platform team to architect and operate scalable LLM and agent infrastructure that powers the company’s AI initiatives. You will own core platform systems, drive knowledge-base infrastructure, and lead cost governance across all AI workloads.

This role requires deep ML/AI infrastructure experience and collaboration with security, legal, and product partners.