Senior AI Platform Engineer: Scale LLMs & Agents (Remote)

Coinbase; Jackson (MS); On-site; USD 186,000 - 219,000; Full time

Job summary

Coinbase is seeking a Senior Software Engineer for the AI Platform team. You will own architecture and delivery of core platform systems, including LLM gateway, AI hub, and agent runtime.

You will lead cross-functional efforts with security, legal, finance, product, and cloud partners to ship high-impact AI capabilities and cost-optimized solutions. You will drive knowledge base infra, FinOps governance, and observability tooling, enabling scalable, responsible AI across the organization.

Qualifications

• 5+ years of software engineering experience with demonstrated expertise building ML/AI infrastructure, LLM systems, or distributed platform services at scale
• Demonstrated ability to lead multi-quarter initiatives end-to-end, from technical design through production operation, with measurable platform-wide impact
• Deep expertise in LLM orchestration patterns, agent frameworks, vector databases, and model serving infrastructure across multiple providers
• Proven track record of cross-functional partnership with security, legal, and product teams to ship governed, production-grade AI systems
• Fluency in Python and at least one systems language (Go, Rust, or C++), with production experience building APIs, microservices, and runtime environments
• Utilizes generative AI responsibly, maintaining human oversight to deliver business-ready outputs and drive measurable improvements in workflow efficiency, cost, and quality.

Responsibilities

• Own the architecture and delivery of core platform systems including the LLM Gateway (60+ models, auth, PII redaction, fallbacks, cost optimization), AI Hub, and agent runtime with microVM sandboxes and governed MCP gateway
• Drive the design and implementation of Knowledge Base infrastructure, connecting data sources to auto-provisioned vector and markdown stores queryable by any agent
• Lead AI FinOps capabilities including spend attribution, governance, and cost optimization across all AI workloads company-wide
• Partner across engineering, security, legal, finance, product, and external partners at frontier labs and major cloud providers to ship high-impact platform capabilities
• Build evaluation and observability tooling including LLM-as-judge harnesses, full tracing, and feedback loops that let subject matter experts refine production agents
• Shape applied AI strategy by embedding with teams to build production agents, applying fine-tuning and traditional ML where it outperforms prompting

Skills

Software engineering

Lead initiatives

LLM orchestration

Python

Go/Rust/C++

Tools

APIs

Microservices

Runtime environments

Job description

Coinbase is seeking a Senior Software Engineer for the AI Platform team. You will own architecture and delivery of core platform systems, including LLM gateway, AI hub, and agent runtime.

You will lead cross-functional efforts with security, legal, finance, product, and cloud partners to ship high-impact AI capabilities and cost-optimized solutions. You will drive knowledge base infra, FinOps governance, and observability tooling, enabling scalable, responsible AI across the organization.