Senior AI Platform Engineer: LLM & Agent Infrastructure

Coinbase; Columbia (SC); On-site; USD 186,000 - 219,000; Full time

Job summary

Coinbase, a remote-first company, seeks a Senior Software Engineer for the AI Platform team. You will build and operate the LLM and agent infrastructure used across Coinbase, enabling teams to scale AI responsibly and effectively.

You’ll own core platform systems, design Knowledge Base infrastructure, and lead multi-quarter initiatives from design through production. Collaborate with security, legal, finance, product, and cloud partners to deliver high-impact capabilities.

Qualifications

• 5 years of software engineering experience with ML/AI infrastructure, LLM systems, or distributed platform services.
• Demonstrated ability to lead multi-quarter initiatives end-to-end, from technical design through production operation.
• Deep expertise in LLM orchestration patterns, agent frameworks, vector databases, and model serving infrastructure across providers.
• Proven track record of cross-functional partnership with security, legal, and product teams to ship governed AI systems.
• Fluency in Python and at least one systems language (Go, Rust, or C++) with API/microservices experience.

Responsibilities

• Own the architecture and delivery of core platform systems including the LLM Gateway, AI Hub, and agent runtime with microVM sandboxes.
• Drive the design and implementation of Knowledge Base infrastructure connected to data sources and vector stores.
• Lead AI FinOps capabilities including spend attribution, governance, and cost optimization across AI workloads.
• Partner with security, legal, finance, product, and external cloud providers to ship high-impact platform features.
• Build evaluation and observability tooling including LLM-as-judge harnesses with tracing and feedback loops.
• Shape applied AI strategy by embedding with teams to build production agents and optimize prompts with fine-tuning.

Skills

Python

LLM orchestration

Agent frameworks

Vector databases

Model serving infra

Cross-functional collaboration

Go,Rust,C++

Job description

Coinbase, a remote-first company, seeks a Senior Software Engineer for the AI Platform team. You will build and operate the LLM and agent infrastructure used across Coinbase, enabling teams to scale AI responsibly and effectively.

You’ll own core platform systems, design Knowledge Base infrastructure, and lead multi-quarter initiatives from design through production. Collaborate with security, legal, finance, product, and cloud partners to deliver high-impact capabilities.