Remote-First Senior Software Engineer, AI Platform & LLM

Coinbase; United States; Hybrid; USD 186,000 - 219,000; Full time

Benefits offered by this job

Equity

Bonus eligibility

Medical, dental, vision

401(k)

In-person surges (quarterly)

Job summary

Coinbase is seeking a Senior Software Engineer for the AI Platform team to build and operate the LLM and agent infrastructure powering our enterprise. You will own architecture and delivery of core platform systems, including the LLM Gateway and AI Hub, and lead multi-quarter initiatives across governance, cost optimization, and observability.

You will collaborate with security, legal, finance, product, and cloud partners to ship production-grade AI capabilities at scale, with a focus on safe

Qualifications

• 5+ years of software engineering experience building ML/AI infrastructure, LLM systems, or distributed platform services at scale.
• Proven ability to lead multi-quarter initiatives end-to-end with measurable platform-wide impact.
• Fluency in Python and at least one systems language (Go, Rust, or C++) with API/microservice experience.

Responsibilities

• Own the architecture and delivery of core platform systems including the LLM Gateway, AI Hub, and agent runtime with microVM sandboxes.
• Drive design and implementation of Knowledge Base infrastructure connecting data sources to vector and markdown stores.
• Lead AI FinOps capabilities including spend attribution, governance, and cost optimization across AI workloads.
• Partner with security, legal, finance, product, and external partners to ship platform capabilities.
• Build evaluation and observability tooling including LLM-as-judge harnesses and tracing.

Skills

LLM orchestration

Python

Go/Rust/C++

ML/AI infrastructure

Cross-functional collaboration

Job description

Coinbase is seeking a Senior Software Engineer for the AI Platform team to build and operate the LLM and agent infrastructure powering our enterprise. You will own architecture and delivery of core platform systems, including the LLM Gateway and AI Hub, and lead multi-quarter initiatives across governance, cost optimization, and observability.

You will collaborate with security, legal, finance, product, and cloud partners to ship production-grade AI capabilities at scale, with a focus on safe