Senior Software Engineer – AI Platform Team

Coinbase; Montgomery (AL); Hybrid; USD 186,000 - 219,000; Full time

Benefits offered by this job

Medical insurance

401(k)

Equity opportunities

Job summary

Coinbase is seeking a Senior Software Engineer for the AI Platform team within the Platform group. You will build and operate the LLM and agent infrastructure that powers the company, owning core platform systems from gateway to runtime with governance and cost optimization.

You will lead multi-quarter initiatives, connect data sources to knowledge bases, and enable scalable AI across the organization. Strong Python and systems language skills are essential for production APIs and runtimes.

Qualifications

• 5+ years of software engineering experience building ML/AI infrastructure or distributed platform services at scale.
• Proven ability to lead multi-quarter initiatives from design to production operation with measurable impact.
• Deep expertise in LLM orchestration patterns and agent frameworks across providers.
• Cross-functional collaboration with security, legal, and product to ship production AI systems.

Responsibilities

• Own architecture and delivery of core platform systems including the LLM Gateway, AI Hub, and agent runtime with microVM sandboxes.
• Drive design and implementation of Knowledge Base infrastructure connecting data sources to vector stores and markdown stores.
• Lead AI FinOps capabilities including spend attribution, governance, and cost optimization across AI workloads.
• Partner with security, legal, finance, product, and external partners to ship high-impact platform capabilities.
• Build evaluation and observability tooling including LLM-as-judge harnesses and full tracing for production agents.
• Shape applied AI strategy by embedding with teams to build production agents, including fine-tuning where appropriate.

Skills

LLM orchestration

Python

Go/Rust/C

ML/AI infrastructure

Distributed platform services

Tools

Vector databases

Model serving infrastructure

MicroVM sandboxes

Job description

Ready to do the most impactful work of your career? AtCoinbase, we are uncompromising on our mission to increase economic freedom. The bar is high, the environment is intense, and we like it that way. This isn’t a place for complacency, it’s a place to be pushed past your perceived limits. If you’re ready to build the future of finance alongside people who refuse to settle for “good enough,” you belong here. Coinbase is a remote-first, but not remote-only company. Expect to get together quarterly for intense in-person working sessions called “surges.”learn more about working at Coinbase.

As a Senior Software Engineer on the AI Platform team within the Platform group, you’ll build and operate the LLM and agent infrastructure that every team at Coinbase depends on. This team owns the company’s single path to large language models and the full agent lifecycle: build, deploy, run, observe, and improve. You’ll lead multi-quarter technical initiatives across the platform, from gateway and runtime systems to knowledge bases and applied AI agents, directly shaping how Coinbase scales AI across the organization.

What you’ll do:

• Own the architecture and delivery of core platform systems including the LLM Gateway (60 models, auth, PII redaction, fallbacks, cost optimization), AI Hub, and agent runtime with microVM sandboxes and governed MCP gateway
• Drive the design and implementation of Knowledge Base infrastructure, connecting data sources to auto-provisioned vector and markdown stores queryable by any agent
• Lead AI FinOps capabilities including spend attribution, governance, and cost optimization across all AI workloads company-wide
• Partner across engineering, security, legal, finance, product, and external partners at frontier labs and major cloud providers to ship high-impact platform capabilities
• Build evaluation and observability tooling including LLM-as-judge harnesses, full tracing, and feedback loops that let subject matter experts refine production agents
• Shape applied AI strategy by embedding with teams to build production agents, applying fine-tuning and traditional ML where it outperforms prompting

Required Skills and Experience:

• 5 years of software engineering experience with demonstrated expertise building ML/AI infrastructure, LLM systems, or distributed platform services at scale
• Demonstrated ability to lead multi-quarter initiatives end-to-end, from technical design through production operation, with measurable platform-wide impact
• Deep expertise in LLM orchestration patterns, agent frameworks, vector databases, and model serving infrastructure across multiple providers
• Proven track record of cross-functional partnership with security, legal, and product teams to ship governed, production-grade AI systems
• Fluency in Python and at least one systems language (Go, Rust, or C ), with production experience building APIs, microservices, and runtime environments
• Utilizes generative AI responsibly, maintaining human oversight to deliver business-ready outputs and drive measurable improvements in workflow efficiency, cost, and quality.

Public Blog Posts:

• NodeSmith: AI-Driven Automation for Blockchain Node Upgrades
• Making Smarter Decisions, Faster with AI at Coinbase
• CB-GPT – The opportunity and the vision for GenAI at Coinbase
• Lessons from launching Enterprise-grade GenAI solutions at Coinbase
• AWS re:Invent 2025 – Scaling support, compliance, & productivity with conversational AI at Coinbase

*Pay Transparency Notice:** *Base salary varies by location (see range below). Total compensation may also include equity and bonus eligibility, and benefits (medical, dental, vision, 401(k)).

Annual base salary range (excluding equity and bonus):

$186,065—$218,900 USD

• *Application Limit:* *Candidates may submit a maximum of 3 applications within a 6-month period.
• *Equal Opportunity Employer:* *Coinbase is an Equal Opportunity Employer. All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, sexual orientation, gender identity, national origin, disability, protected veteran status, or genetic information. Applicants with criminal histories will be considered consistent with applicable federal, state, and local laws.
• *US Applicants:* *View Employee Rights, Know Your Rights, and E-Verify Notice of Participation.
• *Accommodations:* *If you are an individual with a disability who needs a reasonable accommodation, email us your request and contact info at accommodations[at]coinbase.com.Need screen reading technology? Click here to download a free compatible screen reader and view the tutorial.
• *Data Privacy & Arbitration:* *By submitting your application, you agree to our Candidate Privacy Notice. US applicants: By submitting your application, you agree to Arbitration of Disputes.