Senior AI Platform Engineer — Remote & LLMOps Leader

Capital One; San Francisco (CA); Remote; USD 286,000 - 327,000; Full time

Job summary

Capital One seeks a Sr. Distinguished AI Engineer to lead and architect enterprise AI solutions, spanning agent orchestration, RAG pipelines, and multi-tenant guardrails. You will guide cross-functional teams, drive RFCs, and build scalable GenAI tooling to accelerate production timelines.

The ideal candidate brings deep AI system design experience, leadership, and a passion for responsible AI, performance optimization, and security across cloud environments.

Qualifications

• Bachelor’s degree in CS/Engineering/AI with 10+ years of AI/ML experience, or Master’s with 8+ years.
• At least 10 years of experience programming with Python, Go, Scala, or Java.
• 9 years of experience deploying scalable and responsible AI solutions on cloud platforms (AWS, Google Cloud, Azure, or equivalent private cloud).
• 2+ years of experience supporting Agentic Frameworks (LangChain, CrewAI, Semantic Kernel, or AutoGen).
• 2+ years of experience with LLMOps (Google Cloud Vertex AI, Amazon SageMaker, Azure ML).
• 8+ years of experience designing mission-critical machine learning platforms.
• 2+ years of experience architecting, designing, developing, integrating, delivering, and supporting complex AI systems.
• Demonstrated ability to lead and mentor multiple engineering teams and influence cross-functional stakeholders up to VP level.
• Deep understanding of Responsible AI, data privacy and multi-tenant security patterns.
• K8s mastery (multi-region clusters, service mesh).
• Experience leading GenAI or LLM-Powered application architectures in production.

Responsibilities

• Partner with cross-functional teams to deliver AI-powered products that transform user and associate interactions.
• Contribute to the north star platform architecture with live diagrams and canonical APIs for agent orchestration, RAG pipelines, prompt libraries and multi-tenant policy enforcement.
• Standardize and automate agentic workflows by evaluating frameworks and hardening patterns for enterprise SLAs.
• Develop end-to-end GenAI SDK, CLI and starter kits to spin up secure, observable agentic workflows quickly.
• Help implement central guardrail services — prompt firewalls, content-filter hooks, audit APIs — for enterprise-wide safety.
• Collaborate to optimize orchestration and reduce per-token spend through batching, caching and heuristic tuning.
• Incubate POCs and drive RFCs like hierarchical agent memory and multimodal guardrails.
• Own Helm charts, operators and CRDs to scale agents to meet tenant SLAs.
• Coach and evangelize through architecture office hours, mentoring, design docs and blogs; represent Capital One at AI conferences.

Skills

Python

Go

Scala/Java

Kubernetes

LLMOps

Agentic Frameworks

Responsible AI

System design

Education

Bachelor’s degree in Computer Science, Engineering, or AI

Master’s degree in Computer Science, Computer Engineering, or relevant technical field

Tools

LangChain

CrewAI

Semantic Kernel (Microsoft)

AutoGen

Job description

Capital One seeks a Sr. Distinguished AI Engineer to lead and architect enterprise AI solutions, spanning agent orchestration, RAG pipelines, and multi-tenant guardrails. You will guide cross-functional teams, drive RFCs, and build scalable GenAI tooling to accelerate production timelines.

The ideal candidate brings deep AI system design experience, leadership, and a passion for responsible AI, performance optimization, and security across cloud environments.