Senior Generative AI Platform Engineer | LLMs & Agents

Capital One; San Jose (CA); On-site; USD 170,000 - 210,000; Full time

Job summary

Capital One is seeking an AI Engineer 5 to build responsible, scalable AI platforms. You will develop AI software components, including foundation models, LLM inference, and multi-agent workflows, using PyTorch, HuggingFace, and vector databases.

You will optimize performance and drive governance across AI systems. You will mentor engineers and collaborate with cross-functional teams to deliver AI-powered banking experiences.

Qualifications

• Bachelor's or Master's degree with related field and several years of AI/ML experience.
• 6+ years of experience programming in Python or other listed languages.
• Experience leading AI systems with tradeoffs on cost, latency, throughput, and accuracy.

Responsibilities

• Deliver AI-powered products with cross-functional teams.
• Design, develop, test, deploy AI software components (foundation model training, LLM inference, agents, etc.).
• Leverage OSS and SaaS AI tech to build scalable AI infrastructure.
• Improve foundation model optimization for production-scale systems.
• Contribute to technical vision and long-term roadmap of AI systems.
• Architect multi-model orchestration pipelines and cost-performance governance.

Skills

Python

Go

Scala

CUDA

Java

Education

Bachelor's degree in CS / AI / EE / CE

Master's degree in CS / AI / EE / CE

Tools

AWS Ultraclusters

Huggingface

VectorDBs

PyTorch

Job description

Capital One is seeking an AI Engineer 5 to build responsible, scalable AI platforms. You will develop AI software components, including foundation models, LLM inference, and multi-agent workflows, using PyTorch, HuggingFace, and vector databases.

You will optimize performance and drive governance across AI systems. You will mentor engineers and collaborate with cross-functional teams to deliver AI-powered banking experiences.